2026-02-23T07:34:45.226 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-23T07:34:45.239 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T07:34:45.314 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial/65533 branch: wip-bharath8-testing-2026-02-22-0716 description: rados/standalone/{supported-random-distro$/{rpm_latest} workloads/scrub} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '65533' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-bharath8-testing-2026-02-22-0716 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 5adce3ff0fe1645dcbc38d059f948571dc3d69da ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 5adce3ff0fe1645dcbc38d059f948571dc3d69da selinux: allowlist: - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 workunit: branch: wip-bharath8-testing-2026-02-22-0716 sha1: 5adce3ff0fe1645dcbc38d059f948571dc3d69da owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 60 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5057 sha1: 5adce3ff0fe1645dcbc38d059f948571dc3d69da sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath8-testing-2026-02-22-0716 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_5adce3ff0fe1645dcbc38d059f948571dc3d69da/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 5adce3ff0fe1645dcbc38d059f948571dc3d69da targets: trial129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPf3ld+shUDXzq8TI+sZ+He35bWiOpG+jwW2PxNV8POe+8+wmEweMwZCEpGg/FPODaNqdrcUXJ1nEUawu/QVSE= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: null - workunit: basedir: qa/standalone clients: all: - scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-23_07:12:59 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3318653 2026-02-23T07:34:45.314 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_5adce3ff0fe1645dcbc38d059f948571dc3d69da/qa; will attempt to use it 2026-02-23T07:34:45.315 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_5adce3ff0fe1645dcbc38d059f948571dc3d69da/qa/tasks 2026-02-23T07:34:45.315 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-23T07:34:45.317 INFO:teuthology.task.internal:Checking packages... 2026-02-23T07:34:45.317 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '5adce3ff0fe1645dcbc38d059f948571dc3d69da' 2026-02-23T07:34:45.317 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-23T07:34:45.317 INFO:teuthology.packaging:ref: None 2026-02-23T07:34:45.317 INFO:teuthology.packaging:tag: None 2026-02-23T07:34:45.317 INFO:teuthology.packaging:branch: wip-bharath8-testing-2026-02-22-0716 2026-02-23T07:34:45.317 INFO:teuthology.packaging:sha1: 5adce3ff0fe1645dcbc38d059f948571dc3d69da 2026-02-23T07:34:45.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-bharath8-testing-2026-02-22-0716 2026-02-23T07:34:45.434 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5433.g5adce3ff 2026-02-23T07:34:45.436 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-23T07:34:45.448 INFO:teuthology.task.internal:no buildpackages task found 2026-02-23T07:34:45.448 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-23T07:34:45.465 INFO:teuthology.task.internal:Saving configuration 2026-02-23T07:34:45.474 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-23T07:34:45.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-23T07:34:45.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial129.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial/65533', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-23 07:31:11.230472', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDPf3ld+shUDXzq8TI+sZ+He35bWiOpG+jwW2PxNV8POe+8+wmEweMwZCEpGg/FPODaNqdrcUXJ1nEUawu/QVSE='} 2026-02-23T07:34:45.568 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-23T07:34:45.579 INFO:teuthology.task.internal:roles: ubuntu@trial129.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-23T07:34:45.579 INFO:teuthology.run_tasks:Running task console_log... 2026-02-23T07:34:45.670 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7c2d27405760>, signals=[15]) 2026-02-23T07:34:45.670 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-23T07:34:45.681 INFO:teuthology.task.internal:Opening connections... 2026-02-23T07:34:45.681 DEBUG:teuthology.task.internal:connecting to ubuntu@trial129.front.sepia.ceph.com 2026-02-23T07:34:45.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T07:34:45.744 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-23T07:34:45.756 DEBUG:teuthology.orchestra.run.trial129:> uname -m 2026-02-23T07:34:45.819 INFO:teuthology.orchestra.run.trial129.stdout:x86_64 2026-02-23T07:34:45.819 DEBUG:teuthology.orchestra.run.trial129:> cat /etc/os-release 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:NAME="Rocky Linux" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:VERSION="10.1 (Red Quartz)" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:ID="rocky" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:ID_LIKE="rhel centos fedora" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:VERSION_ID="10.1" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:PLATFORM_ID="platform:el10" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:ANSI_COLOR="0;32" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:LOGO="fedora-logo-icon" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-23T07:34:45.877 INFO:teuthology.orchestra.run.trial129.stdout:HOME_URL="https://rockylinux.org/" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:VENDOR_NAME="RESF" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:VENDOR_URL="https://resf.org/" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:SUPPORT_END="2035-05-31" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-23T07:34:45.878 INFO:teuthology.orchestra.run.trial129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-23T07:34:45.879 INFO:teuthology.lock.ops:Updating trial129.front.sepia.ceph.com on lock server 2026-02-23T07:34:45.984 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-23T07:34:45.997 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-23T07:34:46.009 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-23T07:34:46.009 DEBUG:teuthology.orchestra.run.trial129:> test '!' -e /home/ubuntu/cephtest 2026-02-23T07:34:46.026 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-23T07:34:46.039 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-23T07:34:46.040 DEBUG:teuthology.orchestra.run.trial129:> test -z $(ls -A /var/lib/ceph) 2026-02-23T07:34:46.085 INFO:teuthology.orchestra.run.trial129.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-23T07:34:46.085 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-23T07:34:46.173 INFO:teuthology.run_tasks:Running task kernel... 2026-02-23T07:34:46.192 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-23T07:34:46.192 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-23T07:34:46.192 DEBUG:teuthology.orchestra.run.trial129:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-23T07:34:46.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T07:34:46.208 DEBUG:teuthology.orchestra.run.trial129:> uname -r 2026-02-23T07:34:46.265 INFO:teuthology.orchestra.run.trial129.stdout:6.12.0-124.35.1.el10_1.x86_64 2026-02-23T07:34:46.265 INFO:teuthology.task.kernel:Running kernel on trial129: 6.12.0-124.35.1.el10_1.x86_64 2026-02-23T07:34:46.265 DEBUG:teuthology.orchestra.run.trial129:> sudo yum install -y kernel 2026-02-23T07:34:46.786 INFO:teuthology.orchestra.run.trial129.stdout:Rocky Linux 10 - AppStream 22 MB/s | 2.2 MB 00:00 2026-02-23T07:34:47.069 INFO:teuthology.orchestra.run.trial129.stdout:Rocky Linux 10 - BaseOS 75 MB/s | 12 MB 00:00 2026-02-23T07:34:47.590 INFO:teuthology.orchestra.run.trial129.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 508 kB 00:00 2026-02-23T07:34:48.404 INFO:teuthology.orchestra.run.trial129.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 6.2 MB 00:00 2026-02-23T07:34:49.083 INFO:teuthology.orchestra.run.trial129.stdout:lab-extras 129 kB/s | 3.7 kB 00:00 2026-02-23T07:34:49.488 INFO:teuthology.orchestra.run.trial129.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-23T07:34:49.489 INFO:teuthology.orchestra.run.trial129.stdout:Package kernel-6.12.0-124.35.1.el10_1.x86_64 is already installed. 2026-02-23T07:34:49.500 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:34:49.501 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:34:49.501 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:34:49.525 DEBUG:teuthology.orchestra.run.trial129:> echo no | sudo yum reinstall kernel || true 2026-02-23T07:34:49.881 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout: Package Architecture Version Repository Size 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:Reinstalling: 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 2.8 M 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 0 2026-02-23T07:34:49.882 INFO:teuthology.orchestra.run.trial129.stderr:Operation aborted. 2026-02-23T07:34:49.901 INFO:teuthology.orchestra.run.trial129.stdout:Is this ok [y/N]: 2026-02-23T07:34:49.901 DEBUG:teuthology.orchestra.run.trial129:> sudo yum reinstall -y kernel || true 2026-02-23T07:34:50.179 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:01 ago on Mon 23 Feb 2026 07:34:49 AM UTC. 2026-02-23T07:34:50.214 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout: Package Architecture Version Repository Size 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout:Reinstalling: 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout: kernel x86_64 6.12.0-124.27.1.el10_1 baseos 1.4 M 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout: kernel x86_64 6.12.0-124.35.1.el10_1 baseos 1.4 M 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:34:50.215 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:34:50.216 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 2.8 M 2026-02-23T07:34:50.216 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 0 2026-02-23T07:34:50.216 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:34:50.267 INFO:teuthology.orchestra.run.trial129.stdout:(1/2): kernel-6.12.0-124.27.1.el10_1.x86_64.rpm 26 MB/s | 1.4 MB 00:00 2026-02-23T07:34:50.302 INFO:teuthology.orchestra.run.trial129.stdout:(2/2): kernel-6.12.0-124.35.1.el10_1.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2026-02-23T07:34:50.303 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:34:50.303 INFO:teuthology.orchestra.run.trial129.stdout:Total 31 MB/s | 2.8 MB 00:00 2026-02-23T07:34:50.303 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:34:50.382 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:34:50.382 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:34:50.403 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:34:50.403 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:34:50.447 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:34:50.455 INFO:teuthology.orchestra.run.trial129.stdout: Reinstalling : kernel-6.12.0-124.35.1.el10_1.x86_64 1/4 2026-02-23T07:34:50.458 INFO:teuthology.orchestra.run.trial129.stdout: Reinstalling : kernel-6.12.0-124.27.1.el10_1.x86_64 2/4 2026-02-23T07:34:50.459 INFO:teuthology.orchestra.run.trial129.stdout: Cleanup : kernel-6.12.0-124.35.1.el10_1.x86_64 3/4 2026-02-23T07:34:50.572 INFO:teuthology.orchestra.run.trial129.stdout: Cleanup : kernel-6.12.0-124.27.1.el10_1.x86_64 4/4 2026-02-23T07:34:50.572 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:34:50.572 INFO:teuthology.orchestra.run.trial129.stdout:Reinstalled: 2026-02-23T07:34:50.572 INFO:teuthology.orchestra.run.trial129.stdout: kernel-6.12.0-124.27.1.el10_1.x86_64 kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-23T07:34:50.572 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:34:50.572 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:34:50.597 DEBUG:teuthology.orchestra.run.trial129:> rpm -q kernel | sort -rV | head -n 1 2026-02-23T07:34:50.629 INFO:teuthology.orchestra.run.trial129.stdout:kernel-6.12.0-124.35.1.el10_1.x86_64 2026-02-23T07:34:50.629 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.35.1.el10_1.x86_64 2026-02-23T07:34:50.629 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-23T07:34:50.629 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-23T07:34:50.629 DEBUG:teuthology.orchestra.run.trial129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-23T07:34:50.695 INFO:teuthology.orchestra.run.trial129.stdout:ttyS1 2026-02-23T07:34:50.728 DEBUG:teuthology.parallel:result is None 2026-02-23T07:34:50.729 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-23T07:34:50.744 INFO:teuthology.task.internal:Creating test directory... 2026-02-23T07:34:50.745 DEBUG:teuthology.orchestra.run.trial129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-23T07:34:50.787 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-23T07:34:50.798 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-23T07:34:50.812 INFO:teuthology.task.internal:Creating archive directory... 2026-02-23T07:34:50.812 DEBUG:teuthology.orchestra.run.trial129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-23T07:34:50.845 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-23T07:34:50.856 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-23T07:34:50.856 DEBUG:teuthology.orchestra.run.trial129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-23T07:34:50.910 INFO:teuthology.orchestra.run.trial129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:34:50.920 INFO:teuthology.orchestra.run.trial129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:34:50.922 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-23T07:34:50.934 INFO:teuthology.task.internal:Configuring sudo... 2026-02-23T07:34:50.934 DEBUG:teuthology.orchestra.run.trial129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-23T07:34:50.989 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-23T07:34:51.001 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-23T07:34:51.002 DEBUG:teuthology.orchestra.run.trial129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-23T07:34:51.046 DEBUG:teuthology.orchestra.run.trial129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T07:34:51.178 DEBUG:teuthology.orchestra.run.trial129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T07:34:51.204 DEBUG:teuthology.orchestra.run.trial129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T07:34:51.328 DEBUG:teuthology.orchestra.run.trial129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T07:34:51.355 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:34:51.355 DEBUG:teuthology.orchestra.run.trial129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-23T07:34:51.422 DEBUG:teuthology.orchestra.run.trial129:> sudo service rsyslog restart 2026-02-23T07:34:51.491 INFO:teuthology.orchestra.run.trial129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T07:34:52.023 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-23T07:34:52.036 INFO:teuthology.task.internal:Starting timer... 2026-02-23T07:34:52.037 INFO:teuthology.run_tasks:Running task pcp... 2026-02-23T07:34:52.059 INFO:teuthology.run_tasks:Running task selinux... 2026-02-23T07:34:52.078 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['comm="systemd".*denied.*\\{ prog_run \\}.*tclass=bpf.*permissive=1']} 2026-02-23T07:34:52.078 DEBUG:teuthology.orchestra.run.trial129:> sudo service auditd rotate 2026-02-23T07:34:52.109 INFO:teuthology.orchestra.run.trial129.stdout:Rotating logs: 2026-02-23T07:34:52.111 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-23T07:34:52.111 DEBUG:teuthology.orchestra.run.trial129:> /usr/sbin/getenforce 2026-02-23T07:34:52.169 INFO:teuthology.orchestra.run.trial129.stdout:Permissive 2026-02-23T07:34:52.169 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial129.front.sepia.ceph.com': 'permissive'} 2026-02-23T07:34:52.169 DEBUG:teuthology.orchestra.run.trial129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-23T07:34:52.227 INFO:teuthology.orchestra.run.trial129.stderr:grep: Invalid content of \{\} 2026-02-23T07:34:52.237 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-23T07:34:52.238 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-23T07:34:52.238 DEBUG:teuthology.orchestra.run.trial129:> sudo /usr/sbin/setenforce permissive 2026-02-23T07:34:52.305 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-23T07:34:52.322 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-23T07:34:52.334 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-23T07:34:52.336 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-23T07:37:40.976 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial129.front.sepia.ceph.com')] 2026-02-23T07:37:40.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial129.front.sepia.ceph.com' 2026-02-23T07:37:40.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-23T07:37:41.053 DEBUG:teuthology.orchestra.run.trial129:> true 2026-02-23T07:37:41.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial129.front.sepia.ceph.com' 2026-02-23T07:37:41.144 INFO:teuthology.run_tasks:Running task clock... 2026-02-23T07:37:41.160 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-23T07:37:41.160 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-23T07:37:41.160 DEBUG:teuthology.orchestra.run.trial129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T07:37:41.213 INFO:teuthology.orchestra.run.trial129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-23T07:37:41.226 INFO:teuthology.orchestra.run.trial129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-23T07:37:41.248 INFO:teuthology.orchestra.run.trial129.stderr:sudo: ntpd: command not found 2026-02-23T07:37:41.258 INFO:teuthology.orchestra.run.trial129.stdout:506 Cannot talk to daemon 2026-02-23T07:37:41.271 INFO:teuthology.orchestra.run.trial129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-23T07:37:41.285 INFO:teuthology.orchestra.run.trial129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-23T07:37:41.340 INFO:teuthology.orchestra.run.trial129.stderr:bash: line 1: ntpq: command not found 2026-02-23T07:37:41.361 INFO:teuthology.orchestra.run.trial129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T07:37:41.361 INFO:teuthology.orchestra.run.trial129.stdout:=============================================================================== 2026-02-23T07:37:41.362 INFO:teuthology.orchestra.run.trial129.stdout:^? 216-144-228-179-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T07:37:41.362 INFO:teuthology.orchestra.run.trial129.stdout:^? 144.202.62.209.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T07:37:41.362 INFO:teuthology.orchestra.run.trial129.stdout:^? neoknet.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T07:37:41.362 INFO:teuthology.orchestra.run.trial129.stdout:^? connected.by.freedominte> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-23T07:37:41.363 INFO:teuthology.run_tasks:Running task pexec... 2026-02-23T07:37:41.388 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-23T07:37:41.389 DEBUG:teuthology.orchestra.run.trial129:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-23T07:37:41.404 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial129.front.sepia.ceph.com 2026-02-23T07:37:41.404 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-23T07:37:41.404 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-23T07:37:41.586 INFO:teuthology.orchestra.run.trial129.stdout:No match for argument: nvme-cli 2026-02-23T07:37:41.586 INFO:teuthology.orchestra.run.trial129.stderr:No packages marked for removal. 2026-02-23T07:37:41.588 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:37:41.588 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:37:41.588 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:37:41.872 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:26 ago on Mon 23 Feb 2026 07:37:15 AM UTC. 2026-02-23T07:37:41.906 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:37:41.907 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:37:41.907 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repository Size 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout:Installing dependencies: 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-23T07:37:41.908 INFO:teuthology.orchestra.run.trial129.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout:Install 8 Packages 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 2.8 M 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 13 M 2026-02-23T07:37:41.909 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:37:41.958 INFO:teuthology.orchestra.run.trial129.stdout:(1/8): nvmetcli-0.8-1.el10.noarch.rpm 1.0 MB/s | 54 kB 00:00 2026-02-23T07:37:41.961 INFO:teuthology.orchestra.run.trial129.stdout:(2/8): python3-configshell-1.1.30-8.el10.noarch 1.7 MB/s | 90 kB 00:00 2026-02-23T07:37:41.970 INFO:teuthology.orchestra.run.trial129.stdout:(3/8): nvme-cli-2.13-2.el10.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2026-02-23T07:37:41.977 INFO:teuthology.orchestra.run.trial129.stdout:(4/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 5.8 MB/s | 111 kB 00:00 2026-02-23T07:37:41.979 INFO:teuthology.orchestra.run.trial129.stdout:(5/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 15 MB/s | 271 kB 00:00 2026-02-23T07:37:41.985 INFO:teuthology.orchestra.run.trial129.stdout:(6/8): python3-typing-extensions-4.9.0-6.el10.n 4.9 MB/s | 77 kB 00:00 2026-02-23T07:37:41.994 INFO:teuthology.orchestra.run.trial129.stdout:(7/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 3.1 MB/s | 48 kB 00:00 2026-02-23T07:37:42.001 INFO:teuthology.orchestra.run.trial129.stdout:(8/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 45 MB/s | 1.1 MB 00:00 2026-02-23T07:37:42.002 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:37:42.002 INFO:teuthology.orchestra.run.trial129.stdout:Total 30 MB/s | 2.8 MB 00:00 2026-02-23T07:37:42.002 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:37:42.010 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:37:42.010 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:37:42.076 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:37:42.076 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:37:42.144 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:37:42.147 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-23T07:37:42.173 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-23T07:37:42.180 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-23T07:37:42.185 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-23T07:37:42.188 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-23T07:37:42.193 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-23T07:37:42.193 INFO:teuthology.orchestra.run.trial129.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-23T07:37:42.249 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-23T07:37:42.251 INFO:teuthology.orchestra.run.trial129.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-23T07:37:42.512 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-23T07:37:42.512 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-23T07:37:42.513 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:42.815 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:42.815 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:37:42.815 INFO:teuthology.orchestra.run.trial129.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-23T07:37:42.815 INFO:teuthology.orchestra.run.trial129.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-23T07:37:42.815 INFO:teuthology.orchestra.run.trial129.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:42.816 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:37:42.845 DEBUG:teuthology.parallel:result is None 2026-02-23T07:37:42.845 INFO:teuthology.run_tasks:Running task install... 2026-02-23T07:37:42.859 DEBUG:teuthology.task.install:project ceph 2026-02-23T07:37:42.859 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5adce3ff0fe1645dcbc38d059f948571dc3d69da'}} 2026-02-23T07:37:42.859 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '5adce3ff0fe1645dcbc38d059f948571dc3d69da'} 2026-02-23T07:37:42.859 INFO:teuthology.task.install:Using flavor: default 2026-02-23T07:37:42.868 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-23T07:37:42.868 INFO:teuthology.task.install:extra packages: [] 2026-02-23T07:37:42.869 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5adce3ff0fe1645dcbc38d059f948571dc3d69da', 'tag': None, 'wait_for_package': False} 2026-02-23T07:37:42.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=5adce3ff0fe1645dcbc38d059f948571dc3d69da 2026-02-23T07:37:43.033 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath8-testing-2026-02-22-0716/5adce3ff0fe1645dcbc38d059f948571dc3d69da/rocky/10/flavors/default/ 2026-02-23T07:37:43.034 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5433.g5adce3ff 2026-02-23T07:37:43.330 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath8-testing-2026-02-22-0716/5adce3ff0fe1645dcbc38d059f948571dc3d69da/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath8-testing-2026-02-22-0716/5adce3ff0fe1645dcbc38d059f948571dc3d69da/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-bharath8-testing-2026-02-22-0716/5adce3ff0fe1645dcbc38d059f948571dc3d69da/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-23T07:37:43.330 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:37:43.330 DEBUG:teuthology.orchestra.run.trial129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-23T07:37:43.358 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-23T07:37:43.358 DEBUG:teuthology.orchestra.run.trial129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5adce3ff0fe1645dcbc38d059f948571dc3d69da/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-23T07:37:43.426 DEBUG:teuthology.orchestra.run.trial129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-23T07:37:43.504 DEBUG:teuthology.orchestra.run.trial129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-23T07:37:43.570 INFO:teuthology.orchestra.run.trial129.stdout:check_obsoletes = 1 2026-02-23T07:37:43.572 DEBUG:teuthology.orchestra.run.trial129:> sudo yum clean all 2026-02-23T07:37:43.723 INFO:teuthology.orchestra.run.trial129.stdout:28 files removed 2026-02-23T07:37:43.738 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-radosgw 2026-02-23T07:37:44.358 INFO:teuthology.orchestra.run.trial129.stdout:ceph packages for x86_64 55 kB/s | 26 kB 00:00 2026-02-23T07:37:44.804 INFO:teuthology.orchestra.run.trial129.stdout:ceph noarch packages 8.9 kB/s | 3.9 kB 00:00 2026-02-23T07:37:45.262 INFO:teuthology.orchestra.run.trial129.stdout:ceph source packages 3.9 kB/s | 1.8 kB 00:00 2026-02-23T07:37:45.355 INFO:teuthology.orchestra.run.trial129.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-23T07:37:45.689 INFO:teuthology.orchestra.run.trial129.stdout:Rocky Linux 10 - BaseOS 59 MB/s | 12 MB 00:00 2026-02-23T07:37:46.217 INFO:teuthology.orchestra.run.trial129.stdout:Rocky Linux 10 - CRB 7.1 MB/s | 508 kB 00:00 2026-02-23T07:37:46.791 INFO:teuthology.orchestra.run.trial129.stdout:Extra Packages for Enterprise Linux 12 MB/s | 6.2 MB 00:00 2026-02-23T07:37:47.472 INFO:teuthology.orchestra.run.trial129.stdout:lab-extras 159 kB/s | 3.7 kB 00:00 2026-02-23T07:37:47.989 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:37:47.990 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:37:47.990 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repository Size 2026-02-23T07:37:47.990 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:37:47.990 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: ceph-radosgw x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 14 M 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout:Upgrading: 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: librados2 x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 3.6 M 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: librbd1 x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 2.8 M 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout:Installing dependencies: 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: ceph-base x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 5.4 M 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: ceph-common x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 25 M 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: ceph-selinux x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 25 k 2026-02-23T07:37:47.991 INFO:teuthology.orchestra.run.trial129.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs2 x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 937 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: libradosstriper1 x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 252 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-23T07:37:47.992 INFO:teuthology.orchestra.run.trial129.stdout: librgw2 x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 6.7 M 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: python3-ceph-argparse x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 57 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: python3-ceph-common x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 239 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: python3-cephfs x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 253 k 2026-02-23T07:37:47.993 INFO:teuthology.orchestra.run.trial129.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: python3-rados x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 353 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: python3-rbd x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 372 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: python3-rgw x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 130 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout:Installing weak dependencies: 2026-02-23T07:37:47.994 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs-daemon x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 40 k 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 27 k 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout:Install 42 Packages 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout:Upgrade 2 Packages 2026-02-23T07:37:47.995 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:47.996 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 73 M 2026-02-23T07:37:47.996 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:37:49.874 INFO:teuthology.orchestra.run.trial129.stdout:(1/44): ceph-base-20.3.0-5433.g5adce3ff.el10.x8 3.0 MB/s | 5.4 MB 00:01 2026-02-23T07:37:49.934 INFO:teuthology.orchestra.run.trial129.stdout:(2/44): ceph-selinux-20.3.0-5433.g5adce3ff.el10 419 kB/s | 25 kB 00:00 2026-02-23T07:37:49.995 INFO:teuthology.orchestra.run.trial129.stdout:(3/44): libcephfs-daemon-20.3.0-5433.g5adce3ff. 654 kB/s | 40 kB 00:00 2026-02-23T07:37:50.055 INFO:teuthology.orchestra.run.trial129.stdout:(4/44): libcephfs-proxy2-20.3.0-5433.g5adce3ff. 446 kB/s | 27 kB 00:00 2026-02-23T07:37:50.313 INFO:teuthology.orchestra.run.trial129.stdout:(5/44): libcephfs2-20.3.0-5433.g5adce3ff.el10.x 3.5 MB/s | 937 kB 00:00 2026-02-23T07:37:50.380 INFO:teuthology.orchestra.run.trial129.stdout:(6/44): libradosstriper1-20.3.0-5433.g5adce3ff. 3.7 MB/s | 252 kB 00:00 2026-02-23T07:37:51.473 INFO:teuthology.orchestra.run.trial129.stdout:(7/44): ceph-radosgw-20.3.0-5433.g5adce3ff.el10 4.1 MB/s | 14 MB 00:03 2026-02-23T07:37:51.536 INFO:teuthology.orchestra.run.trial129.stdout:(8/44): python3-ceph-argparse-20.3.0-5433.g5adc 913 kB/s | 57 kB 00:00 2026-02-23T07:37:51.604 INFO:teuthology.orchestra.run.trial129.stdout:(9/44): python3-ceph-common-20.3.0-5433.g5adce3 3.4 MB/s | 239 kB 00:00 2026-02-23T07:37:51.673 INFO:teuthology.orchestra.run.trial129.stdout:(10/44): python3-cephfs-20.3.0-5433.g5adce3ff.e 3.6 MB/s | 253 kB 00:00 2026-02-23T07:37:51.745 INFO:teuthology.orchestra.run.trial129.stdout:(11/44): python3-rados-20.3.0-5433.g5adce3ff.el 4.9 MB/s | 353 kB 00:00 2026-02-23T07:37:51.883 INFO:teuthology.orchestra.run.trial129.stdout:(12/44): librgw2-20.3.0-5433.g5adce3ff.el10.x86 4.4 MB/s | 6.7 MB 00:01 2026-02-23T07:37:51.884 INFO:teuthology.orchestra.run.trial129.stdout:(13/44): python3-rbd-20.3.0-5433.g5adce3ff.el10 2.6 MB/s | 372 kB 00:00 2026-02-23T07:37:51.922 INFO:teuthology.orchestra.run.trial129.stdout:(14/44): boost-program-options-1.83.0-5.el10.x8 2.8 MB/s | 109 kB 00:00 2026-02-23T07:37:51.940 INFO:teuthology.orchestra.run.trial129.stdout:(15/44): libnbd-1.22.2-3.el10_1.x86_64.rpm 9.5 MB/s | 175 kB 00:00 2026-02-23T07:37:51.945 INFO:teuthology.orchestra.run.trial129.stdout:(16/44): python3-rgw-20.3.0-5433.g5adce3ff.el10 2.1 MB/s | 130 kB 00:00 2026-02-23T07:37:51.957 INFO:teuthology.orchestra.run.trial129.stdout:(17/44): librabbitmq-0.14.0-3.el10.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2026-02-23T07:37:51.968 INFO:teuthology.orchestra.run.trial129.stdout:(18/44): librdkafka-2.1.1-7.el10.x86_64.rpm 31 MB/s | 725 kB 00:00 2026-02-23T07:37:51.981 INFO:teuthology.orchestra.run.trial129.stdout:(19/44): protobuf-3.19.6-11.el10.x86_64.rpm 42 MB/s | 1.0 MB 00:00 2026-02-23T07:37:51.985 INFO:teuthology.orchestra.run.trial129.stdout:(20/44): python3-prettytable-3.6.0-10.el10.noar 4.1 MB/s | 70 kB 00:00 2026-02-23T07:37:51.999 INFO:teuthology.orchestra.run.trial129.stdout:(21/44): qatlib-service-24.09.0-2.el10.x86_64.r 2.6 MB/s | 37 kB 00:00 2026-02-23T07:37:52.011 INFO:teuthology.orchestra.run.trial129.stdout:(22/44): qatlib-24.09.0-2.el10.x86_64.rpm 7.4 MB/s | 229 kB 00:00 2026-02-23T07:37:52.015 INFO:teuthology.orchestra.run.trial129.stdout:(23/44): qatzip-libs-1.3.1-1.el10.x86_64.rpm 4.0 MB/s | 66 kB 00:00 2026-02-23T07:37:52.028 INFO:teuthology.orchestra.run.trial129.stdout:(24/44): utf8proc-2.7.0-9.el10.x86_64.rpm 4.7 MB/s | 80 kB 00:00 2026-02-23T07:37:52.029 INFO:teuthology.orchestra.run.trial129.stdout:(25/44): daxctl-libs-80-4.el10.x86_64.rpm 3.0 MB/s | 42 kB 00:00 2026-02-23T07:37:52.041 INFO:teuthology.orchestra.run.trial129.stdout:(26/44): mailcap-2.1.54-8.el10.noarch.rpm 2.6 MB/s | 34 kB 00:00 2026-02-23T07:37:52.045 INFO:teuthology.orchestra.run.trial129.stdout:(27/44): ndctl-libs-80-4.el10.x86_64.rpm 5.3 MB/s | 89 kB 00:00 2026-02-23T07:37:52.058 INFO:teuthology.orchestra.run.trial129.stdout:(28/44): pciutils-3.13.0-6.el10.x86_64.rpm 7.2 MB/s | 122 kB 00:00 2026-02-23T07:37:52.070 INFO:teuthology.orchestra.run.trial129.stdout:(29/44): lttng-ust-2.13.7-5.el10.x86_64.rpm 13 MB/s | 334 kB 00:00 2026-02-23T07:37:52.140 INFO:teuthology.orchestra.run.trial129.stdout:(30/44): gperftools-libs-2.15-4.el10_0.x86_64.r 4.2 MB/s | 303 kB 00:00 2026-02-23T07:37:52.152 INFO:teuthology.orchestra.run.trial129.stdout:(31/44): abseil-cpp-20240722.1-1.el10_0.x86_64. 6.1 MB/s | 590 kB 00:00 2026-02-23T07:37:52.177 INFO:teuthology.orchestra.run.trial129.stdout:(32/44): libarrow-doc-17.0.0-9.el10_2.noarch.rp 1.1 MB/s | 27 kB 00:00 2026-02-23T07:37:52.219 INFO:teuthology.orchestra.run.trial129.stdout:(33/44): liboath-2.6.12-1.el10_0.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-23T07:37:52.232 INFO:teuthology.orchestra.run.trial129.stdout:(34/44): libarrow-17.0.0-9.el10_2.x86_64.rpm 62 MB/s | 5.7 MB 00:00 2026-02-23T07:37:52.254 INFO:teuthology.orchestra.run.trial129.stdout:(35/44): libpmem-2.1.0-2.el10_0.x86_64.rpm 5.0 MB/s | 112 kB 00:00 2026-02-23T07:37:52.266 INFO:teuthology.orchestra.run.trial129.stdout:(36/44): liborc2-2.0.7-1.el10_2.x86_64.rpm 11 MB/s | 515 kB 00:00 2026-02-23T07:37:52.271 INFO:teuthology.orchestra.run.trial129.stdout:(37/44): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 9.5 MB/s | 161 kB 00:00 2026-02-23T07:37:52.282 INFO:teuthology.orchestra.run.trial129.stdout:(38/44): libunwind-1.8.0-4.el10_0.x86_64.rpm 4.5 MB/s | 73 kB 00:00 2026-02-23T07:37:52.304 INFO:teuthology.orchestra.run.trial129.stdout:(39/44): re2-20251105-1.el10_2.x86_64.rpm 9.7 MB/s | 221 kB 00:00 2026-02-23T07:37:52.339 INFO:teuthology.orchestra.run.trial129.stdout:(40/44): parquet-libs-17.0.0-9.el10_2.x86_64.rp 15 MB/s | 1.0 MB 00:00 2026-02-23T07:37:52.371 INFO:teuthology.orchestra.run.trial129.stdout:(41/44): thrift-0.20.0-4.el10_1.x86_64.rpm 25 MB/s | 1.7 MB 00:00 2026-02-23T07:37:53.032 INFO:teuthology.orchestra.run.trial129.stdout:(42/44): librbd1-20.3.0-5433.g5adce3ff.el10.x86 4.3 MB/s | 2.8 MB 00:00 2026-02-23T07:37:53.123 INFO:teuthology.orchestra.run.trial129.stdout:(43/44): librados2-20.3.0-5433.g5adce3ff.el10.x 4.6 MB/s | 3.6 MB 00:00 2026-02-23T07:37:53.345 INFO:teuthology.orchestra.run.trial129.stdout:(44/44): ceph-common-20.3.0-5433.g5adce3ff.el10 4.7 MB/s | 25 MB 00:05 2026-02-23T07:37:53.346 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:37:53.346 INFO:teuthology.orchestra.run.trial129.stdout:Total 14 MB/s | 73 MB 00:05 2026-02-23T07:37:53.346 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:37:53.366 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:37:53.366 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:37:53.633 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:37:53.633 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:37:53.961 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:37:54.078 INFO:teuthology.orchestra.run.trial129.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 1/46 2026-02-23T07:37:54.084 INFO:teuthology.orchestra.run.trial129.stdout: Upgrading : librados2-2:20.3.0-5433.g5adce3ff.el10.x86_64 2/46 2026-02-23T07:37:54.125 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: librados2-2:20.3.0-5433.g5adce3ff.el10.x86_64 2/46 2026-02-23T07:37:54.126 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libcephfs2-2:20.3.0-5433.g5adce3ff.el10.x86_64 3/46 2026-02-23T07:37:54.140 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libcephfs2-2:20.3.0-5433.g5adce3ff.el10.x86_64 3/46 2026-02-23T07:37:54.142 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libcephfs-daemon-2:20.3.0-5433.g5adce3ff.el10.x86_ 4/46 2026-02-23T07:37:54.142 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libcephfs-proxy2-2:20.3.0-5433.g5adce3ff.el10.x86_ 5/46 2026-02-23T07:37:54.164 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5433.g5adce3ff.el10.x86_ 5/46 2026-02-23T07:37:54.168 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-rados-2:20.3.0-5433.g5adce3ff.el10.x86_64 6/46 2026-02-23T07:37:54.175 INFO:teuthology.orchestra.run.trial129.stdout: Installing : daxctl-libs-80-4.el10.x86_64 7/46 2026-02-23T07:37:54.176 INFO:teuthology.orchestra.run.trial129.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 8/46 2026-02-23T07:37:54.178 INFO:teuthology.orchestra.run.trial129.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 9/46 2026-02-23T07:37:54.180 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ndctl-libs-80-4.el10.x86_64 10/46 2026-02-23T07:37:54.181 INFO:teuthology.orchestra.run.trial129.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 11/46 2026-02-23T07:37:54.185 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 12/46 2026-02-23T07:37:54.194 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-ceph-argparse-2:20.3.0-5433.g5adce3ff.el10 13/46 2026-02-23T07:37:54.196 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-cephfs-2:20.3.0-5433.g5adce3ff.el10.x86_64 14/46 2026-02-23T07:37:54.199 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 15/46 2026-02-23T07:37:54.208 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 16/46 2026-02-23T07:37:54.208 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libradosstriper1-2:20.3.0-5433.g5adce3ff.el10.x86_ 17/46 2026-02-23T07:37:54.228 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5433.g5adce3ff.el10.x86_ 17/46 2026-02-23T07:37:54.232 INFO:teuthology.orchestra.run.trial129.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 18/46 2026-02-23T07:37:54.237 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 19/46 2026-02-23T07:37:54.261 INFO:teuthology.orchestra.run.trial129.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 20/46 2026-02-23T07:37:54.267 INFO:teuthology.orchestra.run.trial129.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 21/46 2026-02-23T07:37:54.270 INFO:teuthology.orchestra.run.trial129.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 22/46 2026-02-23T07:37:54.272 INFO:teuthology.orchestra.run.trial129.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 23/46 2026-02-23T07:37:54.273 INFO:teuthology.orchestra.run.trial129.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 24/46 2026-02-23T07:37:54.289 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 24/46 2026-02-23T07:37:54.306 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 25/46 2026-02-23T07:37:54.311 INFO:teuthology.orchestra.run.trial129.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 25/46 2026-02-23T07:37:54.313 INFO:teuthology.orchestra.run.trial129.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 26/46 2026-02-23T07:37:54.315 INFO:teuthology.orchestra.run.trial129.stdout: Installing : mailcap-2.1.54-8.el10.noarch 27/46 2026-02-23T07:37:54.317 INFO:teuthology.orchestra.run.trial129.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 28/46 2026-02-23T07:37:54.324 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 29/46 2026-02-23T07:37:54.329 INFO:teuthology.orchestra.run.trial129.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 30/46 2026-02-23T07:37:54.367 INFO:teuthology.orchestra.run.trial129.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 31/46 2026-02-23T07:37:54.370 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 32/46 2026-02-23T07:37:54.461 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 33/46 2026-02-23T07:37:54.462 INFO:teuthology.orchestra.run.trial129.stdout: Upgrading : librbd1-2:20.3.0-5433.g5adce3ff.el10.x86_64 34/46 2026-02-23T07:37:54.487 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: librbd1-2:20.3.0-5433.g5adce3ff.el10.x86_64 34/46 2026-02-23T07:37:54.489 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-rbd-2:20.3.0-5433.g5adce3ff.el10.x86_64 35/46 2026-02-23T07:37:54.496 INFO:teuthology.orchestra.run.trial129.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 36/46 2026-02-23T07:37:54.709 INFO:teuthology.orchestra.run.trial129.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 37/46 2026-02-23T07:37:54.710 INFO:teuthology.orchestra.run.trial129.stdout: Installing : librgw2-2:20.3.0-5433.g5adce3ff.el10.x86_64 38/46 2026-02-23T07:37:54.726 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: librgw2-2:20.3.0-5433.g5adce3ff.el10.x86_64 38/46 2026-02-23T07:37:54.744 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-rgw-2:20.3.0-5433.g5adce3ff.el10.x86_64 39/46 2026-02-23T07:37:54.746 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-ceph-common-2:20.3.0-5433.g5adce3ff.el10.x 40/46 2026-02-23T07:37:55.555 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-common-2:20.3.0-5433.g5adce3ff.el10.x86_64 41/46 2026-02-23T07:37:55.558 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-common-2:20.3.0-5433.g5adce3ff.el10.x86_64 41/46 2026-02-23T07:37:55.761 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-common-2:20.3.0-5433.g5adce3ff.el10.x86_64 41/46 2026-02-23T07:37:55.764 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-base-2:20.3.0-5433.g5adce3ff.el10.x86_64 42/46 2026-02-23T07:37:55.796 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-base-2:20.3.0-5433.g5adce3ff.el10.x86_64 42/46 2026-02-23T07:37:55.796 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-23T07:37:55.796 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-23T07:37:55.797 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:37:55.798 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-selinux-2:20.3.0-5433.g5adce3ff.el10.x86_64 43/46 2026-02-23T07:37:59.693 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5433.g5adce3ff.el10.x86_64 43/46 2026-02-23T07:37:59.693 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /sys 2026-02-23T07:37:59.693 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /proc 2026-02-23T07:37:59.693 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /mnt 2026-02-23T07:37:59.693 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /var/tmp 2026-02-23T07:37:59.693 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /home 2026-02-23T07:37:59.694 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /root 2026-02-23T07:37:59.694 INFO:teuthology.orchestra.run.trial129.stdout:skipping the directory /tmp 2026-02-23T07:37:59.694 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:00.130 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-radosgw-2:20.3.0-5433.g5adce3ff.el10.x86_64 44/46 2026-02-23T07:38:00.155 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5433.g5adce3ff.el10.x86_64 44/46 2026-02-23T07:38:00.155 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:00.155 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-23T07:38:00.155 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-23T07:38:00.155 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-23T07:38:00.156 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:00.158 INFO:teuthology.orchestra.run.trial129.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 45/46 2026-02-23T07:38:00.177 INFO:teuthology.orchestra.run.trial129.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 46/46 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: librados2-2:18.2.1-4.el10.x86_64 46/46 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout:Upgraded: 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout: librados2-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout: librbd1-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:00.546 INFO:teuthology.orchestra.run.trial129.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: ceph-base-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: ceph-common-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: ceph-radosgw-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: ceph-selinux-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs-daemon-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs-proxy2-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs2-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-23T07:38:00.547 INFO:teuthology.orchestra.run.trial129.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: libradosstriper1-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: librgw2-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: python3-ceph-argparse-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: python3-ceph-common-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: python3-cephfs-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-23T07:38:00.548 INFO:teuthology.orchestra.run.trial129.stdout: python3-rados-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: python3-rbd-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: python3-rgw-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:00.549 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:00.589 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-test 2026-02-23T07:38:00.881 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:13 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:00.916 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repository Size 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: ceph-test x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 81 M 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:Installing dependencies: 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: libcephsqlite x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 168 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:00.917 INFO:teuthology.orchestra.run.trial129.stdout:Install 9 Packages 2026-02-23T07:38:00.918 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:00.918 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 84 M 2026-02-23T07:38:00.918 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 339 M 2026-02-23T07:38:00.918 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:01.114 INFO:teuthology.orchestra.run.trial129.stdout:(1/9): libxslt-1.1.39-8.el10_0.x86_64.rpm 3.0 MB/s | 189 kB 00:00 2026-02-23T07:38:01.141 INFO:teuthology.orchestra.run.trial129.stdout:(2/9): socat-1.7.4.4-8.el10.x86_64.rpm 11 MB/s | 303 kB 00:00 2026-02-23T07:38:01.146 INFO:teuthology.orchestra.run.trial129.stdout:(3/9): libcephsqlite-20.3.0-5433.g5adce3ff.el10 1.8 MB/s | 168 kB 00:00 2026-02-23T07:38:01.157 INFO:teuthology.orchestra.run.trial129.stdout:(4/9): xmlstarlet-1.6.1-27.el10.x86_64.rpm 3.9 MB/s | 63 kB 00:00 2026-02-23T07:38:01.179 INFO:teuthology.orchestra.run.trial129.stdout:(5/9): libpciaccess-0.16-16.el10.x86_64.rpm 1.2 MB/s | 27 kB 00:00 2026-02-23T07:38:01.186 INFO:teuthology.orchestra.run.trial129.stdout:(6/9): hwloc-libs-2.11.1-3.el10.x86_64.rpm 52 MB/s | 2.1 MB 00:00 2026-02-23T07:38:01.204 INFO:teuthology.orchestra.run.trial129.stdout:(7/9): ocl-icd-2.3.2-8.el10.x86_64.rpm 2.6 MB/s | 66 kB 00:00 2026-02-23T07:38:01.734 INFO:teuthology.orchestra.run.trial129.stdout:(8/9): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rpm 233 kB/s | 127 kB 00:00 2026-02-23T07:38:02.658 INFO:teuthology.orchestra.run.trial129.stdout:(9/9): ceph-test-20.3.0-5433.g5adce3ff.el10.x86 51 MB/s | 81 MB 00:01 2026-02-23T07:38:02.659 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:02.659 INFO:teuthology.orchestra.run.trial129.stdout:Total 48 MB/s | 84 MB 00:01 2026-02-23T07:38:02.659 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:02.670 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:02.671 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:02.959 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:02.959 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:03.271 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:03.273 INFO:teuthology.orchestra.run.trial129.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 1/9 2026-02-23T07:38:03.275 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 2/9 2026-02-23T07:38:03.281 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 3/9 2026-02-23T07:38:03.286 INFO:teuthology.orchestra.run.trial129.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 4/9 2026-02-23T07:38:03.289 INFO:teuthology.orchestra.run.trial129.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 5/9 2026-02-23T07:38:03.292 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 6/9 2026-02-23T07:38:03.298 INFO:teuthology.orchestra.run.trial129.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 7/9 2026-02-23T07:38:03.298 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libcephsqlite-2:20.3.0-5433.g5adce3ff.el10.x86_64 8/9 2026-02-23T07:38:05.912 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5433.g5adce3ff.el10.x86_64 8/9 2026-02-23T07:38:05.933 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-test-2:20.3.0-5433.g5adce3ff.el10.x86_64 9/9 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-test-2:20.3.0-5433.g5adce3ff.el10.x86_64 9/9 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: ceph-test-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: libcephsqlite-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-23T07:38:06.300 INFO:teuthology.orchestra.run.trial129.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-23T07:38:06.301 INFO:teuthology.orchestra.run.trial129.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-23T07:38:06.301 INFO:teuthology.orchestra.run.trial129.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-23T07:38:06.301 INFO:teuthology.orchestra.run.trial129.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-23T07:38:06.301 INFO:teuthology.orchestra.run.trial129.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-23T07:38:06.301 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:06.301 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:06.336 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph 2026-02-23T07:38:06.630 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:19 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:06.669 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:06.670 INFO:teuthology.orchestra.run.trial129.stdout:======================================================================================== 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repository Size 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout:======================================================================================== 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: ceph x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 6.6 k 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout:Installing dependencies: 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 57 k 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mds x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 2.4 M 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 980 k 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 298 k 2026-02-23T07:38:06.671 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mon x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 6.0 M 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: ceph-osd x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 175 k 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: ceph-osd-classic x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 17 M 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: ceph-osd-crimson x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 20 M 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 17 k 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: cephadm noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 1.3 M 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-23T07:38:06.672 INFO:teuthology.orchestra.run.trial129.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-23T07:38:06.673 INFO:teuthology.orchestra.run.trial129.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-devel x86_64 3.12.12-3.el10_1 appstream 329 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-23T07:38:06.674 INFO:teuthology.orchestra.run.trial129.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-23T07:38:06.675 INFO:teuthology.orchestra.run.trial129.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-23T07:38:06.676 INFO:teuthology.orchestra.run.trial129.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-23T07:38:06.677 INFO:teuthology.orchestra.run.trial129.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout:Installing weak dependencies: 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 184 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 51 M 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 7.4 M 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 22 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-rook noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 50 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: ceph-volume noarch 2:20.3.0-5433.g5adce3ff.el10 ceph-noarch 376 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:06.678 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:06.679 INFO:teuthology.orchestra.run.trial129.stdout:======================================================================================== 2026-02-23T07:38:06.679 INFO:teuthology.orchestra.run.trial129.stdout:Install 88 Packages 2026-02-23T07:38:06.679 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:06.680 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 155 M 2026-02-23T07:38:06.680 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 718 M 2026-02-23T07:38:06.680 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:07.127 INFO:teuthology.orchestra.run.trial129.stdout:(1/88): ceph-20.3.0-5433.g5adce3ff.el10.x86_64. 138 kB/s | 6.6 kB 00:00 2026-02-23T07:38:07.216 INFO:teuthology.orchestra.run.trial129.stdout:(2/88): ceph-mgr-20.3.0-5433.g5adce3ff.el10.x86 7.0 MB/s | 980 kB 00:00 2026-02-23T07:38:07.243 INFO:teuthology.orchestra.run.trial129.stdout:(3/88): ceph-mds-20.3.0-5433.g5adce3ff.el10.x86 15 MB/s | 2.4 MB 00:00 2026-02-23T07:38:07.244 INFO:teuthology.orchestra.run.trial129.stdout:(4/88): ceph-osd-20.3.0-5433.g5adce3ff.el10.x86 6.0 MB/s | 175 kB 00:00 2026-02-23T07:38:07.481 INFO:teuthology.orchestra.run.trial129.stdout:(5/88): ceph-mon-20.3.0-5433.g5adce3ff.el10.x86 17 MB/s | 6.0 MB 00:00 2026-02-23T07:38:07.526 INFO:teuthology.orchestra.run.trial129.stdout:(6/88): ceph-grafana-dashboards-20.3.0-5433.g5a 1.3 MB/s | 57 kB 00:00 2026-02-23T07:38:07.577 INFO:teuthology.orchestra.run.trial129.stdout:(7/88): ceph-mgr-cephadm-20.3.0-5433.g5adce3ff. 3.5 MB/s | 184 kB 00:00 2026-02-23T07:38:07.921 INFO:teuthology.orchestra.run.trial129.stdout:(8/88): ceph-osd-classic-20.3.0-5433.g5adce3ff. 25 MB/s | 17 MB 00:00 2026-02-23T07:38:08.250 INFO:teuthology.orchestra.run.trial129.stdout:(9/88): ceph-mgr-diskprediction-local-20.3.0-54 23 MB/s | 7.4 MB 00:00 2026-02-23T07:38:08.292 INFO:teuthology.orchestra.run.trial129.stdout:(10/88): ceph-osd-crimson-20.3.0-5433.g5adce3ff 19 MB/s | 20 MB 00:01 2026-02-23T07:38:08.293 INFO:teuthology.orchestra.run.trial129.stdout:(11/88): ceph-mgr-k8sevents-20.3.0-5433.g5adce3 524 kB/s | 22 kB 00:00 2026-02-23T07:38:08.306 INFO:teuthology.orchestra.run.trial129.stdout:(12/88): ceph-mgr-modules-core-20.3.0-5433.g5ad 20 MB/s | 298 kB 00:00 2026-02-23T07:38:08.310 INFO:teuthology.orchestra.run.trial129.stdout:(13/88): ceph-mgr-rook-20.3.0-5433.g5adce3ff.el 2.8 MB/s | 50 kB 00:00 2026-02-23T07:38:08.322 INFO:teuthology.orchestra.run.trial129.stdout:(14/88): ceph-prometheus-alerts-20.3.0-5433.g5a 1.1 MB/s | 17 kB 00:00 2026-02-23T07:38:08.333 INFO:teuthology.orchestra.run.trial129.stdout:(15/88): ceph-volume-20.3.0-5433.g5adce3ff.el10 16 MB/s | 376 kB 00:00 2026-02-23T07:38:08.379 INFO:teuthology.orchestra.run.trial129.stdout:(16/88): flexiblas-3.4.2-3.el10.x86_64.rpm 540 kB/s | 25 kB 00:00 2026-02-23T07:38:08.383 INFO:teuthology.orchestra.run.trial129.stdout:(17/88): cephadm-20.3.0-5433.g5adce3ff.el10.noa 22 MB/s | 1.3 MB 00:00 2026-02-23T07:38:08.400 INFO:teuthology.orchestra.run.trial129.stdout:(18/88): flexiblas-openblas-openmp-3.4.2-3.el10 997 kB/s | 17 kB 00:00 2026-02-23T07:38:08.415 INFO:teuthology.orchestra.run.trial129.stdout:(19/88): ledmon-libs-1.1.0-2.el10.x86_64.rpm 2.7 MB/s | 42 kB 00:00 2026-02-23T07:38:08.431 INFO:teuthology.orchestra.run.trial129.stdout:(20/88): flexiblas-netlib-3.4.2-3.el10.x86_64.r 61 MB/s | 3.2 MB 00:00 2026-02-23T07:38:08.436 INFO:teuthology.orchestra.run.trial129.stdout:(21/88): libstoragemgmt-1.10.1-4.el10.x86_64.rp 12 MB/s | 251 kB 00:00 2026-02-23T07:38:08.445 INFO:teuthology.orchestra.run.trial129.stdout:(22/88): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 2.5 MB/s | 36 kB 00:00 2026-02-23T07:38:08.451 INFO:teuthology.orchestra.run.trial129.stdout:(23/88): lua-5.4.6-7.el10.x86_64.rpm 12 MB/s | 190 kB 00:00 2026-02-23T07:38:08.459 INFO:teuthology.orchestra.run.trial129.stdout:(24/88): openblas-0.3.29-2.el10.x86_64.rpm 3.1 MB/s | 43 kB 00:00 2026-02-23T07:38:08.476 INFO:teuthology.orchestra.run.trial129.stdout:(25/88): python3-devel-3.12.12-3.el10_1.x86_64. 19 MB/s | 329 kB 00:00 2026-02-23T07:38:08.507 INFO:teuthology.orchestra.run.trial129.stdout:(26/88): python3-jinja2-3.1.6-1.el10_0.noarch.r 10 MB/s | 330 kB 00:00 2026-02-23T07:38:08.524 INFO:teuthology.orchestra.run.trial129.stdout:(27/88): python3-jmespath-1.0.1-8.el10.noarch.r 3.4 MB/s | 60 kB 00:00 2026-02-23T07:38:08.545 INFO:teuthology.orchestra.run.trial129.stdout:(28/88): openblas-openmp-0.3.29-2.el10.x86_64.r 57 MB/s | 5.3 MB 00:00 2026-02-23T07:38:08.546 INFO:teuthology.orchestra.run.trial129.stdout:(29/88): python3-libstoragemgmt-1.10.1-4.el10.x 9.9 MB/s | 219 kB 00:00 2026-02-23T07:38:08.570 INFO:teuthology.orchestra.run.trial129.stdout:(30/88): python3-markupsafe-2.1.3-6.el10.x86_64 1.4 MB/s | 34 kB 00:00 2026-02-23T07:38:08.592 INFO:teuthology.orchestra.run.trial129.stdout:(31/88): python3-lxml-5.2.1-4.el10.x86_64.rpm 29 MB/s | 1.4 MB 00:00 2026-02-23T07:38:08.614 INFO:teuthology.orchestra.run.trial129.stdout:(32/88): python3-numpy-f2py-1.26.4-5.el10.x86_6 23 MB/s | 490 kB 00:00 2026-02-23T07:38:08.632 INFO:teuthology.orchestra.run.trial129.stdout:(33/88): python3-protobuf-3.19.6-11.el10.x86_64 22 MB/s | 419 kB 00:00 2026-02-23T07:38:08.653 INFO:teuthology.orchestra.run.trial129.stdout:(34/88): python3-pyasn1-0.6.1-1.el10.noarch.rpm 9.4 MB/s | 198 kB 00:00 2026-02-23T07:38:08.667 INFO:teuthology.orchestra.run.trial129.stdout:(35/88): python3-numpy-1.26.4-5.el10.x86_64.rpm 69 MB/s | 6.7 MB 00:00 2026-02-23T07:38:08.672 INFO:teuthology.orchestra.run.trial129.stdout:(36/88): python3-pyasn1-modules-0.6.1-1.el10.no 20 MB/s | 402 kB 00:00 2026-02-23T07:38:08.681 INFO:teuthology.orchestra.run.trial129.stdout:(37/88): python3-requests-oauthlib-1.3.1-11.el1 4.4 MB/s | 60 kB 00:00 2026-02-23T07:38:08.700 INFO:teuthology.orchestra.run.trial129.stdout:(38/88): xmlsec1-1.2.39-3.el10.x86_64.rpm 10 MB/s | 193 kB 00:00 2026-02-23T07:38:08.716 INFO:teuthology.orchestra.run.trial129.stdout:(39/88): xmlsec1-openssl-1.2.39-3.el10.x86_64.r 5.7 MB/s | 96 kB 00:00 2026-02-23T07:38:08.735 INFO:teuthology.orchestra.run.trial129.stdout:(40/88): cryptsetup-2.7.5-2.el10.x86_64.rpm 18 MB/s | 335 kB 00:00 2026-02-23T07:38:08.752 INFO:teuthology.orchestra.run.trial129.stdout:(41/88): libconfig-1.7.3-10.el10.x86_64.rpm 4.1 MB/s | 72 kB 00:00 2026-02-23T07:38:08.782 INFO:teuthology.orchestra.run.trial129.stdout:(42/88): libgfortran-14.3.1-2.1.el10.x86_64.rpm 27 MB/s | 827 kB 00:00 2026-02-23T07:38:08.808 INFO:teuthology.orchestra.run.trial129.stdout:(43/88): libquadmath-14.3.1-2.1.el10.x86_64.rpm 8.0 MB/s | 215 kB 00:00 2026-02-23T07:38:08.827 INFO:teuthology.orchestra.run.trial129.stdout:(44/88): python3-cffi-1.16.0-7.el10.x86_64.rpm 17 MB/s | 310 kB 00:00 2026-02-23T07:38:08.858 INFO:teuthology.orchestra.run.trial129.stdout:(45/88): python3-scipy-1.11.3-17.el10.x86_64.rp 87 MB/s | 16 MB 00:00 2026-02-23T07:38:08.870 INFO:teuthology.orchestra.run.trial129.stdout:(46/88): python3-cryptography-43.0.0-4.el10.x86 31 MB/s | 1.3 MB 00:00 2026-02-23T07:38:08.874 INFO:teuthology.orchestra.run.trial129.stdout:(47/88): python3-packaging-24.2-2.el10.noarch.r 9.4 MB/s | 155 kB 00:00 2026-02-23T07:38:08.885 INFO:teuthology.orchestra.run.trial129.stdout:(48/88): python3-ply-3.11-25.el10.noarch.rpm 8.6 MB/s | 137 kB 00:00 2026-02-23T07:38:08.891 INFO:teuthology.orchestra.run.trial129.stdout:(49/88): python3-pycparser-2.20-16.el10.noarch. 9.5 MB/s | 160 kB 00:00 2026-02-23T07:38:08.902 INFO:teuthology.orchestra.run.trial129.stdout:(50/88): python3-requests-2.32.4-1.el10_0.noarc 9.7 MB/s | 160 kB 00:00 2026-02-23T07:38:08.909 INFO:teuthology.orchestra.run.trial129.stdout:(51/88): python3-urllib3-1.26.19-2.el10_1.1.noa 16 MB/s | 285 kB 00:00 2026-02-23T07:38:08.918 INFO:teuthology.orchestra.run.trial129.stdout:(52/88): unzip-6.0-69.el10.x86_64.rpm 12 MB/s | 188 kB 00:00 2026-02-23T07:38:08.925 INFO:teuthology.orchestra.run.trial129.stdout:(53/88): zip-3.0-45.el10.x86_64.rpm 16 MB/s | 271 kB 00:00 2026-02-23T07:38:08.930 INFO:teuthology.orchestra.run.trial129.stdout:(54/88): lua-devel-5.4.6-7.el10.x86_64.rpm 1.8 MB/s | 22 kB 00:00 2026-02-23T07:38:08.944 INFO:teuthology.orchestra.run.trial129.stdout:(55/88): protobuf-compiler-3.19.6-11.el10.x86_6 40 MB/s | 787 kB 00:00 2026-02-23T07:38:09.080 INFO:teuthology.orchestra.run.trial129.stdout:(56/88): ceph-mgr-dashboard-20.3.0-5433.g5adce3 34 MB/s | 51 MB 00:01 2026-02-23T07:38:09.080 INFO:teuthology.orchestra.run.trial129.stdout:(57/88): grpc-data-1.48.4-44.el10_0.noarch.rpm 139 kB/s | 21 kB 00:00 2026-02-23T07:38:09.120 INFO:teuthology.orchestra.run.trial129.stdout:(58/88): python3-autocommand-2.2.2-9.el10_0.noa 803 kB/s | 32 kB 00:00 2026-02-23T07:38:09.124 INFO:teuthology.orchestra.run.trial129.stdout:(59/88): luarocks-3.9.2-6.el10_0.noarch.rpm 842 kB/s | 152 kB 00:00 2026-02-23T07:38:09.175 INFO:teuthology.orchestra.run.trial129.stdout:(60/88): python3-cachetools-5.4.0-6.el10_0.noar 739 kB/s | 37 kB 00:00 2026-02-23T07:38:09.176 INFO:teuthology.orchestra.run.trial129.stdout:(61/88): python3-asyncssh-2.17.0-1.el10_0.noarc 7.7 MB/s | 756 kB 00:00 2026-02-23T07:38:09.194 INFO:teuthology.orchestra.run.trial129.stdout:(62/88): python3-bcrypt-4.3.0-3.el10_1.x86_64.r 3.2 MB/s | 238 kB 00:00 2026-02-23T07:38:09.198 INFO:teuthology.orchestra.run.trial129.stdout:(63/88): python3-certifi-2023.05.07-6.el10_0.no 631 kB/s | 14 kB 00:00 2026-02-23T07:38:09.253 INFO:teuthology.orchestra.run.trial129.stdout:(64/88): python3-durationpy-0.9-2.el10_0.noarch 267 kB/s | 15 kB 00:00 2026-02-23T07:38:09.253 INFO:teuthology.orchestra.run.trial129.stdout:(65/88): python3-cheroot-10.0.1-4.el10_0.noarch 2.7 MB/s | 215 kB 00:00 2026-02-23T07:38:09.279 INFO:teuthology.orchestra.run.trial129.stdout:(66/88): python3-cherrypy-18.10.0-4.el10_0.noar 4.1 MB/s | 359 kB 00:00 2026-02-23T07:38:09.376 INFO:teuthology.orchestra.run.trial129.stdout:(67/88): python3-google-auth-2.40.3-1.el10_1.no 2.3 MB/s | 286 kB 00:00 2026-02-23T07:38:09.412 INFO:teuthology.orchestra.run.trial129.stdout:(68/88): python3-grpcio-1.48.4-44.el10_0.x86_64 15 MB/s | 2.3 MB 00:00 2026-02-23T07:38:09.445 INFO:teuthology.orchestra.run.trial129.stdout:(69/88): python3-grpcio-tools-1.48.4-44.el10_0. 947 kB/s | 157 kB 00:00 2026-02-23T07:38:09.468 INFO:teuthology.orchestra.run.trial129.stdout:(70/88): python3-jaraco-collections-5.1.0-1.el1 513 kB/s | 29 kB 00:00 2026-02-23T07:38:09.469 INFO:teuthology.orchestra.run.trial129.stdout:(71/88): python3-isodate-0.6.1-14.el10_0.noarch 714 kB/s | 66 kB 00:00 2026-02-23T07:38:09.472 INFO:teuthology.orchestra.run.trial129.stdout:(72/88): python3-jaraco-context-6.0.1-4.el10_0. 802 kB/s | 21 kB 00:00 2026-02-23T07:38:09.490 INFO:teuthology.orchestra.run.trial129.stdout:(73/88): python3-jaraco-functools-4.0.2-4.el10_ 1.0 MB/s | 23 kB 00:00 2026-02-23T07:38:09.544 INFO:teuthology.orchestra.run.trial129.stdout:(74/88): python3-jaraco-text-4.0.0-3.el10_0.noa 384 kB/s | 29 kB 00:00 2026-02-23T07:38:09.649 INFO:teuthology.orchestra.run.trial129.stdout:(75/88): python3-kubernetes-32.0.1-1.el10_1.noa 7.5 MB/s | 1.3 MB 00:00 2026-02-23T07:38:09.655 INFO:teuthology.orchestra.run.trial129.stdout:(76/88): python3-more-itertools-10.1.0-8.el10_0 613 kB/s | 100 kB 00:00 2026-02-23T07:38:09.655 INFO:teuthology.orchestra.run.trial129.stdout:(77/88): python3-natsort-8.4.0-2.el10_0.noarch. 649 kB/s | 72 kB 00:00 2026-02-23T07:38:09.800 INFO:teuthology.orchestra.run.trial129.stdout:(78/88): python3-portend-3.2.0-6.el10_0.noarch. 118 kB/s | 18 kB 00:00 2026-02-23T07:38:09.807 INFO:teuthology.orchestra.run.trial129.stdout:(79/88): python3-repoze-lru-0.7-23.el10_0.noarc 237 kB/s | 36 kB 00:00 2026-02-23T07:38:09.823 INFO:teuthology.orchestra.run.trial129.stdout:(80/88): python3-pyOpenSSL-25.0.0-1.el10_1.noar 674 kB/s | 113 kB 00:00 2026-02-23T07:38:09.840 INFO:teuthology.orchestra.run.trial129.stdout:(81/88): python3-routes-2.5.1-11.el10_0.noarch. 4.8 MB/s | 201 kB 00:00 2026-02-23T07:38:09.908 INFO:teuthology.orchestra.run.trial129.stdout:(82/88): python3-tempora-5.7.0-1.el10_0.noarch. 433 kB/s | 37 kB 00:00 2026-02-23T07:38:09.908 INFO:teuthology.orchestra.run.trial129.stdout:(83/88): python3-rsa-4.9-7.el10_0.noarch.rpm 684 kB/s | 70 kB 00:00 2026-02-23T07:38:09.939 INFO:teuthology.orchestra.run.trial129.stdout:(84/88): python3-xmltodict-0.13.0-5.el10_0.noar 840 kB/s | 26 kB 00:00 2026-02-23T07:38:09.942 INFO:teuthology.orchestra.run.trial129.stdout:(85/88): python3-zc-lockfile-3.0.post1-11.el10_ 685 kB/s | 23 kB 00:00 2026-02-23T07:38:09.942 INFO:teuthology.orchestra.run.trial129.stdout:(86/88): python3-websocket-client-1.8.0-2.el10_ 1.2 MB/s | 124 kB 00:00 2026-02-23T07:38:09.954 INFO:teuthology.orchestra.run.trial129.stdout:(87/88): python3-xmlsec-1.3.16-1.el10.x86_64.rp 4.0 MB/s | 49 kB 00:00 2026-02-23T07:38:09.955 INFO:teuthology.orchestra.run.trial129.stdout:(88/88): python3-saml-1.16.0-11.el10.noarch.rpm 9.7 MB/s | 150 kB 00:00 2026-02-23T07:38:09.956 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:09.956 INFO:teuthology.orchestra.run.trial129.stdout:Total 47 MB/s | 155 MB 00:03 2026-02-23T07:38:09.956 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:09.997 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:09.997 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:10.563 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:10.563 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:11.145 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:11.147 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 1/88 2026-02-23T07:38:11.153 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 2/88 2026-02-23T07:38:11.156 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 3/88 2026-02-23T07:38:11.166 INFO:teuthology.orchestra.run.trial129.stdout: Installing : unzip-6.0-69.el10.x86_64 4/88 2026-02-23T07:38:11.172 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 5/88 2026-02-23T07:38:11.178 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 6/88 2026-02-23T07:38:11.186 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-packaging-24.2-2.el10.noarch 7/88 2026-02-23T07:38:11.205 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 8/88 2026-02-23T07:38:11.209 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 9/88 2026-02-23T07:38:11.211 INFO:teuthology.orchestra.run.trial129.stdout: Installing : lua-5.4.6-7.el10.x86_64 10/88 2026-02-23T07:38:11.214 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 11/88 2026-02-23T07:38:11.215 INFO:teuthology.orchestra.run.trial129.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 12/88 2026-02-23T07:38:11.217 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 13/88 2026-02-23T07:38:11.219 INFO:teuthology.orchestra.run.trial129.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 14/88 2026-02-23T07:38:11.221 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 15/88 2026-02-23T07:38:11.243 INFO:teuthology.orchestra.run.trial129.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 16/88 2026-02-23T07:38:11.249 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 17/88 2026-02-23T07:38:11.253 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 18/88 2026-02-23T07:38:11.257 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 19/88 2026-02-23T07:38:11.266 INFO:teuthology.orchestra.run.trial129.stdout: Installing : zip-3.0-45.el10.x86_64 20/88 2026-02-23T07:38:11.270 INFO:teuthology.orchestra.run.trial129.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 21/88 2026-02-23T07:38:11.272 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 22/88 2026-02-23T07:38:11.274 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 23/88 2026-02-23T07:38:11.276 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 24/88 2026-02-23T07:38:11.281 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 25/88 2026-02-23T07:38:11.284 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 26/88 2026-02-23T07:38:11.289 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 27/88 2026-02-23T07:38:11.293 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 28/88 2026-02-23T07:38:11.295 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 29/88 2026-02-23T07:38:11.300 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 30/88 2026-02-23T07:38:11.306 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 31/88 2026-02-23T07:38:11.308 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 32/88 2026-02-23T07:38:11.310 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 33/88 2026-02-23T07:38:11.313 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 34/88 2026-02-23T07:38:11.327 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 35/88 2026-02-23T07:38:11.465 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 36/88 2026-02-23T07:38:11.472 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 37/88 2026-02-23T07:38:11.475 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 38/88 2026-02-23T07:38:11.478 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 39/88 2026-02-23T07:38:11.480 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 40/88 2026-02-23T07:38:11.482 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 41/88 2026-02-23T07:38:11.505 INFO:teuthology.orchestra.run.trial129.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 42/88 2026-02-23T07:38:11.512 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 43/88 2026-02-23T07:38:11.515 INFO:teuthology.orchestra.run.trial129.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 44/88 2026-02-23T07:38:11.521 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-ply-3.11-25.el10.noarch 45/88 2026-02-23T07:38:11.528 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 46/88 2026-02-23T07:38:11.559 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 47/88 2026-02-23T07:38:11.565 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 48/88 2026-02-23T07:38:11.574 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 49/88 2026-02-23T07:38:11.585 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 50/88 2026-02-23T07:38:11.606 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 51/88 2026-02-23T07:38:11.609 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 52/88 2026-02-23T07:38:11.611 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 53/88 2026-02-23T07:38:11.612 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 54/88 2026-02-23T07:38:11.633 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 55/88 2026-02-23T07:38:11.633 INFO:teuthology.orchestra.run.trial129.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-23T07:38:11.633 INFO:teuthology.orchestra.run.trial129.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-23T07:38:11.633 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:11.640 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 55/88 2026-02-23T07:38:11.663 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 55/88 2026-02-23T07:38:11.664 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-23T07:38:11.664 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:11.678 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 56/88 2026-02-23T07:38:12.172 INFO:teuthology.orchestra.run.trial129.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 57/88 2026-02-23T07:38:12.766 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-osd-classic-2:20.3.0-5433.g5adce3ff.el10.x86_ 58/88 2026-02-23T07:38:12.796 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-osd-crimson-2:20.3.0-5433.g5adce3ff.el10.x86_ 59/88 2026-02-23T07:38:12.798 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-volume-2:20.3.0-5433.g5adce3ff.el10.noarch 60/88 2026-02-23T07:38:12.812 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-volume-2:20.3.0-5433.g5adce3ff.el10.noarch 60/88 2026-02-23T07:38:12.812 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:12.812 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-23T07:38:12.812 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:12.819 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-osd-2:20.3.0-5433.g5adce3ff.el10.x86_64 61/88 2026-02-23T07:38:12.843 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-osd-2:20.3.0-5433.g5adce3ff.el10.x86_64 61/88 2026-02-23T07:38:12.843 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:12.843 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-23T07:38:12.843 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-23T07:38:12.843 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-23T07:38:12.844 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:12.861 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 62/88 2026-02-23T07:38:12.864 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 63/88 2026-02-23T07:38:12.872 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 64/88 2026-02-23T07:38:12.876 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 65/88 2026-02-23T07:38:12.889 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 66/88 2026-02-23T07:38:12.892 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-devel-3.12.12-3.el10_1.x86_64 67/88 2026-02-23T07:38:12.947 INFO:teuthology.orchestra.run.trial129.stdout: Installing : openblas-0.3.29-2.el10.x86_64 68/88 2026-02-23T07:38:12.967 INFO:teuthology.orchestra.run.trial129.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 69/88 2026-02-23T07:38:12.969 INFO:teuthology.orchestra.run.trial129.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 70/88 2026-02-23T07:38:12.970 INFO:teuthology.orchestra.run.trial129.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 71/88 2026-02-23T07:38:13.094 INFO:teuthology.orchestra.run.trial129.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 72/88 2026-02-23T07:38:13.120 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 73/88 2026-02-23T07:38:13.306 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 74/88 2026-02-23T07:38:13.315 INFO:teuthology.orchestra.run.trial129.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 75/88 2026-02-23T07:38:13.349 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: cephadm-2:20.3.0-5433.g5adce3ff.el10.noarch 76/88 2026-02-23T07:38:13.351 INFO:teuthology.orchestra.run.trial129.stdout: Installing : cephadm-2:20.3.0-5433.g5adce3ff.el10.noarch 76/88 2026-02-23T07:38:13.358 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5433.g5adce3ff.el1 77/88 2026-02-23T07:38:13.369 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5433.g5adce3ff.el 78/88 2026-02-23T07:38:13.371 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5433.g5adce3ff.el10.noar 79/88 2026-02-23T07:38:15.124 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5433.g5adce3ff.el10.noar 79/88 2026-02-23T07:38:15.131 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5433.g5adce3ff.el10.no 80/88 2026-02-23T07:38:15.493 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5433.g5adce3ff.el10.no 80/88 2026-02-23T07:38:15.494 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5433.g5adce 81/88 2026-02-23T07:38:15.506 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5433.g5adce 81/88 2026-02-23T07:38:15.506 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5433.g5adce3ff.el10.no 82/88 2026-02-23T07:38:15.539 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5433.g5adce3ff.el10.no 82/88 2026-02-23T07:38:15.572 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5433.g5adce3ff.el10 83/88 2026-02-23T07:38:15.573 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-2:20.3.0-5433.g5adce3ff.el10.x86_64 84/88 2026-02-23T07:38:15.595 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5433.g5adce3ff.el10.x86_64 84/88 2026-02-23T07:38:15.595 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:15.595 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-23T07:38:15.595 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-23T07:38:15.595 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-23T07:38:15.595 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:15.601 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mgr-rook-2:20.3.0-5433.g5adce3ff.el10.noarch 85/88 2026-02-23T07:38:15.802 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5433.g5adce3ff.el10.noarch 85/88 2026-02-23T07:38:15.804 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mon-2:20.3.0-5433.g5adce3ff.el10.x86_64 86/88 2026-02-23T07:38:15.826 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mon-2:20.3.0-5433.g5adce3ff.el10.x86_64 86/88 2026-02-23T07:38:15.826 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:15.826 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-23T07:38:15.826 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-23T07:38:15.826 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-23T07:38:15.826 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:15.900 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-mds-2:20.3.0-5433.g5adce3ff.el10.x86_64 87/88 2026-02-23T07:38:15.922 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-mds-2:20.3.0-5433.g5adce3ff.el10.x86_64 87/88 2026-02-23T07:38:15.922 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:15.922 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-23T07:38:15.922 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-23T07:38:15.922 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-23T07:38:15.922 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:15.923 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-2:20.3.0-5433.g5adce3ff.el10.x86_64 88/88 2026-02-23T07:38:15.930 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5433.g5adce3ff.el10.x86_ 88/88 2026-02-23T07:38:15.955 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5433.g5adce3ff.el10.x86_ 88/88 2026-02-23T07:38:16.868 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-2:20.3.0-5433.g5adce3ff.el10.x86_64 88/88 2026-02-23T07:38:16.868 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:16.868 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:16.868 INFO:teuthology.orchestra.run.trial129.stdout: ceph-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.868 INFO:teuthology.orchestra.run.trial129.stdout: ceph-grafana-dashboards-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mds-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-cephadm-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-dashboard-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-k8sevents-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-modules-core-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mgr-rook-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-mon-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-osd-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-osd-classic-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.869 INFO:teuthology.orchestra.run.trial129.stdout: ceph-osd-crimson-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: ceph-prometheus-alerts-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: ceph-volume-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: cephadm-2:20.3.0-5433.g5adce3ff.el10.noarch 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-23T07:38:16.870 INFO:teuthology.orchestra.run.trial129.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: lua-5.4.6-7.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-23T07:38:16.871 INFO:teuthology.orchestra.run.trial129.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-devel-3.12.12-3.el10_1.x86_64 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-23T07:38:16.872 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-23T07:38:16.873 INFO:teuthology.orchestra.run.trial129.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-ply-3.11-25.el10.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-23T07:38:16.874 INFO:teuthology.orchestra.run.trial129.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: unzip-6.0-69.el10.x86_64 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-23T07:38:16.875 INFO:teuthology.orchestra.run.trial129.stdout: zip-3.0-45.el10.x86_64 2026-02-23T07:38:16.876 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:16.876 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:16.927 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-base 2026-02-23T07:38:17.221 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:30 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:17.246 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-base-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:17.258 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:17.259 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:17.259 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:17.278 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install cephadm 2026-02-23T07:38:17.560 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:30 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:17.586 INFO:teuthology.orchestra.run.trial129.stdout:Package cephadm-2:20.3.0-5433.g5adce3ff.el10.noarch is already installed. 2026-02-23T07:38:17.595 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:17.596 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:17.596 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:17.615 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-immutable-object-cache 2026-02-23T07:38:17.904 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:30 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:17.941 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:17.941 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:17.941 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repo Size 2026-02-23T07:38:17.941 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:17.941 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 151 k 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout:Install 1 Package 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 151 k 2026-02-23T07:38:17.942 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 425 k 2026-02-23T07:38:17.943 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:18.027 INFO:teuthology.orchestra.run.trial129.stdout:ceph-immutable-object-cache-20.3.0-5433.g5adce3 1.7 MB/s | 151 kB 00:00 2026-02-23T07:38:18.027 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:18.027 INFO:teuthology.orchestra.run.trial129.stdout:Total 1.7 MB/s | 151 kB 00:00 2026-02-23T07:38:18.027 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:18.032 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:18.032 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:18.061 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:18.062 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:18.114 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:18.115 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5433.g5adce3ff. 1/1 2026-02-23T07:38:18.139 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5433.g5adce3ff. 1/1 2026-02-23T07:38:18.139 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:18.139 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-23T07:38:18.139 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:18.400 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:18.400 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:18.401 INFO:teuthology.orchestra.run.trial129.stdout: ceph-immutable-object-cache-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:18.401 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:18.401 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:18.425 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-mgr 2026-02-23T07:38:18.714 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:31 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:18.741 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-mgr-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:18.751 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:18.752 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:18.752 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:18.771 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-mgr-dashboard 2026-02-23T07:38:19.060 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:32 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:19.088 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-mgr-dashboard-2:20.3.0-5433.g5adce3ff.el10.noarch is already installed. 2026-02-23T07:38:19.098 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:19.098 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:19.098 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:19.118 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-23T07:38:19.406 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:32 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:19.432 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5433.g5adce3ff.el10.noarch is already installed. 2026-02-23T07:38:19.442 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:19.442 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:19.443 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:19.462 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-mgr-rook 2026-02-23T07:38:19.755 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:32 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:19.782 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-mgr-rook-2:20.3.0-5433.g5adce3ff.el10.noarch is already installed. 2026-02-23T07:38:19.792 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:19.793 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:19.793 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:19.814 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-mgr-cephadm 2026-02-23T07:38:20.106 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:33 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:20.134 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-mgr-cephadm-2:20.3.0-5433.g5adce3ff.el10.noarch is already installed. 2026-02-23T07:38:20.144 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:20.145 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:20.145 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:20.166 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-osd 2026-02-23T07:38:20.449 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:33 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:20.475 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-osd-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:20.485 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:20.486 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:20.486 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:20.507 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-osd-classic 2026-02-23T07:38:20.799 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:33 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:20.826 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-osd-classic-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:20.836 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:20.836 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:20.836 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:20.858 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-fuse 2026-02-23T07:38:21.148 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:34 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:21.184 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:21.185 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:21.185 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repository Size 2026-02-23T07:38:21.185 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:21.185 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout: ceph-fuse x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 1.1 M 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout:Installing dependencies: 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout:Install 2 Packages 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 1.1 M 2026-02-23T07:38:21.186 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 3.2 M 2026-02-23T07:38:21.187 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:21.220 INFO:teuthology.orchestra.run.trial129.stdout:(1/2): fuse3-3.16.2-5.el10.x86_64.rpm 1.7 MB/s | 58 kB 00:00 2026-02-23T07:38:21.303 INFO:teuthology.orchestra.run.trial129.stdout:(2/2): ceph-fuse-20.3.0-5433.g5adce3ff.el10.x86 9.0 MB/s | 1.1 MB 00:00 2026-02-23T07:38:21.303 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:21.303 INFO:teuthology.orchestra.run.trial129.stdout:Total 9.4 MB/s | 1.1 MB 00:00 2026-02-23T07:38:21.303 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:21.312 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:21.312 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:21.347 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:21.347 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:21.401 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:21.436 INFO:teuthology.orchestra.run.trial129.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 1/2 2026-02-23T07:38:21.455 INFO:teuthology.orchestra.run.trial129.stdout: Installing : ceph-fuse-2:20.3.0-5433.g5adce3ff.el10.x86_64 2/2 2026-02-23T07:38:21.739 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5433.g5adce3ff.el10.x86_64 2/2 2026-02-23T07:38:21.740 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:21.740 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:21.740 INFO:teuthology.orchestra.run.trial129.stdout: ceph-fuse-2:20.3.0-5433.g5adce3ff.el10.x86_64 fuse3-3.16.2-5.el10.x86_64 2026-02-23T07:38:21.740 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:21.740 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:21.764 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install ceph-volume 2026-02-23T07:38:22.055 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:35 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:22.081 INFO:teuthology.orchestra.run.trial129.stdout:Package ceph-volume-2:20.3.0-5433.g5adce3ff.el10.noarch is already installed. 2026-02-23T07:38:22.090 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:22.091 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:22.091 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:22.112 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install librados-devel 2026-02-23T07:38:22.404 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:35 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:22.440 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:22.440 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:22.440 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repo Size 2026-02-23T07:38:22.440 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:22.440 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout: librados-devel x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 128 k 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout:Install 1 Package 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 128 k 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 448 k 2026-02-23T07:38:22.441 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:22.524 INFO:teuthology.orchestra.run.trial129.stdout:librados-devel-20.3.0-5433.g5adce3ff.el10.x86_6 1.5 MB/s | 128 kB 00:00 2026-02-23T07:38:22.524 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:22.525 INFO:teuthology.orchestra.run.trial129.stdout:Total 1.5 MB/s | 128 kB 00:00 2026-02-23T07:38:22.525 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:22.527 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:22.528 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:22.557 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:22.558 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:22.608 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:22.626 INFO:teuthology.orchestra.run.trial129.stdout: Installing : librados-devel-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:22.739 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: librados-devel-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:22.739 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:22.739 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:22.739 INFO:teuthology.orchestra.run.trial129.stdout: librados-devel-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:22.740 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:22.740 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:22.764 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install libcephfs2 2026-02-23T07:38:23.057 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:36 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:23.082 INFO:teuthology.orchestra.run.trial129.stdout:Package libcephfs2-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:23.092 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:23.093 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:23.093 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:23.113 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install libcephfs-devel 2026-02-23T07:38:23.398 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:36 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:23.435 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:23.435 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:23.435 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repo Size 2026-02-23T07:38:23.435 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:23.435 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:23.435 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs-devel x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 37 k 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout:Install 1 Package 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 37 k 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 171 k 2026-02-23T07:38:23.436 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:23.497 INFO:teuthology.orchestra.run.trial129.stdout:libcephfs-devel-20.3.0-5433.g5adce3ff.el10.x86_ 616 kB/s | 37 kB 00:00 2026-02-23T07:38:23.497 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:23.498 INFO:teuthology.orchestra.run.trial129.stdout:Total 609 kB/s | 37 kB 00:00 2026-02-23T07:38:23.498 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:23.500 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:23.500 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:23.502 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:23.502 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:23.522 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:23.540 INFO:teuthology.orchestra.run.trial129.stdout: Installing : libcephfs-devel-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:23.637 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:23.638 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:23.638 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:23.638 INFO:teuthology.orchestra.run.trial129.stdout: libcephfs-devel-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:23.638 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:23.638 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:23.662 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install librados2 2026-02-23T07:38:23.955 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:36 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:23.981 INFO:teuthology.orchestra.run.trial129.stdout:Package librados2-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:23.991 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:23.991 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:23.992 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:24.011 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install librbd1 2026-02-23T07:38:24.299 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:37 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:24.326 INFO:teuthology.orchestra.run.trial129.stdout:Package librbd1-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:24.335 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:24.336 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:24.336 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:24.358 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install python3-rados 2026-02-23T07:38:24.650 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:37 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:24.676 INFO:teuthology.orchestra.run.trial129.stdout:Package python3-rados-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:24.686 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:24.686 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:24.687 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:24.707 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install python3-rgw 2026-02-23T07:38:24.998 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:37 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:25.024 INFO:teuthology.orchestra.run.trial129.stdout:Package python3-rgw-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:25.034 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:25.035 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:25.035 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:25.055 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install python3-cephfs 2026-02-23T07:38:25.339 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:38 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:25.366 INFO:teuthology.orchestra.run.trial129.stdout:Package python3-cephfs-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:25.375 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:25.376 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:25.377 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:25.396 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install python3-rbd 2026-02-23T07:38:25.687 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:38 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:25.713 INFO:teuthology.orchestra.run.trial129.stdout:Package python3-rbd-2:20.3.0-5433.g5adce3ff.el10.x86_64 is already installed. 2026-02-23T07:38:25.723 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:25.724 INFO:teuthology.orchestra.run.trial129.stdout:Nothing to do. 2026-02-23T07:38:25.724 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:25.743 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install rbd-fuse 2026-02-23T07:38:26.033 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:39 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repo Size 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout: rbd-fuse x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 87 k 2026-02-23T07:38:26.069 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout:Install 1 Package 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 87 k 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 215 k 2026-02-23T07:38:26.070 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:26.142 INFO:teuthology.orchestra.run.trial129.stdout:rbd-fuse-20.3.0-5433.g5adce3ff.el10.x86_64.rpm 1.2 MB/s | 87 kB 00:00 2026-02-23T07:38:26.142 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:26.142 INFO:teuthology.orchestra.run.trial129.stdout:Total 1.2 MB/s | 87 kB 00:00 2026-02-23T07:38:26.142 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:26.146 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:26.146 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:26.175 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:26.175 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:26.225 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:26.243 INFO:teuthology.orchestra.run.trial129.stdout: Installing : rbd-fuse-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:26.357 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:26.357 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:26.357 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:26.357 INFO:teuthology.orchestra.run.trial129.stdout: rbd-fuse-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:26.357 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:26.357 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:26.383 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install rbd-mirror 2026-02-23T07:38:26.667 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:39 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:26.703 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:26.703 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout: Package Arch Version Repo Size 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout: rbd-mirror x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 2.9 M 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:Install 1 Package 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 2.9 M 2026-02-23T07:38:26.704 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 11 M 2026-02-23T07:38:26.705 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:26.848 INFO:teuthology.orchestra.run.trial129.stdout:rbd-mirror-20.3.0-5433.g5adce3ff.el10.x86_64.rp 20 MB/s | 2.9 MB 00:00 2026-02-23T07:38:26.848 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:26.848 INFO:teuthology.orchestra.run.trial129.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-23T07:38:26.848 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:26.853 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:26.853 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:26.891 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:26.891 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:27.038 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:27.039 INFO:teuthology.orchestra.run.trial129.stdout: Installing : rbd-mirror-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:27.061 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:27.061 INFO:teuthology.orchestra.run.trial129.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-23T07:38:27.061 INFO:teuthology.orchestra.run.trial129.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-23T07:38:27.061 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-23T07:38:27.061 INFO:teuthology.orchestra.run.trial129.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-23T07:38:27.062 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:27.359 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:27.359 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:27.359 INFO:teuthology.orchestra.run.trial129.stdout: rbd-mirror-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:27.359 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:27.359 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:27.384 DEBUG:teuthology.orchestra.run.trial129:> sudo yum -y install rbd-nbd 2026-02-23T07:38:27.676 INFO:teuthology.orchestra.run.trial129.stdout:Last metadata expiration check: 0:00:40 ago on Mon 23 Feb 2026 07:37:47 AM UTC. 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout:Dependencies resolved. 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout: Package Architecture Version Repository Size 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout:Installing: 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout: rbd-nbd x86_64 2:20.3.0-5433.g5adce3ff.el10 ceph 180 k 2026-02-23T07:38:27.713 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout:Transaction Summary 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout:================================================================================ 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout:Install 1 Package 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout:Total download size: 180 k 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout:Installed size: 479 k 2026-02-23T07:38:27.714 INFO:teuthology.orchestra.run.trial129.stdout:Downloading Packages: 2026-02-23T07:38:27.795 INFO:teuthology.orchestra.run.trial129.stdout:rbd-nbd-20.3.0-5433.g5adce3ff.el10.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-23T07:38:27.795 INFO:teuthology.orchestra.run.trial129.stdout:-------------------------------------------------------------------------------- 2026-02-23T07:38:27.796 INFO:teuthology.orchestra.run.trial129.stdout:Total 2.1 MB/s | 180 kB 00:00 2026-02-23T07:38:27.796 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction check 2026-02-23T07:38:27.800 INFO:teuthology.orchestra.run.trial129.stdout:Transaction check succeeded. 2026-02-23T07:38:27.800 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction test 2026-02-23T07:38:27.830 INFO:teuthology.orchestra.run.trial129.stdout:Transaction test succeeded. 2026-02-23T07:38:27.830 INFO:teuthology.orchestra.run.trial129.stdout:Running transaction 2026-02-23T07:38:27.882 INFO:teuthology.orchestra.run.trial129.stdout: Preparing : 1/1 2026-02-23T07:38:27.901 INFO:teuthology.orchestra.run.trial129.stdout: Installing : rbd-nbd-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:28.012 INFO:teuthology.orchestra.run.trial129.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5433.g5adce3ff.el10.x86_64 1/1 2026-02-23T07:38:28.012 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:28.013 INFO:teuthology.orchestra.run.trial129.stdout:Installed: 2026-02-23T07:38:28.013 INFO:teuthology.orchestra.run.trial129.stdout: rbd-nbd-2:20.3.0-5433.g5adce3ff.el10.x86_64 2026-02-23T07:38:28.013 INFO:teuthology.orchestra.run.trial129.stdout: 2026-02-23T07:38:28.013 INFO:teuthology.orchestra.run.trial129.stdout:Complete! 2026-02-23T07:38:28.041 DEBUG:teuthology.parallel:result is None 2026-02-23T07:38:28.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=5adce3ff0fe1645dcbc38d059f948571dc3d69da 2026-02-23T07:38:28.218 DEBUG:teuthology.orchestra.run.trial129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-23T07:38:28.239 INFO:teuthology.orchestra.run.trial129.stdout:20.3.0-5433.g5adce3ff.el10 2026-02-23T07:38:28.239 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5433.g5adce3ff.el10 2026-02-23T07:38:28.240 INFO:teuthology.task.install:The correct ceph version 20.3.0-5433.g5adce3ff is installed. 2026-02-23T07:38:28.242 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-23T07:38:28.242 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:38:28.242 DEBUG:teuthology.orchestra.run.trial129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-23T07:38:28.306 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-23T07:38:28.306 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:38:28.306 DEBUG:teuthology.orchestra.run.trial129:> sudo dd of=/usr/bin/daemon-helper 2026-02-23T07:38:28.373 DEBUG:teuthology.orchestra.run.trial129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-23T07:38:28.439 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-23T07:38:28.439 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:38:28.439 DEBUG:teuthology.orchestra.run.trial129:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-23T07:38:28.505 DEBUG:teuthology.orchestra.run.trial129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-23T07:38:28.570 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-23T07:38:28.571 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:38:28.571 DEBUG:teuthology.orchestra.run.trial129:> sudo dd of=/usr/bin/stdin-killer 2026-02-23T07:38:28.636 DEBUG:teuthology.orchestra.run.trial129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-23T07:38:28.701 INFO:teuthology.run_tasks:Running task workunit... 2026-02-23T07:38:28.742 INFO:tasks.workunit:Pulling workunits from ref 5adce3ff0fe1645dcbc38d059f948571dc3d69da 2026-02-23T07:38:28.743 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-23T07:38:28.743 INFO:tasks.workunit:timeout=3h 2026-02-23T07:38:28.743 INFO:tasks.workunit:cleanup=True 2026-02-23T07:38:28.743 DEBUG:teuthology.orchestra.run.trial129:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-23T07:38:28.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T07:38:28.762 INFO:teuthology.orchestra.run.trial129.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-23T07:38:28.763 DEBUG:teuthology.orchestra.run.trial129:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-23T07:38:28.819 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-23T07:38:28.820 DEBUG:teuthology.orchestra.run.trial129:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-23T07:38:28.878 DEBUG:teuthology.orchestra.run.trial129:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5adce3ff0fe1645dcbc38d059f948571dc3d69da 2026-02-23T07:38:28.942 INFO:tasks.workunit.client.0.trial129.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-23T07:38:46.490 INFO:tasks.workunit.client.0.trial129.stderr:Note: switching to '5adce3ff0fe1645dcbc38d059f948571dc3d69da'. 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr:state without impacting any branches by switching back to a branch. 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-23T07:38:46.491 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr: git switch -c 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr:Or undo this operation with: 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr: git switch - 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr: 2026-02-23T07:38:46.492 INFO:tasks.workunit.client.0.trial129.stderr:HEAD is now at 5adce3ff0fe Merge branch 'wip-qa-distros-t-rocky' of https://github.com/cbodley/ceph into wip-bharath8-testing-2026-02-22-0716 2026-02-23T07:38:46.498 DEBUG:teuthology.orchestra.run.trial129:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-23T07:38:46.557 DEBUG:teuthology.orchestra.run.trial129:> set -ex 2026-02-23T07:38:46.558 DEBUG:teuthology.orchestra.run.trial129:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-23T07:38:46.616 INFO:tasks.workunit:Running workunits matching scrub on client.0... 2026-02-23T07:38:46.617 INFO:tasks.workunit:Running workunit scrub/osd-mapper.sh... 2026-02-23T07:38:46.617 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-mapper.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh 2026-02-23T07:38:46.680 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T07:38:46.684 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T07:38:46.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:38:46.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:38:46.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-mapper 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:12: run: local dir=td/osd-mapper 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:13: run: shift 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:15: run: export CEPH_MON=127.0.0.1:7144 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:15: run: CEPH_MON=127.0.0.1:7144 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:16: run: export CEPH_ARGS 2026-02-23T07:38:46.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:17: run: uuidgen 2026-02-23T07:38:46.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:17: run: CEPH_ARGS+='--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none ' 2026-02-23T07:38:46.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:18: run: CEPH_ARGS+='--mon-host=127.0.0.1:7144 ' 2026-02-23T07:38:46.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:20: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T07:38:46.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:21: run: set 2026-02-23T07:38:46.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:21: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T07:38:46.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:21: run: local funcs=TEST_truncated_sna_record 2026-02-23T07:38:46.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:22: run: for func in $funcs 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:23: run: setup td/osd-mapper 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-mapper 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-mapper 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-mapper 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-mapper KILL 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:38:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:38:46.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:38:46.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:38:46.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:38:46.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:38:46.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:38:46.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:38:46.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:38:46.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:38:46.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:38:46.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:38:46.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:38:46.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:38:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:38:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-mapper 2026-02-23T07:38:46.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:38:46.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:38:46.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:38:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.31403 2026-02-23T07:38:46.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:38:46.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:38:46.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-mapper 2026-02-23T07:38:46.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:38:46.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:38:46.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:38:46.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.31403 2026-02-23T07:38:46.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:38:46.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T07:38:46.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-mapper 1' TERM HUP INT 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:24: run: TEST_truncated_sna_record td/osd-mapper 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:46: TEST_truncated_sna_record: local dir=td/osd-mapper 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:47: TEST_truncated_sna_record: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='4' ['pool_name']='test') 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:47: TEST_truncated_sna_record: local -A cluster_conf 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:53: TEST_truncated_sna_record: local extr_dbg=3 2026-02-23T07:38:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:54: TEST_truncated_sna_record: (( extr_dbg > 1 )) 2026-02-23T07:38:46.702 INFO:tasks.workunit.client.0.trial129.stdout:Dir: td/osd-mapper 2026-02-23T07:38:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:54: TEST_truncated_sna_record: echo 'Dir: td/osd-mapper' 2026-02-23T07:38:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:55: TEST_truncated_sna_record: standard_scrub_cluster td/osd-mapper cluster_conf 2026-02-23T07:38:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-mapper 2026-02-23T07:38:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-23T07:38:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local extra_pars= 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T07:38:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T07:38:46.983 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 3ad3c33e-466c-4fb3-b1d1-dc26afe69a47 2026-02-23T07:38:47.077 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:38:47.104 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.101+0000 7efe0936d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:47.105 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.103+0000 7efe0936d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:47.106 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.104+0000 7efe0936d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:47.106 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.104+0000 7efe0936d780 -1 bdev(0x55983639b400 td/osd-mapper/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:38:47.107 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.104+0000 7efe0936d780 -1 bluestore(td/osd-mapper/0) _read_fsid unparsable uuid 2026-02-23T07:38:47.565 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:38:47.661 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:38:47.675 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.673+0000 7f253cb84780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:47.677 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.674+0000 7f253cb84780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:47.677 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.675+0000 7f253cb84780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:47.751 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:38:47.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:47.877+0000 7f253cb84780 -1 Falling back to public interface 2026-02-23T07:38:48.275 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:48.273+0000 7f253cb84780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:38:48.843 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:38:48.937 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3705391600,v1:127.0.0.1:6801/3705391600] [v2:127.0.0.1:6802/3705391600,v1:127.0.0.1:6803/3705391600] exists,up 3ad3c33e-466c-4fb3-b1d1-dc26afe69a47 2026-02-23T07:38:48.940 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 097d78c9-7cea-4f35-8d91-1f15a8fc04ed 2026-02-23T07:38:49.036 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:38:49.062 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.059+0000 7f9362812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:49.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.060+0000 7f9362812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:49.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.061+0000 7f9362812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:49.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.061+0000 7f9362812780 -1 bdev(0x5625ca023400 td/osd-mapper/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:38:49.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.061+0000 7f9362812780 -1 bluestore(td/osd-mapper/1) _read_fsid unparsable uuid 2026-02-23T07:38:49.490 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:38:49.695 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:38:49.709 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.707+0000 7f0c0256f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:49.711 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.708+0000 7f0c0256f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:49.711 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.709+0000 7f0c0256f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:49.858 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:38:49.921 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:49.918+0000 7f0c0256f780 -1 Falling back to public interface 2026-02-23T07:38:50.299 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:50.296+0000 7f0c0256f780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:38:51.023 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:38:51.187 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/133441380,v1:127.0.0.1:6811/133441380] [v2:127.0.0.1:6812/133441380,v1:127.0.0.1:6813/133441380] exists,up 097d78c9-7cea-4f35-8d91-1f15a8fc04ed 2026-02-23T07:38:51.192 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 0484a2b9-3d5a-47aa-a93d-fa0a9b86a68d 2026-02-23T07:38:51.357 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:38:51.384 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:51.381+0000 7fd052d75780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:51.385 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:51.383+0000 7fd052d75780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:51.386 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:51.383+0000 7fd052d75780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:51.386 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:51.384+0000 7fd052d75780 -1 bdev(0x55b65505d400 td/osd-mapper/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:38:51.386 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:51.384+0000 7fd052d75780 -1 bluestore(td/osd-mapper/2) _read_fsid unparsable uuid 2026-02-23T07:38:51.815 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:38:52.017 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:38:52.032 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:52.029+0000 7f650560a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:52.033 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:52.031+0000 7f650560a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:52.034 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:52.031+0000 7f650560a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:38:52.181 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:38:52.222 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:52.219+0000 7f650560a780 -1 Falling back to public interface 2026-02-23T07:38:52.574 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:38:52.571+0000 7f650560a780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:38:53.344 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:38:53.509 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/697619275,v1:127.0.0.1:6819/697619275] [v2:127.0.0.1:6820/697619275,v1:127.0.0.1:6821/697619275] exists,up 0484a2b9-3d5a-47aa-a93d-fa0a9b86a68d 2026-02-23T07:38:53.673 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T07:38:55.146 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T07:38:56.477 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705669 2026-02-23T07:38:56.646 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574852 2026-02-23T07:38:58.535 INFO:tasks.workunit.client.0.trial129.stdout:standard_scrub_cluster: dbg: test pool is test 1 2026-02-23T07:38:58.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:56: TEST_truncated_sna_record: ceph tell 'osd.*' config set osd_stats_update_period_not_scrubbing 1 2026-02-23T07:38:58.599 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:38:58.599 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T07:38:58.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:58.606 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:38:58.606 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T07:38:58.606 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:58.613 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:38:58.614 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T07:38:58.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:58.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:57: TEST_truncated_sna_record: ceph tell 'osd.*' config set osd_stats_update_period_scrubbing 1 2026-02-23T07:38:58.686 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:38:58.686 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_scrubbing = '' " 2026-02-23T07:38:58.686 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:58.692 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:38:58.693 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_scrubbing = '' " 2026-02-23T07:38:58.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:58.699 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:38:58.700 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_scrubbing = '' " 2026-02-23T07:38:58.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:59: TEST_truncated_sna_record: local osdn=3 2026-02-23T07:38:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:60: TEST_truncated_sna_record: local poolid=1 2026-02-23T07:38:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:61: TEST_truncated_sna_record: local poolname=test 2026-02-23T07:38:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:62: TEST_truncated_sna_record: local objname=objxxx 2026-02-23T07:38:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:65: TEST_truncated_sna_record: make_a_clone test objxxx snap01 snap02 2026-02-23T07:38:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:33: make_a_clone: local saved_echo_flag=x 2026-02-23T07:38:58.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:34: make_a_clone: set +x 2026-02-23T07:38:58.777 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap01 2026-02-23T07:38:58.879 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap02 2026-02-23T07:38:58.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:66: TEST_truncated_sna_record: make_a_clone test objxxx snap13 2026-02-23T07:38:58.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:33: make_a_clone: local saved_echo_flag=x 2026-02-23T07:38:58.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:34: make_a_clone: set +x 2026-02-23T07:38:58.982 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap13 2026-02-23T07:38:58.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:67: TEST_truncated_sna_record: make_a_clone test objxxx snap24 snap25 2026-02-23T07:38:58.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:33: make_a_clone: local saved_echo_flag=x 2026-02-23T07:38:58.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:34: make_a_clone: set +x 2026-02-23T07:38:59.082 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap24 2026-02-23T07:38:59.184 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap25 2026-02-23T07:38:59.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:68: TEST_truncated_sna_record: echo 6779 2026-02-23T07:38:59.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:68: TEST_truncated_sna_record: rados -p test put objxxx - 2026-02-23T07:38:59.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:71: TEST_truncated_sna_record: ceph --format=json-pretty osd map test objxxx 2026-02-23T07:38:59.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:71: TEST_truncated_sna_record: jq -r .pgid 2026-02-23T07:38:59.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:71: TEST_truncated_sna_record: local pgid=1.3 2026-02-23T07:38:59.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:72: TEST_truncated_sna_record: ceph --format=json-pretty osd map test objxxx 2026-02-23T07:38:59.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:72: TEST_truncated_sna_record: jq -r '.up[0]' 2026-02-23T07:38:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:72: TEST_truncated_sna_record: local osd=1 2026-02-23T07:38:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:73: TEST_truncated_sna_record: echo 'pgid is 1.3 (primary: osd.1)' 2026-02-23T07:38:59.539 INFO:tasks.workunit.client.0.trial129.stdout:pgid is 1.3 (primary: osd.1) 2026-02-23T07:38:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:75: TEST_truncated_sna_record: set_query_debug 1.3 2026-02-23T07:38:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.3 2026-02-23T07:38:59.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-23T07:38:59.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.3' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-23T07:38:59.693 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:38:59.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=1 2026-02-23T07:38:59.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.3 is 1' 2026-02-23T07:38:59.705 INFO:tasks.workunit.client.0.trial129.stdout:Setting scrub debug data. Primary for 1.3 is 1 2026-02-23T07:38:59.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.1 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.31403/ceph-osd.1.asok 2026-02-23T07:38:59.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-23T07:38:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.31403/ceph-osd.1.asok scrubdebug 1.3 set sessions 2026-02-23T07:38:59.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:78: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:38:59.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:78: TEST_truncated_sna_record: rados --format json-pretty -p test listsnaps objxxx 2026-02-23T07:38:59.784 INFO:tasks.workunit.client.0.trial129.stdout:{"success":true}{ 2026-02-23T07:38:59.784 INFO:tasks.workunit.client.0.trial129.stdout: "name": "objxxx", 2026-02-23T07:38:59.784 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 5, 2026-02-23T07:38:59.784 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T07:38:59.784 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.784 INFO:tasks.workunit.client.0.trial129.stdout: "id": 2, 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [ 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "id": 1, 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap01" 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "id": 2, 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap02" 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "size": 6, 2026-02-23T07:38:59.785 INFO:tasks.workunit.client.0.trial129.stdout: "overlaps": [] 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: "id": 3, 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [ 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: "id": 3, 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap13" 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: "size": 6, 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: "overlaps": [] 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:38:59.786 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "id": 5, 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [ 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "id": 4, 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap24" 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "id": 5, 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap25" 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "size": 6, 2026-02-23T07:38:59.787 INFO:tasks.workunit.client.0.trial129.stdout: "overlaps": [] 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: "id": "head", 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [], 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: "size": 5 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:38:59.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:59.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:81: TEST_truncated_sna_record: ceph pg 1.3 deep-scrub 2026-02-23T07:38:59.848 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:38:59.848 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:38:59.848 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:38:59.848 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:38:59.848 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:38:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:85: TEST_truncated_sna_record: sleep 3 2026-02-23T07:39:02.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:86: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-23T07:39:00.320549+0000 22'7 22:43 [1,2,0] 1 [1,2,0] 1 22'7 2026-02-23T07:39:00.320491+0000 22'7 2026-02-23T07:39:00.320491+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:39:00.320491+0000 4 0 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:38:53.778351+0000 0'0 22:30 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:38:54.276454+0000 0'0 22:28 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:38:53.778574+0000 0'0 22:32 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:03.009 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:03.010 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:03.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:87: TEST_truncated_sna_record: grep -a -q -- 'event: --^^^^---- ScrubFinished' td/osd-mapper/osd.1.log 2026-02-23T07:39:03.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:91: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-23T07:39:00.320549+0000 22'7 22:43 [1,2,0] 1 [1,2,0] 1 22'7 2026-02-23T07:39:00.320491+0000 22'7 2026-02-23T07:39:00.320491+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:39:00.320491+0000 4 0 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:38:53.778351+0000 0'0 22:30 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:38:54.276454+0000 0'0 22:28 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:38:53.778574+0000 0'0 22:32 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:03.171 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:03.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:92: TEST_truncated_sna_record: ceph osd set noscrub 2026-02-23T07:39:03.437 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T07:39:03.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:93: TEST_truncated_sna_record: ceph osd set nodeep-scrub 2026-02-23T07:39:03.638 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T07:39:03.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:94: TEST_truncated_sna_record: sleep 5 2026-02-23T07:39:08.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:95: TEST_truncated_sna_record: grep -a -q -v ERR td/osd-mapper/osd.1.log 2026-02-23T07:39:08.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:98: TEST_truncated_sna_record: kill_daemons td/osd-mapper TERM osd 2026-02-23T07:39:08.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:39:08.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:39:08.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:39:08.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:39:08.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:39:08.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:39:08.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:100: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:08.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:100: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 dump p 2026-02-23T07:39:08.975 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:08.974+0000 7fe82ce0bac0 1 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:08.975 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:08.974+0000 7fe82ce0bac0 0 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:08.976 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:08.974+0000 7fe82ce0bac0 1 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:08.976 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:08.974+0000 7fe82ce0bac0 1 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) close 2026-02-23T07:39:09.015 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 0 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-23T07:39:09.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bdev(0x55c5dcd45000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 0 bdev(0x55c5dcd45000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bdev(0x55c5dcd45000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.017 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-23T07:39:09.017 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bluefs mount 2026-02-23T07:39:09.017 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.013+0000 7fe82ce0bac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:09.018 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.018 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.019 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.019 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.019 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.019 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluefs mount shared_bdev_used = 0 2026-02-23T07:39:09.019 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.016+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:09.027 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:09.027 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_super_meta old nid_max 2050 2026-02-23T07:39:09.027 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_super_meta old blobid_max 20480 2026-02-23T07:39:09.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-23T07:39:09.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_super_meta min_alloc_size 0x1000 2026-02-23T07:39:09.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 freelist init 2026-02-23T07:39:09.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 freelist _read_cfg 2026-02-23T07:39:09.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.026+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-23T07:39:09.030 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.028+0000 7fe82ce0bac0 1 fbmap_alloc 0x55c5dcc4b7a0 shutdown 2026-02-23T07:39:09.030 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.028+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-23T07:39:09.030 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.028+0000 7fe82ce0bac0 1 bluefs umount 2026-02-23T07:39:09.030 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.028+0000 7fe82ce0bac0 1 bdev(0x55c5dcd45000 td/osd-mapper/0/block) close 2026-02-23T07:39:09.062 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.061+0000 7fe82ce0bac0 1 bdev(0x55c5dcd45000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.061+0000 7fe82ce0bac0 0 bdev(0x55c5dcd45000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.061+0000 7fe82ce0bac0 1 bdev(0x55c5dcd45000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.061+0000 7fe82ce0bac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-23T07:39:09.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.061+0000 7fe82ce0bac0 1 bluefs mount 2026-02-23T07:39:09.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.061+0000 7fe82ce0bac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:09.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.065 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluefs mount shared_bdev_used = 27656192 2026-02-23T07:39:09.065 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.063+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:09.072 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.071+0000 7fe82ce0bac0 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:09.073 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-23T07:39:09.073 INFO:tasks.workunit.client.0.trial129.stdout:00000000 0b 05 58 02 00 00 67 32 55 76 cb 4c 41 f2 ac 12 |..X...g2Uv.LA...| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000010 47 89 5c c0 44 b3 00 00 00 00 18 00 00 00 00 00 |G.\.D...........| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:* 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-23T07:39:09.074 INFO:tasks.workunit.client.0.trial129.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-23T07:39:09.075 INFO:tasks.workunit.client.0.trial129.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000220 72 65 18 00 00 00 05 00 00 00 3a d3 c3 3e 46 6c |re........:..>Fl| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000230 4f b3 b1 d1 dc 26 af e6 9a 47 00 00 00 00 00 00 |O....&...G......| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000240 00 00 18 00 00 00 09 04 9c 69 ce 7f 28 13 01 00 |.........i..(...| 2026-02-23T07:39:09.076 INFO:tasks.workunit.client.0.trial129.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:0000025e 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:09.077 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:0000003f 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.078 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.079 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.080 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.081 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-23T07:39:09.082 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.083 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.071+0000 7fe82ce0bac0 1 bluefs umount 2026-02-23T07:39:09.083 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.071+0000 7fe82ce0bac0 1 bdev(0x55c5dcd45000 td/osd-mapper/0/block) close 2026-02-23T07:39:09.099 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.098+0000 7fe82ce0bac0 1 freelist shutdown 2026-02-23T07:39:09.099 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.098+0000 7fe82ce0bac0 1 bdev(0x55c5dcd44c00 td/osd-mapper/0/block) close 2026-02-23T07:39:09.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:101: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:09.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:101: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-23T07:39:09.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:101: TEST_truncated_sna_record: grep -a SNA_ 2026-02-23T07:39:09.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.131+0000 7fc594611ac0 1 bdev(0x563d02548c00 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:09.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.131+0000 7fc594611ac0 0 bdev(0x563d02548c00 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:09.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.131+0000 7fc594611ac0 1 bdev(0x563d02548c00 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.131+0000 7fc594611ac0 1 bdev(0x563d02548c00 td/osd-mapper/2/block) close 2026-02-23T07:39:09.161 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bdev(0x563d02548c00 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:09.161 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 0 bdev(0x563d02548c00 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:09.161 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bdev(0x563d02548c00 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bdev(0x563d02549000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 0 bdev(0x563d02549000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bdev(0x563d02549000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bluefs mount 2026-02-23T07:39:09.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.160+0000 7fc594611ac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:09.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.165 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluefs mount shared_bdev_used = 0 2026-02-23T07:39:09.165 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.163+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:09.173 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.172+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.172+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_super_meta old nid_max 2051 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.172+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_super_meta old blobid_max 20480 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.172+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.172+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_super_meta min_alloc_size 0x1000 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.173+0000 7fc594611ac0 1 freelist init 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.173+0000 7fc594611ac0 1 freelist _read_cfg 2026-02-23T07:39:09.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.173+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-23T07:39:09.176 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.175+0000 7fc594611ac0 1 fbmap_alloc 0x563d0244f7a0 shutdown 2026-02-23T07:39:09.176 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.175+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc6000, fragmentation 7.62941e-08 2026-02-23T07:39:09.176 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.175+0000 7fc594611ac0 1 bluefs umount 2026-02-23T07:39:09.177 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.175+0000 7fc594611ac0 1 bdev(0x563d02549000 td/osd-mapper/2/block) close 2026-02-23T07:39:09.209 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.208+0000 7fc594611ac0 1 bdev(0x563d02549000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:09.209 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.208+0000 7fc594611ac0 0 bdev(0x563d02549000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:09.210 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.208+0000 7fc594611ac0 1 bdev(0x563d02549000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.210 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.208+0000 7fc594611ac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-23T07:39:09.210 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.208+0000 7fc594611ac0 1 bluefs mount 2026-02-23T07:39:09.210 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.208+0000 7fc594611ac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:09.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluefs mount shared_bdev_used = 27656192 2026-02-23T07:39:09.212 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.210+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:09.219 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.218+0000 7fc594611ac0 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:09.219 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.218+0000 7fc594611ac0 1 bluefs umount 2026-02-23T07:39:09.220 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.218+0000 7fc594611ac0 1 bdev(0x563d02549000 td/osd-mapper/2/block) close 2026-02-23T07:39:09.245 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.244+0000 7fc594611ac0 1 freelist shutdown 2026-02-23T07:39:09.245 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.244+0000 7fc594611ac0 1 bdev(0x563d02548c00 td/osd-mapper/2/block) close 2026-02-23T07:39:09.267 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.267 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.267 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.267 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.268 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:102: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:09.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:102: TEST_truncated_sna_record: grep -a SNA_ /tmp/oo2.dump 2026-02-23T07:39:09.269 INFO:tasks.workunit.client.0.trial129.stderr:grep: /tmp/oo2.dump: No such file or directory 2026-02-23T07:39:09.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:103: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:09.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:103: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-23T07:39:09.362 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-23T07:39:09.362 INFO:tasks.workunit.client.0.trial129.stdout:00000000 0b 05 58 02 00 00 67 32 55 76 cb 4c 41 f2 ac 12 |..X...g2Uv.LA...| 2026-02-23T07:39:09.362 INFO:tasks.workunit.client.0.trial129.stdout:00000010 47 89 5c c0 44 b3 02 00 00 00 19 00 00 00 00 00 |G.\.D...........| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:* 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-23T07:39:09.363 INFO:tasks.workunit.client.0.trial129.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-23T07:39:09.364 INFO:tasks.workunit.client.0.trial129.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:00000220 72 65 19 00 00 00 0d 00 00 00 04 84 a2 b9 3d 5a |re............=Z| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:00000230 47 aa a9 3d fa 0a 9b 86 a6 8d 00 00 00 00 00 00 |G..=............| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:00000240 00 00 19 00 00 00 0d 04 9c 69 59 66 48 24 01 00 |.........iYfH$..| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:00000250 00 00 01 00 00 00 01 00 00 00 19 00 00 00 |..............| 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:0000025e 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.365 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.366 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:0000003f 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.367 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.368 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.369 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-23T07:39:09.370 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-23T07:39:09.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_000000000000000[0-9]_000000000000000' 2026-02-23T07:39:09.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-23T07:39:09.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: wc -l 2026-02-23T07:39:09.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:105: TEST_truncated_sna_record: local num_sna_b4=5 2026-02-23T07:39:09.566 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: expr 3 - 1 2026-02-23T07:39:09.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: seq 0 2 2026-02-23T07:39:09.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:09.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:109: TEST_truncated_sna_record: kvdir=td/osd-mapper/0 2026-02-23T07:39:09.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:110: TEST_truncated_sna_record: echo 'corrupting the SnapMapper DB of osd.0 (db: td/osd-mapper/0)' 2026-02-23T07:39:09.569 INFO:tasks.workunit.client.0.trial129.stdout:corrupting the SnapMapper DB of osd.0 (db: td/osd-mapper/0) 2026-02-23T07:39:09.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: (( extr_dbg >= 3 )) 2026-02-23T07:39:09.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 dump p 2026-02-23T07:39:09.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.576+0000 7f3219e06ac0 1 bdev(0x55be1f932c00 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.576+0000 7f3219e06ac0 0 bdev(0x55be1f932c00 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.576+0000 7f3219e06ac0 1 bdev(0x55be1f932c00 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.578 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.577+0000 7f3219e06ac0 1 bdev(0x55be1f932c00 td/osd-mapper/0/block) close 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bdev(0x55be1f932c00 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 0 bdev(0x55be1f932c00 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bdev(0x55be1f932c00 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bdev(0x55be1f933000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 0 bdev(0x55be1f933000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bdev(0x55be1f933000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bluefs mount 2026-02-23T07:39:09.625 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.624+0000 7f3219e06ac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluefs mount shared_bdev_used = 0 2026-02-23T07:39:09.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.627+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_super_meta old nid_max 2050 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_super_meta old blobid_max 20480 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_super_meta min_alloc_size 0x1000 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 freelist init 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 freelist _read_cfg 2026-02-23T07:39:09.638 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.637+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-23T07:39:09.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.639+0000 7f3219e06ac0 1 fbmap_alloc 0x55be1f839200 shutdown 2026-02-23T07:39:09.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.639+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-23T07:39:09.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.639+0000 7f3219e06ac0 1 bluefs umount 2026-02-23T07:39:09.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.639+0000 7f3219e06ac0 1 bdev(0x55be1f933000 td/osd-mapper/0/block) close 2026-02-23T07:39:09.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.664+0000 7f3219e06ac0 1 bdev(0x55be1f933000 td/osd-mapper/0/block) open path td/osd-mapper/0/block 2026-02-23T07:39:09.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.664+0000 7f3219e06ac0 0 bdev(0x55be1f933000 td/osd-mapper/0/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/0/block failed: (22) Invalid argument 2026-02-23T07:39:09.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.664+0000 7f3219e06ac0 1 bdev(0x55be1f933000 td/osd-mapper/0/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:09.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.664+0000 7f3219e06ac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/0/block size 100 GiB 2026-02-23T07:39:09.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.664+0000 7f3219e06ac0 1 bluefs mount 2026-02-23T07:39:09.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.664+0000 7f3219e06ac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:09.666 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:09.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluefs mount shared_bdev_used = 27656192 2026-02-23T07:39:09.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.666+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.674+0000 7f3219e06ac0 1 bluestore(td/osd-mapper/0) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000000 0b 05 58 02 00 00 67 32 55 76 cb 4c 41 f2 ac 12 |..X...g2Uv.LA...| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000010 47 89 5c c0 44 b3 00 00 00 00 18 00 00 00 00 00 |G.\.D...........| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:* 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-23T07:39:09.675 INFO:tasks.workunit.client.0.trial129.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000220 72 65 18 00 00 00 05 00 00 00 3a d3 c3 3e 46 6c |re........:..>Fl| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000230 4f b3 b1 d1 dc 26 af e6 9a 47 00 00 00 00 00 00 |O....&...G......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000240 00 00 18 00 00 00 09 04 9c 69 ce 7f 28 13 01 00 |.........i..(...| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:0000025e 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.676 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:0000003f 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:09.677 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.678 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-23T07:39:09.678 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.678 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-23T07:39:09.678 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:09.678 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.674+0000 7f3219e06ac0 1 bluefs umount 2026-02-23T07:39:09.678 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.674+0000 7f3219e06ac0 1 bdev(0x55be1f933000 td/osd-mapper/0/block) close 2026-02-23T07:39:09.699 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.699+0000 7f3219e06ac0 1 freelist shutdown 2026-02-23T07:39:09.699 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:09.699+0000 7f3219e06ac0 1 bdev(0x55be1f932c00 td/osd-mapper/0/block) close 2026-02-23T07:39:09.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 dump p 2026-02-23T07:39:09.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_0000000000000003_000000000000000' 2026-02-23T07:39:09.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-23T07:39:09.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: KY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:09.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: echo 'SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..' 2026-02-23T07:39:09.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: cat -v 2026-02-23T07:39:09.889 INFO:tasks.workunit.client.0.trial129.stdout:SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:09.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: mktemp -p /tmp --suffix=_the_val 2026-02-23T07:39:09.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: tmp_fn1=/tmp/tmp.KVA9V7U1EM_the_val 2026-02-23T07:39:09.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:09.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: echo 'Value dumped in: /tmp/tmp.KVA9V7U1EM_the_val' 2026-02-23T07:39:09.891 INFO:tasks.workunit.client.0.trial129.stdout:Value dumped in: /tmp/tmp.KVA9V7U1EM_the_val 2026-02-23T07:39:09.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:120: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 get p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. out /tmp/tmp.KVA9V7U1EM_the_val 2026-02-23T07:39:09.981 INFO:tasks.workunit.client.0.trial129.stdout:(p, %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..) 2026-02-23T07:39:10.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:10.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: od -xc /tmp/tmp.KVA9V7U1EM_the_val 2026-02-23T07:39:10.036 INFO:tasks.workunit.client.0.trial129.stdout:0000000 0101 0035 0000 0003 0000 0000 0000 0304 2026-02-23T07:39:10.036 INFO:tasks.workunit.client.0.trial129.stdout: 001 001 5 \0 \0 \0 003 \0 \0 \0 \0 \0 \0 \0 004 003 2026-02-23T07:39:10.036 INFO:tasks.workunit.client.0.trial129.stdout:0000020 0027 0000 0000 0000 0006 0000 626f 786a 2026-02-23T07:39:10.036 INFO:tasks.workunit.client.0.trial129.stdout: ' \0 \0 \0 \0 \0 \0 \0 006 \0 \0 \0 o b j x 2026-02-23T07:39:10.037 INFO:tasks.workunit.client.0.trial129.stdout:0000040 7878 0003 0000 0000 0000 75af 85d0 0000 2026-02-23T07:39:10.037 INFO:tasks.workunit.client.0.trial129.stdout: x x 003 \0 \0 \0 \0 \0 \0 \0 257 u 320 205 \0 \0 2026-02-23T07:39:10.037 INFO:tasks.workunit.client.0.trial129.stdout:0000060 0000 0100 0000 0000 0000 0000 2026-02-23T07:39:10.037 INFO:tasks.workunit.client.0.trial129.stdout: \0 \0 \0 001 \0 \0 \0 \0 \0 \0 \0 2026-02-23T07:39:10.037 INFO:tasks.workunit.client.0.trial129.stdout:0000073 2026-02-23T07:39:10.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:123: TEST_truncated_sna_record: NKY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-23T07:39:10.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:124: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 rm p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:10.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:125: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/0 set p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 in /tmp/tmp.KVA9V7U1EM_the_val 2026-02-23T07:39:10.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:127: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:10.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:10.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:109: TEST_truncated_sna_record: kvdir=td/osd-mapper/1 2026-02-23T07:39:10.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:110: TEST_truncated_sna_record: echo 'corrupting the SnapMapper DB of osd.1 (db: td/osd-mapper/1)' 2026-02-23T07:39:10.353 INFO:tasks.workunit.client.0.trial129.stdout:corrupting the SnapMapper DB of osd.1 (db: td/osd-mapper/1) 2026-02-23T07:39:10.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: (( extr_dbg >= 3 )) 2026-02-23T07:39:10.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-23T07:39:10.361 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.360+0000 7fa0064dcac0 1 bdev(0x562791606c00 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-23T07:39:10.362 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.360+0000 7fa0064dcac0 0 bdev(0x562791606c00 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-23T07:39:10.362 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.360+0000 7fa0064dcac0 1 bdev(0x562791606c00 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:10.362 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.360+0000 7fa0064dcac0 1 bdev(0x562791606c00 td/osd-mapper/1/block) close 2026-02-23T07:39:10.396 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bdev(0x562791606c00 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-23T07:39:10.396 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 0 bdev(0x562791606c00 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-23T07:39:10.396 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bdev(0x562791606c00 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:10.396 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-23T07:39:10.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bdev(0x562791607000 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-23T07:39:10.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 0 bdev(0x562791607000 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-23T07:39:10.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bdev(0x562791607000 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:10.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/1/block size 100 GiB 2026-02-23T07:39:10.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bluefs mount 2026-02-23T07:39:10.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.394+0000 7fa0064dcac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:10.398 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluefs mount shared_bdev_used = 0 2026-02-23T07:39:10.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.397+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:10.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.406+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:10.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.406+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_super_meta old nid_max 2050 2026-02-23T07:39:10.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.406+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_super_meta old blobid_max 20480 2026-02-23T07:39:10.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.406+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-23T07:39:10.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.406+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_super_meta min_alloc_size 0x1000 2026-02-23T07:39:10.409 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.407+0000 7fa0064dcac0 1 freelist init 2026-02-23T07:39:10.409 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.407+0000 7fa0064dcac0 1 freelist _read_cfg 2026-02-23T07:39:10.409 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.407+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-23T07:39:10.410 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.409+0000 7fa0064dcac0 1 fbmap_alloc 0x56279150d7a0 shutdown 2026-02-23T07:39:10.410 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.409+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc8000, fragmentation 7.62941e-08 2026-02-23T07:39:10.410 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.409+0000 7fa0064dcac0 1 bluefs umount 2026-02-23T07:39:10.411 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.409+0000 7fa0064dcac0 1 bdev(0x562791607000 td/osd-mapper/1/block) close 2026-02-23T07:39:10.433 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.431+0000 7fa0064dcac0 1 bdev(0x562791607000 td/osd-mapper/1/block) open path td/osd-mapper/1/block 2026-02-23T07:39:10.433 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.431+0000 7fa0064dcac0 0 bdev(0x562791607000 td/osd-mapper/1/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/1/block failed: (22) Invalid argument 2026-02-23T07:39:10.433 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.431+0000 7fa0064dcac0 1 bdev(0x562791607000 td/osd-mapper/1/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:10.434 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.431+0000 7fa0064dcac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/1/block size 100 GiB 2026-02-23T07:39:10.434 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.431+0000 7fa0064dcac0 1 bluefs mount 2026-02-23T07:39:10.434 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.431+0000 7fa0064dcac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:10.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.436 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:10.436 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluefs mount shared_bdev_used = 27656192 2026-02-23T07:39:10.436 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.433+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:10.443 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.441+0000 7fa0064dcac0 1 bluestore(td/osd-mapper/1) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:10.444 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-23T07:39:10.445 INFO:tasks.workunit.client.0.trial129.stdout:00000000 0b 05 58 02 00 00 67 32 55 76 cb 4c 41 f2 ac 12 |..X...g2Uv.LA...| 2026-02-23T07:39:10.445 INFO:tasks.workunit.client.0.trial129.stdout:00000010 47 89 5c c0 44 b3 01 00 00 00 18 00 00 00 00 00 |G.\.D...........| 2026-02-23T07:39:10.445 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-23T07:39:10.445 INFO:tasks.workunit.client.0.trial129.stdout:* 2026-02-23T07:39:10.445 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-23T07:39:10.446 INFO:tasks.workunit.client.0.trial129.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-23T07:39:10.447 INFO:tasks.workunit.client.0.trial129.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-23T07:39:10.447 INFO:tasks.workunit.client.0.trial129.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-23T07:39:10.447 INFO:tasks.workunit.client.0.trial129.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-23T07:39:10.447 INFO:tasks.workunit.client.0.trial129.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-23T07:39:10.447 INFO:tasks.workunit.client.0.trial129.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-23T07:39:10.448 INFO:tasks.workunit.client.0.trial129.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-23T07:39:10.448 INFO:tasks.workunit.client.0.trial129.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-23T07:39:10.448 INFO:tasks.workunit.client.0.trial129.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-23T07:39:10.448 INFO:tasks.workunit.client.0.trial129.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-23T07:39:10.448 INFO:tasks.workunit.client.0.trial129.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-23T07:39:10.448 INFO:tasks.workunit.client.0.trial129.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-23T07:39:10.449 INFO:tasks.workunit.client.0.trial129.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-23T07:39:10.449 INFO:tasks.workunit.client.0.trial129.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-23T07:39:10.449 INFO:tasks.workunit.client.0.trial129.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-23T07:39:10.449 INFO:tasks.workunit.client.0.trial129.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-23T07:39:10.449 INFO:tasks.workunit.client.0.trial129.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-23T07:39:10.449 INFO:tasks.workunit.client.0.trial129.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-23T07:39:10.450 INFO:tasks.workunit.client.0.trial129.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-23T07:39:10.450 INFO:tasks.workunit.client.0.trial129.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-23T07:39:10.450 INFO:tasks.workunit.client.0.trial129.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-23T07:39:10.450 INFO:tasks.workunit.client.0.trial129.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-23T07:39:10.450 INFO:tasks.workunit.client.0.trial129.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-23T07:39:10.450 INFO:tasks.workunit.client.0.trial129.stdout:00000220 72 65 18 00 00 00 09 00 00 00 09 7d 78 c9 7c ea |re.........}x.|.| 2026-02-23T07:39:10.451 INFO:tasks.workunit.client.0.trial129.stdout:00000230 4f 35 8d 91 1f 15 a8 fc 04 ed 00 00 00 00 00 00 |O5..............| 2026-02-23T07:39:10.451 INFO:tasks.workunit.client.0.trial129.stdout:00000240 00 00 18 00 00 00 0b 04 9c 69 95 4b 9f 13 01 00 |.........i.K....| 2026-02-23T07:39:10.451 INFO:tasks.workunit.client.0.trial129.stdout:00000250 00 00 01 00 00 00 01 00 00 00 18 00 00 00 |..............| 2026-02-23T07:39:10.451 INFO:tasks.workunit.client.0.trial129.stdout:0000025e 2026-02-23T07:39:10.451 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.451 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-23T07:39:10.452 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.452 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:10.452 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:10.452 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:10.452 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:10.452 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-23T07:39:10.453 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:10.453 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:10.453 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.453 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:10.453 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-23T07:39:10.453 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:10.454 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:10.454 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-23T07:39:10.454 INFO:tasks.workunit.client.0.trial129.stdout:0000003f 2026-02-23T07:39:10.454 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.454 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:10.454 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.455 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:10.456 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:10.456 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:10.456 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:10.456 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:10.456 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:10.456 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.457 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:10.457 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:10.457 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:10.457 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:10.457 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:10.457 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:10.458 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:10.459 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:10.460 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.460 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:10.460 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:10.460 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:10.460 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:10.460 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:10.461 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:10.461 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.461 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-23T07:39:10.461 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.461 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-23T07:39:10.461 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:10.462 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.441+0000 7fa0064dcac0 1 bluefs umount 2026-02-23T07:39:10.462 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.441+0000 7fa0064dcac0 1 bdev(0x562791607000 td/osd-mapper/1/block) close 2026-02-23T07:39:10.468 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.467+0000 7fa0064dcac0 1 freelist shutdown 2026-02-23T07:39:10.468 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:10.467+0000 7fa0064dcac0 1 bdev(0x562791606c00 td/osd-mapper/1/block) close 2026-02-23T07:39:10.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-23T07:39:10.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_0000000000000003_000000000000000' 2026-02-23T07:39:10.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-23T07:39:10.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: KY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:10.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:10.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: echo 'SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..' 2026-02-23T07:39:10.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: cat -v 2026-02-23T07:39:10.647 INFO:tasks.workunit.client.0.trial129.stdout:SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:10.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: mktemp -p /tmp --suffix=_the_val 2026-02-23T07:39:10.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: tmp_fn1=/tmp/tmp.lPOijoei5Z_the_val 2026-02-23T07:39:10.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:10.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: echo 'Value dumped in: /tmp/tmp.lPOijoei5Z_the_val' 2026-02-23T07:39:10.648 INFO:tasks.workunit.client.0.trial129.stdout:Value dumped in: /tmp/tmp.lPOijoei5Z_the_val 2026-02-23T07:39:10.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:120: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 get p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. out /tmp/tmp.lPOijoei5Z_the_val 2026-02-23T07:39:10.750 INFO:tasks.workunit.client.0.trial129.stdout:(p, %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..) 2026-02-23T07:39:10.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:10.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: od -xc /tmp/tmp.lPOijoei5Z_the_val 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout:0000000 0101 0035 0000 0003 0000 0000 0000 0304 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout: 001 001 5 \0 \0 \0 003 \0 \0 \0 \0 \0 \0 \0 004 003 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout:0000020 0027 0000 0000 0000 0006 0000 626f 786a 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout: ' \0 \0 \0 \0 \0 \0 \0 006 \0 \0 \0 o b j x 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout:0000040 7878 0003 0000 0000 0000 75af 85d0 0000 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout: x x 003 \0 \0 \0 \0 \0 \0 \0 257 u 320 205 \0 \0 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout:0000060 0000 0100 0000 0000 0000 0000 2026-02-23T07:39:10.799 INFO:tasks.workunit.client.0.trial129.stdout: \0 \0 \0 001 \0 \0 \0 \0 \0 \0 \0 2026-02-23T07:39:10.800 INFO:tasks.workunit.client.0.trial129.stdout:0000073 2026-02-23T07:39:10.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:123: TEST_truncated_sna_record: NKY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-23T07:39:10.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:124: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 rm p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:10.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:125: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 set p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 in /tmp/tmp.lPOijoei5Z_the_val 2026-02-23T07:39:11.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:127: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:107: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:109: TEST_truncated_sna_record: kvdir=td/osd-mapper/2 2026-02-23T07:39:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:110: TEST_truncated_sna_record: echo 'corrupting the SnapMapper DB of osd.2 (db: td/osd-mapper/2)' 2026-02-23T07:39:11.095 INFO:tasks.workunit.client.0.trial129.stdout:corrupting the SnapMapper DB of osd.2 (db: td/osd-mapper/2) 2026-02-23T07:39:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: (( extr_dbg >= 3 )) 2026-02-23T07:39:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:111: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-23T07:39:11.104 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.103+0000 7f05a1cdaac0 1 bdev(0x55b5b255ac00 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:11.104 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.103+0000 7f05a1cdaac0 0 bdev(0x55b5b255ac00 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:11.104 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.103+0000 7f05a1cdaac0 1 bdev(0x55b5b255ac00 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:11.105 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.104+0000 7f05a1cdaac0 1 bdev(0x55b5b255ac00 td/osd-mapper/2/block) close 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bdev(0x55b5b255ac00 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 0 bdev(0x55b5b255ac00 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bdev(0x55b5b255ac00 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _set_cache_sizes cache_size 3221225472 meta 0.45 kv 0.45 kv_onode 0.04 data 0.06 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bdev(0x55b5b255b000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 0 bdev(0x55b5b255b000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:11.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bdev(0x55b5b255b000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:11.133 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-23T07:39:11.133 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bluefs mount 2026-02-23T07:39:11.133 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.130+0000 7f05a1cdaac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:11.134 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluefs mount shared_bdev_used = 0 2026-02-23T07:39:11.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.133+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:11.144 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.142+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:11.144 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.142+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_super_meta old nid_max 2051 2026-02-23T07:39:11.144 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.142+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_super_meta old blobid_max 20480 2026-02-23T07:39:11.144 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.142+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_super_meta ondisk_format 4 compat_ondisk_format 3 2026-02-23T07:39:11.144 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.142+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_super_meta min_alloc_size 0x1000 2026-02-23T07:39:11.145 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.143+0000 7f05a1cdaac0 1 freelist init 2026-02-23T07:39:11.145 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.143+0000 7f05a1cdaac0 1 freelist _read_cfg 2026-02-23T07:39:11.145 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.143+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_fm effective freelist_type = null, freelist_alloc_size = 0x1000, min_alloc_size = 0x1000 2026-02-23T07:39:11.146 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.145+0000 7f05a1cdaac0 1 fbmap_alloc 0x55b5b24617a0 shutdown 2026-02-23T07:39:11.146 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.145+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _init_alloc loaded 100 GiB in 3 extents, allocator type hybrid, capacity 0x1900000000, block size 0x1000, free 0x18fffc6000, fragmentation 7.62941e-08 2026-02-23T07:39:11.146 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.145+0000 7f05a1cdaac0 1 bluefs umount 2026-02-23T07:39:11.146 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.145+0000 7f05a1cdaac0 1 bdev(0x55b5b255b000 td/osd-mapper/2/block) close 2026-02-23T07:39:11.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.169+0000 7f05a1cdaac0 1 bdev(0x55b5b255b000 td/osd-mapper/2/block) open path td/osd-mapper/2/block 2026-02-23T07:39:11.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.169+0000 7f05a1cdaac0 0 bdev(0x55b5b255b000 td/osd-mapper/2/block) ioctl(F_SET_FILE_RW_HINT) on td/osd-mapper/2/block failed: (22) Invalid argument 2026-02-23T07:39:11.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.169+0000 7f05a1cdaac0 1 bdev(0x55b5b255b000 td/osd-mapper/2/block) open size 107374182400 (0x1900000000, 100 GiB) block_size 4096 (4 KiB) non-rotational device, discard supported 2026-02-23T07:39:11.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.169+0000 7f05a1cdaac0 1 bluefs add_block_device bdev 1 path td/osd-mapper/2/block size 100 GiB 2026-02-23T07:39:11.172 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.169+0000 7f05a1cdaac0 1 bluefs mount 2026-02-23T07:39:11.172 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.169+0000 7f05a1cdaac0 1 bluefs _init_alloc shared, id 1, capacity 0x1900000000, block size 0x10000 2026-02-23T07:39:11.173 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 0 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.173 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 1 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.173 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 2 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.173 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 3 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluefs mount final locked allocations 4 <0x0~0, [0x0~0], 0x0~0> => <0x0~0, [0x0~0], 0x0~0> 2026-02-23T07:39:11.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluefs mount shared_bdev_used = 27656192 2026-02-23T07:39:11.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.171+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _prepare_db_environment set db_paths to db,102005473280 db.slow,102005473280 2026-02-23T07:39:11.181 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.179+0000 7f05a1cdaac0 1 bluestore(td/osd-mapper/2) _open_db opened rocksdb path db options compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0 2026-02-23T07:39:11.182 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01.osd_superblock 2026-02-23T07:39:11.183 INFO:tasks.workunit.client.0.trial129.stdout:00000000 0b 05 58 02 00 00 67 32 55 76 cb 4c 41 f2 ac 12 |..X...g2Uv.LA...| 2026-02-23T07:39:11.183 INFO:tasks.workunit.client.0.trial129.stdout:00000010 47 89 5c c0 44 b3 02 00 00 00 19 00 00 00 00 00 |G.\.D...........| 2026-02-23T07:39:11.183 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 2026-02-23T07:39:11.183 INFO:tasks.workunit.client.0.trial129.stdout:* 2026-02-23T07:39:11.183 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 fe ff 03 00 00 00 00 00 11 00 |................| 2026-02-23T07:39:11.184 INFO:tasks.workunit.client.0.trial129.stdout:00000050 00 00 01 00 00 00 00 00 00 00 1a 00 00 00 69 6e |..............in| 2026-02-23T07:39:11.184 INFO:tasks.workunit.client.0.trial129.stdout:00000060 69 74 69 61 6c 20 66 65 61 74 75 72 65 20 73 65 |itial feature se| 2026-02-23T07:39:11.184 INFO:tasks.workunit.client.0.trial129.stdout:00000070 74 28 7e 76 2e 31 38 29 02 00 00 00 00 00 00 00 |t(~v.18)........| 2026-02-23T07:39:11.184 INFO:tasks.workunit.client.0.trial129.stdout:00000080 0d 00 00 00 70 67 69 6e 66 6f 20 6f 62 6a 65 63 |....pginfo objec| 2026-02-23T07:39:11.184 INFO:tasks.workunit.client.0.trial129.stdout:00000090 74 03 00 00 00 00 00 00 00 0e 00 00 00 6f 62 6a |t............obj| 2026-02-23T07:39:11.184 INFO:tasks.workunit.client.0.trial129.stdout:000000a0 65 63 74 20 6c 6f 63 61 74 6f 72 04 00 00 00 00 |ect locator.....| 2026-02-23T07:39:11.185 INFO:tasks.workunit.client.0.trial129.stdout:000000b0 00 00 00 10 00 00 00 6c 61 73 74 5f 65 70 6f 63 |.......last_epoc| 2026-02-23T07:39:11.185 INFO:tasks.workunit.client.0.trial129.stdout:000000c0 68 5f 63 6c 65 61 6e 05 00 00 00 00 00 00 00 0a |h_clean.........| 2026-02-23T07:39:11.185 INFO:tasks.workunit.client.0.trial129.stdout:000000d0 00 00 00 63 61 74 65 67 6f 72 69 65 73 06 00 00 |...categories...| 2026-02-23T07:39:11.185 INFO:tasks.workunit.client.0.trial129.stdout:000000e0 00 00 00 00 00 0b 00 00 00 68 6f 62 6a 65 63 74 |.........hobject| 2026-02-23T07:39:11.185 INFO:tasks.workunit.client.0.trial129.stdout:000000f0 70 6f 6f 6c 07 00 00 00 00 00 00 00 07 00 00 00 |pool............| 2026-02-23T07:39:11.185 INFO:tasks.workunit.client.0.trial129.stdout:00000100 62 69 67 69 6e 66 6f 08 00 00 00 00 00 00 00 0b |biginfo.........| 2026-02-23T07:39:11.186 INFO:tasks.workunit.client.0.trial129.stdout:00000110 00 00 00 6c 65 76 65 6c 64 62 69 6e 66 6f 09 00 |...leveldbinfo..| 2026-02-23T07:39:11.186 INFO:tasks.workunit.client.0.trial129.stdout:00000120 00 00 00 00 00 00 0a 00 00 00 6c 65 76 65 6c 64 |..........leveld| 2026-02-23T07:39:11.186 INFO:tasks.workunit.client.0.trial129.stdout:00000130 62 6c 6f 67 0a 00 00 00 00 00 00 00 0a 00 00 00 |blog............| 2026-02-23T07:39:11.186 INFO:tasks.workunit.client.0.trial129.stdout:00000140 73 6e 61 70 6d 61 70 70 65 72 0b 00 00 00 00 00 |snapmapper......| 2026-02-23T07:39:11.186 INFO:tasks.workunit.client.0.trial129.stdout:00000150 00 00 0f 00 00 00 73 68 61 72 64 65 64 20 6f 62 |......sharded ob| 2026-02-23T07:39:11.186 INFO:tasks.workunit.client.0.trial129.stdout:00000160 6a 65 63 74 73 0c 00 00 00 00 00 00 00 11 00 00 |jects...........| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:00000170 00 74 72 61 6e 73 61 63 74 69 6f 6e 20 68 69 6e |.transaction hin| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:00000180 74 73 0d 00 00 00 00 00 00 00 0e 00 00 00 70 67 |ts............pg| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:00000190 20 6d 65 74 61 20 6f 62 6a 65 63 74 0e 00 00 00 | meta object....| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:000001a0 00 00 00 00 14 00 00 00 65 78 70 6c 69 63 69 74 |........explicit| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:000001b0 20 6d 69 73 73 69 6e 67 20 73 65 74 0f 00 00 00 | missing set....| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:000001c0 00 00 00 00 10 00 00 00 66 61 73 74 69 6e 66 6f |........fastinfo| 2026-02-23T07:39:11.187 INFO:tasks.workunit.client.0.trial129.stdout:000001d0 20 70 67 20 61 74 74 72 10 00 00 00 00 00 00 00 | pg attr........| 2026-02-23T07:39:11.188 INFO:tasks.workunit.client.0.trial129.stdout:000001e0 16 00 00 00 64 65 6c 65 74 65 73 20 69 6e 20 6d |....deletes in m| 2026-02-23T07:39:11.188 INFO:tasks.workunit.client.0.trial129.stdout:000001f0 69 73 73 69 6e 67 20 73 65 74 11 00 00 00 00 00 |issing set......| 2026-02-23T07:39:11.188 INFO:tasks.workunit.client.0.trial129.stdout:00000200 00 00 1c 00 00 00 6e 65 77 20 73 6e 61 70 6d 61 |......new snapma| 2026-02-23T07:39:11.188 INFO:tasks.workunit.client.0.trial129.stdout:00000210 70 70 65 72 20 6b 65 79 20 73 74 72 75 63 74 75 |pper key structu| 2026-02-23T07:39:11.188 INFO:tasks.workunit.client.0.trial129.stdout:00000220 72 65 19 00 00 00 0d 00 00 00 04 84 a2 b9 3d 5a |re............=Z| 2026-02-23T07:39:11.188 INFO:tasks.workunit.client.0.trial129.stdout:00000230 47 aa a9 3d fa 0a 9b 86 a6 8d 00 00 00 00 00 00 |G..=............| 2026-02-23T07:39:11.189 INFO:tasks.workunit.client.0.trial129.stdout:00000240 00 00 19 00 00 00 0d 04 9c 69 59 66 48 24 01 00 |.........iYfH$..| 2026-02-23T07:39:11.189 INFO:tasks.workunit.client.0.trial129.stdout:00000250 00 00 01 00 00 00 01 00 00 00 19 00 00 00 |..............| 2026-02-23T07:39:11.189 INFO:tasks.workunit.client.0.trial129.stdout:0000025e 2026-02-23T07:39:11.189 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.189 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%7b%3fC%c4%00%00%00%00%00%00%00%01~ 2026-02-23T07:39:11.190 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.190 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:11.190 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:11.190 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 02 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:11.190 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:11.190 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 01 00 00 00 00 00 00 00 02 |................| 2026-02-23T07:39:11.191 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:11.191 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:11.191 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.191 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:11.191 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 39 00 00 00 04 03 27 00 00 00 00 00 00 00 |..9.....'.......| 2026-02-23T07:39:11.191 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 03 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 03 00 00 00 00 00 00 00 |...............| 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout:0000003f 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.OBJ_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 41 00 00 00 04 03 27 00 00 00 00 00 00 00 |..A.....'.......| 2026-02-23T07:39:11.192 INFO:tasks.workunit.client.0.trial129.stdout:00000010 06 00 00 00 6f 62 6a 78 78 78 05 00 00 00 00 00 |....objxxx......| 2026-02-23T07:39:11.193 INFO:tasks.workunit.client.0.trial129.stdout:00000020 00 00 af 75 d0 85 00 00 00 00 00 01 00 00 00 00 |...u............| 2026-02-23T07:39:11.193 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 02 00 00 00 04 00 00 00 00 00 00 00 05 |................| 2026-02-23T07:39:11.193 INFO:tasks.workunit.client.0.trial129.stdout:00000040 00 00 00 00 00 00 00 |.......| 2026-02-23T07:39:11.193 INFO:tasks.workunit.client.0.trial129.stdout:00000047 2026-02-23T07:39:11.193 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 01 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:11.194 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.195 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:11.195 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 02 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:11.195 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:11.195 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 02 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:11.195 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:11.195 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:11.196 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.196 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:11.196 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 03 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:11.196 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:11.196 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 03 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:11.196 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:11.197 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:11.197 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.197 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:11.197 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 04 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:11.197 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:11.197 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:11.198 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:11.198 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:11.198 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.198 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:11.198 INFO:tasks.workunit.client.0.trial129.stdout:00000000 01 01 35 00 00 00 05 00 00 00 00 00 00 00 04 03 |..5.............| 2026-02-23T07:39:11.198 INFO:tasks.workunit.client.0.trial129.stdout:00000010 27 00 00 00 00 00 00 00 06 00 00 00 6f 62 6a 78 |'...........objx| 2026-02-23T07:39:11.199 INFO:tasks.workunit.client.0.trial129.stdout:00000020 78 78 05 00 00 00 00 00 00 00 af 75 d0 85 00 00 |xx.........u....| 2026-02-23T07:39:11.199 INFO:tasks.workunit.client.0.trial129.stdout:00000030 00 00 00 01 00 00 00 00 00 00 00 |...........| 2026-02-23T07:39:11.199 INFO:tasks.workunit.client.0.trial129.stdout:0000003b 2026-02-23T07:39:11.199 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.199 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02~ 2026-02-23T07:39:11.199 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.200 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c1%a3%fcn%00%00%00%00%00%00%04%03~ 2026-02-23T07:39:11.200 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:11.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.179+0000 7f05a1cdaac0 1 bluefs umount 2026-02-23T07:39:11.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.179+0000 7f05a1cdaac0 1 bdev(0x55b5b255b000 td/osd-mapper/2/block) close 2026-02-23T07:39:11.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.198+0000 7f05a1cdaac0 1 freelist shutdown 2026-02-23T07:39:11.202 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.198+0000 7f05a1cdaac0 1 bdev(0x55b5b255ac00 td/osd-mapper/2/block) close 2026-02-23T07:39:11.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 dump p 2026-02-23T07:39:11.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_0000000000000003_000000000000000' 2026-02-23T07:39:11.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-23T07:39:11.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:115: TEST_truncated_sna_record: KY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:11.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:11.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: echo 'SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..' 2026-02-23T07:39:11.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:116: TEST_truncated_sna_record: cat -v 2026-02-23T07:39:11.361 INFO:tasks.workunit.client.0.trial129.stdout:SNA key: %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:11.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: mktemp -p /tmp --suffix=_the_val 2026-02-23T07:39:11.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:118: TEST_truncated_sna_record: tmp_fn1=/tmp/tmp.2Pj7KRWvJE_the_val 2026-02-23T07:39:11.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:11.362 INFO:tasks.workunit.client.0.trial129.stdout:Value dumped in: /tmp/tmp.2Pj7KRWvJE_the_val 2026-02-23T07:39:11.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:119: TEST_truncated_sna_record: echo 'Value dumped in: /tmp/tmp.2Pj7KRWvJE_the_val' 2026-02-23T07:39:11.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:120: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 get p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. out /tmp/tmp.2Pj7KRWvJE_the_val 2026-02-23T07:39:11.443 INFO:tasks.workunit.client.0.trial129.stdout:(p, %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx..) 2026-02-23T07:39:11.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:121: TEST_truncated_sna_record: od -xc /tmp/tmp.2Pj7KRWvJE_the_val 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout:0000000 0101 0035 0000 0003 0000 0000 0000 0304 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout: 001 001 5 \0 \0 \0 003 \0 \0 \0 \0 \0 \0 \0 004 003 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout:0000020 0027 0000 0000 0000 0006 0000 626f 786a 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout: ' \0 \0 \0 \0 \0 \0 \0 006 \0 \0 \0 o b j x 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout:0000040 7878 0003 0000 0000 0000 75af 85d0 0000 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout: x x 003 \0 \0 \0 \0 \0 \0 \0 257 u 320 205 \0 \0 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout:0000060 0000 0100 0000 0000 0000 0000 2026-02-23T07:39:11.498 INFO:tasks.workunit.client.0.trial129.stdout: \0 \0 \0 001 \0 \0 \0 \0 \0 \0 \0 2026-02-23T07:39:11.499 INFO:tasks.workunit.client.0.trial129.stdout:0000073 2026-02-23T07:39:11.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:123: TEST_truncated_sna_record: NKY=%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-23T07:39:11.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:124: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 rm p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:11.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:125: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/2 set p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 in /tmp/tmp.2Pj7KRWvJE_the_val 2026-02-23T07:39:11.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:127: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:11.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:130: TEST_truncated_sna_record: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 ' 2026-02-23T07:39:11.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:131: TEST_truncated_sna_record: echo --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 2026-02-23T07:39:11.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:131: TEST_truncated_sna_record: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:11.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:132: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:11.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:132: TEST_truncated_sna_record: echo 'Copied OSD args: / --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/ /--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/' 2026-02-23T07:39:11.794 INFO:tasks.workunit.client.0.trial129.stdout:Copied OSD args: / --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/ /--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3/ 2026-02-23T07:39:11.801 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: expr 3 - 1 2026-02-23T07:39:11.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: seq 0 2 2026-02-23T07:39:11.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:11.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: CEPH_ARGS='--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:11.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: activate_osd td/osd-mapper 0 2026-02-23T07:39:11.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-mapper 2026-02-23T07:39:11.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:39:11.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:39:11.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:39:11.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-mapper/0 2026-02-23T07:39:11.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:11.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-mapper/0' 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-mapper/0/journal' 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:39:11.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-mapper' 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:39:11.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.31403/$cluster-$name.asok' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.31403/$cluster-$name.asok' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-mapper/$name.log' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-mapper/$name.pid' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:11.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:11.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:11.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:39:11.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:39:11.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-mapper/0 2026-02-23T07:39:11.807 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-mapper/0 --osd-journal=td/osd-mapper/0/journal --chdir= --run-dir=td/osd-mapper '--admin-socket=/tmp/ceph-asok.31403/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-mapper/$name.log' '--pid-file=td/osd-mapper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-mapper/0/whoami 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:39:11.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:39:11.817 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.816+0000 7f6ed874f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:11.819 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.818+0000 7f6ed874f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:11.819 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:11.818+0000 7f6ed874f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:11.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:39:11.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:11.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:39:11.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:11.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:11.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:11.971 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:11.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:11.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:11.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:39:12.002 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:12.000+0000 7f6ed874f780 -1 Falling back to public interface 2026-02-23T07:39:12.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:12.332 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:12.331+0000 7f6ed874f780 -1 osd.0 24 log_to_monitors true 2026-02-23T07:39:13.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:13.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:13.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:13.144 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:13.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:13.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:39:13.322 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 28 up_thru 28 down_at 25 last_clean_interval [5,24) [v2:127.0.0.1:6800/3345579873,v1:127.0.0.1:6801/3345579873] [v2:127.0.0.1:6802/3345579873,v1:127.0.0.1:6803/3345579873] exists,up 3ad3c33e-466c-4fb3-b1d1-dc26afe69a47 2026-02-23T07:39:13.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: CEPH_ARGS='--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: activate_osd td/osd-mapper 1 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-mapper 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-mapper/1 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-mapper/1' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-mapper/1/journal' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-mapper' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:13.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.31403/$cluster-$name.asok' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.31403/$cluster-$name.asok' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-mapper/$name.log' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-mapper/$name.pid' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:39:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-mapper/1 2026-02-23T07:39:13.326 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:39:13.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:39:13.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-mapper/1 --osd-journal=td/osd-mapper/1/journal --chdir= --run-dir=td/osd-mapper '--admin-socket=/tmp/ceph-asok.31403/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-mapper/$name.log' '--pid-file=td/osd-mapper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:39:13.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-mapper/1/whoami 2026-02-23T07:39:13.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:39:13.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:39:13.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:39:13.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:39:13.346 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:13.345+0000 7fa1fa74e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:13.347 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:13.346+0000 7fa1fa74e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:13.348 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:13.347+0000 7fa1fa74e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:39:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:39:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:13.500 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:13.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:13.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:13.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:39:13.534 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:13.533+0000 7fa1fa74e780 -1 Falling back to public interface 2026-02-23T07:39:13.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:13.904 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:13.903+0000 7fa1fa74e780 -1 osd.1 24 log_to_monitors true 2026-02-23T07:39:14.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:14.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:14.675 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:14.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:14.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:14.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:39:14.848 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 31 up_thru 31 down_at 25 last_clean_interval [9,24) [v2:127.0.0.1:6810/913491049,v1:127.0.0.1:6811/913491049] [v2:127.0.0.1:6812/913491049,v1:127.0.0.1:6813/913491049] exists,up 097d78c9-7cea-4f35-8d91-1f15a8fc04ed 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:133: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: CEPH_ARGS='--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:135: TEST_truncated_sna_record: activate_osd td/osd-mapper 2 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-mapper 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-mapper/2 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3' 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:14.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-mapper/2' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-mapper/2/journal' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-mapper' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.31403/$cluster-$name.asok' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.31403/$cluster-$name.asok' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-mapper/$name.log' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-mapper/$name.pid' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:14.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:39:14.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:39:14.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-mapper/2 2026-02-23T07:39:14.853 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:39:14.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T07:39:14.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=67325576-cb4c-41f2-ac12-47895cc044b3 --auth-supported=none --mon-host=127.0.0.1:7144 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-mapper/2 --osd-journal=td/osd-mapper/2/journal --chdir= --run-dir=td/osd-mapper '--admin-socket=/tmp/ceph-asok.31403/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-mapper/$name.log' '--pid-file=td/osd-mapper/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:39:14.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-mapper/2/whoami 2026-02-23T07:39:14.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T07:39:14.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:39:14.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:39:14.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:39:14.872 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:14.871+0000 7f87c5c07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:14.873 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:14.873+0000 7f87c5c07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:14.874 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:14.873+0000 7f87c5c07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T07:39:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:39:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:15.028 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:15.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:15.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:39:15.133 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:15.132+0000 7f87c5c07780 -1 Falling back to public interface 2026-02-23T07:39:15.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:15.481 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:15.480+0000 7f87c5c07780 -1 osd.2 25 log_to_monitors true 2026-02-23T07:39:16.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:16.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:16.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:16.203 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:16.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:16.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:39:16.380 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 34 up_thru 34 down_at 25 last_clean_interval [13,25) [v2:127.0.0.1:6818/3484711471,v1:127.0.0.1:6819/3484711471] [v2:127.0.0.1:6820/3484711471,v1:127.0.0.1:6821/3484711471] exists,up 0484a2b9-3d5a-47aa-a93d-fa0a9b86a68d 2026-02-23T07:39:16.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:16.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:16.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:16.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:137: TEST_truncated_sna_record: sleep 1 2026-02-23T07:39:17.382 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: expr 3 - 1 2026-02-23T07:39:17.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: seq 0 2 2026-02-23T07:39:17.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:17.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:141: TEST_truncated_sna_record: timeout 60 ceph tell osd.0 version 2026-02-23T07:39:17.449 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:39:17.449 INFO:tasks.workunit.client.0.trial129.stdout: "version": "20.3.0-5433-g5adce3ff", 2026-02-23T07:39:17.449 INFO:tasks.workunit.client.0.trial129.stdout: "release": "tentacle", 2026-02-23T07:39:17.450 INFO:tasks.workunit.client.0.trial129.stdout: "release_type": "dev" 2026-02-23T07:39:17.450 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:39:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:141: TEST_truncated_sna_record: timeout 60 ceph tell osd.1 version 2026-02-23T07:39:17.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:39:17.520 INFO:tasks.workunit.client.0.trial129.stdout: "version": "20.3.0-5433-g5adce3ff", 2026-02-23T07:39:17.520 INFO:tasks.workunit.client.0.trial129.stdout: "release": "tentacle", 2026-02-23T07:39:17.520 INFO:tasks.workunit.client.0.trial129.stdout: "release_type": "dev" 2026-02-23T07:39:17.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:39:17.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:139: TEST_truncated_sna_record: for sdn in $(seq 0 $(expr $osdn - 1)) 2026-02-23T07:39:17.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:141: TEST_truncated_sna_record: timeout 60 ceph tell osd.2 version 2026-02-23T07:39:17.590 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:39:17.590 INFO:tasks.workunit.client.0.trial129.stdout: "version": "20.3.0-5433-g5adce3ff", 2026-02-23T07:39:17.590 INFO:tasks.workunit.client.0.trial129.stdout: "release": "tentacle", 2026-02-23T07:39:17.590 INFO:tasks.workunit.client.0.trial129.stdout: "release_type": "dev" 2026-02-23T07:39:17.590 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:39:17.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:143: TEST_truncated_sna_record: rados --format json-pretty -p test listsnaps objxxx 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "name": "objxxx", 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 5, 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "id": 2, 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [ 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "id": 1, 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap01" 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "id": 2, 2026-02-23T07:39:17.612 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap02" 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "size": 6, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "overlaps": [] 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "id": 3, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [ 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "id": 3, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap13" 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "size": 6, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "overlaps": [] 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "id": 5, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [ 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "id": 4, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap24" 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "id": 5, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "name": "snap25" 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "size": 6, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: "overlaps": [] 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:39:17.613 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stdout: "id": "head", 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stdout: "snapshots": [], 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stdout: "size": 5 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:39:17.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:146: TEST_truncated_sna_record: ceph osd unset nodeep-scrub 2026-02-23T07:39:17.820 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is unset 2026-02-23T07:39:17.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:147: TEST_truncated_sna_record: ceph osd unset noscrub 2026-02-23T07:39:18.023 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is unset 2026-02-23T07:39:18.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:150: TEST_truncated_sna_record: ceph --format=json-pretty osd map test objxxx 2026-02-23T07:39:18.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:150: TEST_truncated_sna_record: jq -r '.up[0]' 2026-02-23T07:39:18.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:150: TEST_truncated_sna_record: local cur_prim=1 2026-02-23T07:39:18.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:151: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-23T07:39:15.797624+0000 22'7 37:67 [1,2,0] 1 [1,2,0] 1 22'7 2026-02-23T07:39:00.320491+0000 22'7 2026-02-23T07:39:00.320491+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:39:00.320491+0000 4 0 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.797800+0000 0'0 36:41 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.698083+0000 0'0 36:51 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.797618+0000 0'0 37:35 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:18.358 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:18.359 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:18.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:152: TEST_truncated_sna_record: sleep 2 2026-02-23T07:39:20.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:153: TEST_truncated_sna_record: ceph pg 1.3 deep-scrub 2026-02-23T07:39:20.434 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:39:20.434 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:39:20.435 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:39:20.435 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:39:20.435 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:39:20.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:154: TEST_truncated_sna_record: sleep 5 2026-02-23T07:39:25.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:155: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-23T07:39:25.597 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:25.597 INFO:tasks.workunit.client.0.trial129.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-23T07:39:20.896653+0000 22'7 41:82 [1,2,0] 1 [1,2,0] 1 22'7 2026-02-23T07:39:20.896600+0000 22'7 2026-02-23T07:39:20.896600+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:39:20.896600+0000 4 0 2026-02-23T07:39:25.597 INFO:tasks.workunit.client.0.trial129.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.797800+0000 0'0 41:51 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:25.597 INFO:tasks.workunit.client.0.trial129.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.698083+0000 0'0 41:61 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:25.597 INFO:tasks.workunit.client.0.trial129.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.797618+0000 0'0 41:43 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:25.598 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:25.598 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:25.598 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:156: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:156: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-23T07:39:25.610 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:20.896+0000 7fa1da8446c0 -1 log_channel(cluster) log [ERR] : osd.1 found snap mapper error on pg 1.3 oid 1:f5ae0ba1:::objxxx:3 snaps in mapper: {}, oi: {3} ...repaired 2026-02-23T07:39:25.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:157: TEST_truncated_sna_record: grep -a -q ERR td/osd-mapper/osd.1.log 2026-02-23T07:39:25.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:161: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-23T07:39:25.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:161: TEST_truncated_sna_record: wc -l 2026-02-23T07:39:25.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:161: TEST_truncated_sna_record: local prev_err_cnt=1 2026-02-23T07:39:25.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:162: TEST_truncated_sna_record: echo 'prev count: 1' 2026-02-23T07:39:25.613 INFO:tasks.workunit.client.0.trial129.stdout:prev count: 1 2026-02-23T07:39:25.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:165: TEST_truncated_sna_record: ceph pg 1.3 deep-scrub 2026-02-23T07:39:25.677 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:39:25.677 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:39:25.678 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:39:25.678 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:39:25.678 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:39:25.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:166: TEST_truncated_sna_record: sleep 5 2026-02-23T07:39:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:167: TEST_truncated_sna_record: ceph pg dump pgs 2026-02-23T07:39:30.839 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:30.839 INFO:tasks.workunit.client.0.trial129.stdout:1.3 4 0 0 0 0 23 0 0 7 0 7 active+clean 2026-02-23T07:39:25.846298+0000 22'7 41:91 [1,2,0] 1 [1,2,0] 1 22'7 2026-02-23T07:39:25.846236+0000 22'7 2026-02-23T07:39:25.846236+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:39:25.846236+0000 4 0 2026-02-23T07:39:30.839 INFO:tasks.workunit.client.0.trial129.stdout:1.2 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.797800+0000 0'0 41:52 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:30.839 INFO:tasks.workunit.client.0.trial129.stdout:1.1 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.698083+0000 0'0 41:62 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:30.840 INFO:tasks.workunit.client.0.trial129.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:15.797618+0000 0'0 41:45 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:38:53.669845+0000 0'0 2026-02-23T07:38:53.669845+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:38:53.669845+0000 0 0 2026-02-23T07:39:30.840 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:30.840 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:30.840 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:30.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:168: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:30.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:168: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-23T07:39:30.852 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:20.896+0000 7fa1da8446c0 -1 log_channel(cluster) log [ERR] : osd.1 found snap mapper error on pg 1.3 oid 1:f5ae0ba1:::objxxx:3 snaps in mapper: {}, oi: {3} ...repaired 2026-02-23T07:39:30.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:169: TEST_truncated_sna_record: grep -a ERR td/osd-mapper/osd.1.log 2026-02-23T07:39:30.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:169: TEST_truncated_sna_record: wc -l 2026-02-23T07:39:30.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:169: TEST_truncated_sna_record: local current_err_cnt=1 2026-02-23T07:39:30.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:170: TEST_truncated_sna_record: (( extr_dbg >= 1 )) 2026-02-23T07:39:30.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:170: TEST_truncated_sna_record: echo 'current count: 1' 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stdout:current count: 1 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:171: TEST_truncated_sna_record: (( current_err_cnt == prev_err_cnt )) 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:172: TEST_truncated_sna_record: kill_daemons td/osd-mapper TERM osd 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:39:30.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:39:30.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:39:31.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:39:31.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:173: TEST_truncated_sna_record: kvdir=td/osd-mapper/1 2026-02-23T07:39:31.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:174: TEST_truncated_sna_record: (( extr_dbg >= 2 )) 2026-02-23T07:39:31.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:174: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-23T07:39:31.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:174: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_' 2026-02-23T07:39:31.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:175: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-23T07:39:31.309 INFO:tasks.workunit.client.0.trial129.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:31.309 INFO:tasks.workunit.client.0.trial129.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.FA570D58.2.objxxx.. 2026-02-23T07:39:31.309 INFO:tasks.workunit.client.0.trial129.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_000000 2026-02-23T07:39:31.309 INFO:tasks.workunit.client.0.trial129.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.FA570D58.3.objxxx.. 2026-02-23T07:39:31.309 INFO:tasks.workunit.client.0.trial129.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:31.310 INFO:tasks.workunit.client.0.trial129.stdout:%00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.FA570D58.5.objxxx.. 2026-02-23T07:39:31.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: ceph-kvstore-tool bluestore-kv td/osd-mapper/1 dump p 2026-02-23T07:39:31.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: grep -a -e 'SNA_[0-9]_000000000000000[0-9]_000000000000000' 2026-02-23T07:39:31.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: awk -e '{print $2;}' 2026-02-23T07:39:31.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: wc -l 2026-02-23T07:39:31.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:177: TEST_truncated_sna_record: local num_sna_full=5 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:178: TEST_truncated_sna_record: (( num_sna_full == num_sna_b4 )) 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:179: TEST_truncated_sna_record: return 0 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh:25: run: teardown td/osd-mapper 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-mapper 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-mapper KILL 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:39:31.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:39:31.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:39:31.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:39:31.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:39:31.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:39:31.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:39:31.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:39:31.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:39:31.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:39:31.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:39:31.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:39:31.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:39:31.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:39:31.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:39:31.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:39:31.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:39:31.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-mapper 2026-02-23T07:39:31.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:39:31.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:39:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.31403 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-mapper 0 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-mapper 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-mapper KILL 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:39:31.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:39:31.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:39:31.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:39:31.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:39:31.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:39:31.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:39:31.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:39:31.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:39:31.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:39:31.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:39:31.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:39:31.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:39:31.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:39:31.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-23T07:39:31.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-mapper 2026-02-23T07:39:31.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:39:31.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.31403 2026-02-23T07:39:31.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.31403 2026-02-23T07:39:31.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:39:31.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:39:31.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-23T07:39:31.582 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T07:39:31.582 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T07:39:31.650 INFO:tasks.workunit:Running workunit scrub/osd-recovery-scrub.sh... 2026-02-23T07:39:31.650 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-recovery-scrub.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh 2026-02-23T07:39:31.713 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T07:39:31.717 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-recovery-scrub 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:20: run: local dir=td/osd-recovery-scrub 2026-02-23T07:39:31.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:21: run: shift 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:23: run: export CEPH_MON=127.0.0.1:7124 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:23: run: CEPH_MON=127.0.0.1:7124 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:24: run: export CEPH_ARGS 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:25: run: uuidgen 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:25: run: CEPH_ARGS+='--fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none ' 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:26: run: CEPH_ARGS+='--mon-host=127.0.0.1:7124 ' 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:27: run: CEPH_ARGS+='--osd-op-queue=wpq ' 2026-02-23T07:39:31.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:29: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: set 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:30: run: local funcs=TEST_recovery_scrub_1 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:31: run: for func in $funcs 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:32: run: TEST_recovery_scrub_1 td/osd-recovery-scrub 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:39: TEST_recovery_scrub_1: local dir=td/osd-recovery-scrub 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:40: TEST_recovery_scrub_1: local poolname=test 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:42: TEST_recovery_scrub_1: TESTDATA=testdata.47907 2026-02-23T07:39:31.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:43: TEST_recovery_scrub_1: OSDS=4 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:44: TEST_recovery_scrub_1: PGS=1 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:45: TEST_recovery_scrub_1: OBJECTS=100 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:46: TEST_recovery_scrub_1: ERRORS=0 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:48: TEST_recovery_scrub_1: setup td/osd-recovery-scrub 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-recovery-scrub 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-recovery-scrub 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-recovery-scrub 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-recovery-scrub KILL 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:39:31.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:39:31.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:39:31.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:39:31.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:39:31.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:39:31.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:39:31.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:39:31.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:39:31.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:39:31.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-recovery-scrub 2026-02-23T07:39:31.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:39:31.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:31.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47907 2026-02-23T07:39:31.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:39:31.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:39:31.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-recovery-scrub 2026-02-23T07:39:31.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:39:31.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:31.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.47907 2026-02-23T07:39:31.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:39:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T07:39:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T07:39:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:39:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-recovery-scrub 1' TERM HUP INT 2026-02-23T07:39:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:49: TEST_recovery_scrub_1: run_mon td/osd-recovery-scrub a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T07:39:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-recovery-scrub 2026-02-23T07:39:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:39:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:39:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:39:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-recovery-scrub/a 2026-02-23T07:39:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-recovery-scrub/a --run-dir=td/osd-recovery-scrub --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:31.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-recovery-scrub/a '--log-file=td/osd-recovery-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --mon-cluster-log-file=td/osd-recovery-scrub/log --run-dir=td/osd-recovery-scrub '--pid-file=td/osd-recovery-scrub/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T07:39:31.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:39:31.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:39:31.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:39:31.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:31.772 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47907/ceph-mon.a.asok 2026-02-23T07:39:31.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:39:31.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47907/ceph-mon.a.asok config get fsid 2026-02-23T07:39:31.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:39:31.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:39:31.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:39:31.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:39:31.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:39:31.832 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.47907/ceph-mon.a.asok 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:39:31.833 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.47907/ceph-mon.a.asok config get mon_host 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:50: TEST_recovery_scrub_1: run_mgr td/osd-recovery-scrub x 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-recovery-scrub 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-recovery-scrub/x 2026-02-23T07:39:31.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:39:31.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:39:31.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:31.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:31.985 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:31.985 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:31.985 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:31.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:31.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:39:31.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-recovery-scrub/x '--log-file=td/osd-recovery-scrub/$name.log' '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --run-dir=td/osd-recovery-scrub '--pid-file=td/osd-recovery-scrub/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:39:31.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:51: TEST_recovery_scrub_1: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 ' 2026-02-23T07:39:31.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:52: TEST_recovery_scrub_1: ceph_osd_args+='--osd_scrub_backoff_ratio=0 ' 2026-02-23T07:39:31.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:53: TEST_recovery_scrub_1: ceph_osd_args+='--osd_stats_update_period_not_scrubbing=3 ' 2026-02-23T07:39:31.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:54: TEST_recovery_scrub_1: ceph_osd_args+=--osd_stats_update_period_scrubbing=2 2026-02-23T07:39:31.999 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: expr 4 - 1 2026-02-23T07:39:32.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: seq 0 3 2026-02-23T07:39:32.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:39:32.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 0 --osd_scrub_during_recovery=false 2026-02-23T07:39:32.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-23T07:39:32.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:39:32.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:39:32.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:39:32.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/0 2026-02-23T07:39:32.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-23T07:39:32.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:32.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:32.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:32.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/0' 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/0/journal' 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:32.009 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:39:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-23T07:39:32.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/0 2026-02-23T07:39:32.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:39:32.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eecee9c0-88d3-4650-96df-e990ac907211 2026-02-23T07:39:32.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 eecee9c0-88d3-4650-96df-e990ac907211' 2026-02-23T07:39:32.013 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 eecee9c0-88d3-4650-96df-e990ac907211 2026-02-23T07:39:32.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:39:32.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA0BJxpu5+bABAAINeDWZSKjo2WW5gn9sz5bg== 2026-02-23T07:39:32.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA0BJxpu5+bABAAINeDWZSKjo2WW5gn9sz5bg=="}' 2026-02-23T07:39:32.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eecee9c0-88d3-4650-96df-e990ac907211 -i td/osd-recovery-scrub/0/new.json 2026-02-23T07:39:32.100 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:32.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/0/new.json 2026-02-23T07:39:32.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/0 --osd-journal=td/osd-recovery-scrub/0/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQA0BJxpu5+bABAAINeDWZSKjo2WW5gn9sz5bg== --osd-uuid eecee9c0-88d3-4650-96df-e990ac907211 2026-02-23T07:39:32.124 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.122+0000 7f68fc555780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:32.125 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.123+0000 7f68fc555780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:32.126 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.124+0000 7f68fc555780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:32.126 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.124+0000 7f68fc555780 -1 bdev(0x5563f7f7d400 td/osd-recovery-scrub/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:39:32.127 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.125+0000 7f68fc555780 -1 bluestore(td/osd-recovery-scrub/0) _read_fsid unparsable uuid 2026-02-23T07:39:32.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/0/keyring 2026-02-23T07:39:32.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:39:32.547 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:39:32.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:39:32.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:39:32.640 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:39:32.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:39:32.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/0 --osd-journal=td/osd-recovery-scrub/0/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-23T07:39:32.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:39:32.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:39:32.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:39:32.653 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.651+0000 7f3978e08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:32.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.652+0000 7f3978e08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:32.655 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.653+0000 7f3978e08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:32.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:39:32.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:32.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:39:32.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:32.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:32.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:32.736 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:32.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:32.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:32.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:39:32.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:32.829 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:32.828+0000 7f3978e08780 -1 Falling back to public interface 2026-02-23T07:39:33.169 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:33.167+0000 7f3978e08780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:39:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:33.830 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:33.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:33.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:33.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:39:33.920 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2746927088,v1:127.0.0.1:6801/2746927088] [v2:127.0.0.1:6802/2746927088,v1:127.0.0.1:6803/2746927088] exists,up eecee9c0-88d3-4650-96df-e990ac907211 2026-02-23T07:39:33.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:33.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:33.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:33.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 1 --osd_scrub_during_recovery=false 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/1 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/1' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/1/journal' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:39:33.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-23T07:39:33.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/1 2026-02-23T07:39:33.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:39:33.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9bedb1c4-072c-4abf-a671-41315ecb86a5 2026-02-23T07:39:33.928 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 9bedb1c4-072c-4abf-a671-41315ecb86a5 2026-02-23T07:39:33.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9bedb1c4-072c-4abf-a671-41315ecb86a5' 2026-02-23T07:39:33.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:39:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA1BJxpgfKBNxAAKXPqtZt2Tzzyo/1aBgjymw== 2026-02-23T07:39:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA1BJxpgfKBNxAAKXPqtZt2Tzzyo/1aBgjymw=="}' 2026-02-23T07:39:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9bedb1c4-072c-4abf-a671-41315ecb86a5 -i td/osd-recovery-scrub/1/new.json 2026-02-23T07:39:34.020 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:34.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/1/new.json 2026-02-23T07:39:34.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/1 --osd-journal=td/osd-recovery-scrub/1/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQA1BJxpgfKBNxAAKXPqtZt2Tzzyo/1aBgjymw== --osd-uuid 9bedb1c4-072c-4abf-a671-41315ecb86a5 2026-02-23T07:39:34.042 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.041+0000 7f2dd3413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:34.044 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.042+0000 7f2dd3413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:34.044 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.043+0000 7f2dd3413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:34.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.043+0000 7f2dd3413780 -1 bdev(0x5611cf31d400 td/osd-recovery-scrub/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:39:34.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.043+0000 7f2dd3413780 -1 bluestore(td/osd-recovery-scrub/1) _read_fsid unparsable uuid 2026-02-23T07:39:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/1/keyring 2026-02-23T07:39:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:39:34.459 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:39:34.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:39:34.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:39:34.661 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:39:34.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:39:34.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/1 --osd-journal=td/osd-recovery-scrub/1/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-23T07:39:34.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:39:34.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:39:34.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:39:34.673 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.671+0000 7fc8bf98a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:34.674 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.672+0000 7fc8bf98a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:34.675 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.673+0000 7fc8bf98a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:34.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:39:34.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:34.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:39:34.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:34.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:34.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:34.824 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:34.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:34.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:34.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:39:34.901 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:34.900+0000 7fc8bf98a780 -1 Falling back to public interface 2026-02-23T07:39:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:35.227 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:35.225+0000 7fc8bf98a780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:39:35.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:35.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:35.985 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:35.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:35.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:35.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:39:36.148 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2167415550,v1:127.0.0.1:6811/2167415550] [v2:127.0.0.1:6812/2167415550,v1:127.0.0.1:6813/2167415550] exists,up 9bedb1c4-072c-4abf-a671-41315ecb86a5 2026-02-23T07:39:36.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:36.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 2 --osd_scrub_during_recovery=false 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/2 2026-02-23T07:39:36.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/2' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/2/journal' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:39:36.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-23T07:39:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/2 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:39:36.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8b9cde22-e32a-4958-8c0e-4bb89271463c 2026-02-23T07:39:36.157 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 8b9cde22-e32a-4958-8c0e-4bb89271463c 2026-02-23T07:39:36.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 8b9cde22-e32a-4958-8c0e-4bb89271463c' 2026-02-23T07:39:36.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:39:36.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA4BJxpkL+QCRAAhZvuVQZzF8j1AsKjzXA31w== 2026-02-23T07:39:36.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA4BJxpkL+QCRAAhZvuVQZzF8j1AsKjzXA31w=="}' 2026-02-23T07:39:36.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8b9cde22-e32a-4958-8c0e-4bb89271463c -i td/osd-recovery-scrub/2/new.json 2026-02-23T07:39:36.319 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:39:36.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/2/new.json 2026-02-23T07:39:36.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/2 --osd-journal=td/osd-recovery-scrub/2/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQA4BJxpkL+QCRAAhZvuVQZzF8j1AsKjzXA31w== --osd-uuid 8b9cde22-e32a-4958-8c0e-4bb89271463c 2026-02-23T07:39:36.343 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.341+0000 7fb0ea4a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:36.344 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.343+0000 7fb0ea4a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:36.345 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.343+0000 7fb0ea4a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:36.345 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.344+0000 7fb0ea4a6780 -1 bdev(0x563f4d049400 td/osd-recovery-scrub/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:39:36.346 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.344+0000 7fb0ea4a6780 -1 bluestore(td/osd-recovery-scrub/2) _read_fsid unparsable uuid 2026-02-23T07:39:36.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/2/keyring 2026-02-23T07:39:36.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:39:36.744 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:39:36.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:39:36.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:39:36.947 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:39:36.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:39:36.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/2 --osd-journal=td/osd-recovery-scrub/2/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-23T07:39:36.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:39:36.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:39:36.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:39:36.960 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.958+0000 7fc3e6e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:36.961 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.960+0000 7fc3e6e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:36.962 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:36.961+0000 7fc3e6e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:37.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:39:37.182 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:37.180+0000 7fc3e6e0f780 -1 Falling back to public interface 2026-02-23T07:39:37.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:37.534 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:37.532+0000 7fc3e6e0f780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:39:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:38.275 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:38.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:38.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:39:38.440 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1282225386,v1:127.0.0.1:6819/1282225386] [v2:127.0.0.1:6820/1282225386,v1:127.0.0.1:6821/1282225386] exists,up 8b9cde22-e32a-4958-8c0e-4bb89271463c 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:55: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:57: TEST_recovery_scrub_1: run_osd td/osd-recovery-scrub 3 --osd_scrub_during_recovery=false 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-recovery-scrub 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-recovery-scrub/3 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq ' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-recovery-scrub/3' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-recovery-scrub/3/journal' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-recovery-scrub' 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:39:38.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-recovery-scrub/$name.log' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-recovery-scrub/$name.pid' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_during_recovery=false 2026-02-23T07:39:38.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-recovery-scrub/3 2026-02-23T07:39:38.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:39:38.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=de61007b-2bbf-406e-bf6b-0be6a248f2fc 2026-02-23T07:39:38.444 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 de61007b-2bbf-406e-bf6b-0be6a248f2fc 2026-02-23T07:39:38.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 de61007b-2bbf-406e-bf6b-0be6a248f2fc' 2026-02-23T07:39:38.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:39:38.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA6BJxpz0PyGhAAaZB2JeBs3rfFxSvfE5HxVQ== 2026-02-23T07:39:38.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA6BJxpz0PyGhAAaZB2JeBs3rfFxSvfE5HxVQ=="}' 2026-02-23T07:39:38.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new de61007b-2bbf-406e-bf6b-0be6a248f2fc -i td/osd-recovery-scrub/3/new.json 2026-02-23T07:39:38.610 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T07:39:38.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-recovery-scrub/3/new.json 2026-02-23T07:39:38.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/3 --osd-journal=td/osd-recovery-scrub/3/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --mkfs --key AQA6BJxpz0PyGhAAaZB2JeBs3rfFxSvfE5HxVQ== --osd-uuid de61007b-2bbf-406e-bf6b-0be6a248f2fc 2026-02-23T07:39:38.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:38.633+0000 7fb14614e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:38.636 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:38.634+0000 7fb14614e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:38.637 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:38.635+0000 7fb14614e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:38.637 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:38.636+0000 7fb14614e780 -1 bdev(0x562dd7c53400 td/osd-recovery-scrub/3/block) open stat got: (1) Operation not permitted 2026-02-23T07:39:38.637 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:38.636+0000 7fb14614e780 -1 bluestore(td/osd-recovery-scrub/3) _read_fsid unparsable uuid 2026-02-23T07:39:39.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-recovery-scrub/3/keyring 2026-02-23T07:39:39.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:39:39.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T07:39:39.052 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T07:39:39.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-recovery-scrub/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:39:39.255 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T07:39:39.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T07:39:39.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=9b7f8e95-4c06-42e3-9688-1a9229723170 --auth-supported=none --mon-host=127.0.0.1:7124 --osd-op-queue=wpq --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-recovery-scrub/3 --osd-journal=td/osd-recovery-scrub/3/journal --chdir= --run-dir=td/osd-recovery-scrub '--admin-socket=/tmp/ceph-asok.47907/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-recovery-scrub/$name.log' '--pid-file=td/osd-recovery-scrub/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false 2026-02-23T07:39:39.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:39:39.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:39:39.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:39:39.267 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:39.266+0000 7f1d22f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:39.268 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:39.267+0000 7f1d22f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:39.269 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:39.268+0000 7f1d22f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:39:39.419 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:39:39.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:39.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:39:39.472 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:39.471+0000 7f1d22f4f780 -1 Falling back to public interface 2026-02-23T07:39:39.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:39:39.831 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:39:39.829+0000 7f1d22f4f780 -1 osd.3 0 log_to_monitors true 2026-02-23T07:39:40.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:39:40.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:39:40.584 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:39:40.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:39:40.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:39:40.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:39:40.746 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3207265441,v1:127.0.0.1:6827/3207265441] [v2:127.0.0.1:6828/3207265441,v1:127.0.0.1:6829/3207265441] exists,up de61007b-2bbf-406e-bf6b-0be6a248f2fc 2026-02-23T07:39:40.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:39:40.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:39:40.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:39:40.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:61: TEST_recovery_scrub_1: create_pool test 1 1 2026-02-23T07:39:40.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T07:39:40.954 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T07:39:40.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:39:41.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:62: TEST_recovery_scrub_1: wait_for_clean 2026-02-23T07:39:41.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:39:41.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:39:41.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:39:41.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:39:41.967 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:39:41.967 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:39:41.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:39:41.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:39:41.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:39:42.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:39:42.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:39:42.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:39:42.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:39:42.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:39:42.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:39:42.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:39:42.206 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:39:42.206 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:39:42.206 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T07:39:42.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:39:42.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:39:42.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:39:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:39:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:39:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:39:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:39:42.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:39:42.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T07:39:42.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T07:39:42.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705668' 2026-02-23T07:39:42.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:39:42.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:39:42.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T07:39:42.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T07:39:42.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705668 2-60129542146' 2026-02-23T07:39:42.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:39:42.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T07:39:42.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411330 2026-02-23T07:39:42.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411330 2026-02-23T07:39:42.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705668 2-60129542146 3-77309411330' 2026-02-23T07:39:42.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:39:42.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:39:42.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:39:42.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:39:42.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:39:42.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:39:42.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:39:42.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:39:42.501 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:39:42.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:39:42.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:39:42.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:39:43.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:39:43.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:39:43.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:39:43.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:39:44.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:39:44.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:39:44.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:39:44.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:39:44.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T07:39:44.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:39:44.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:39:45.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T07:39:45.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:39:45.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T07:39:45.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T07:39:45.001 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T07:39:45.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:39:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-23T07:39:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:39:45.168 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T07:39:45.168 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:39:45.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:39:45.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T07:39:45.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:39:45.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T07:39:45.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T07:39:45.171 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T07:39:45.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:39:45.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-23T07:39:45.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:39:45.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411330 2026-02-23T07:39:45.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:39:45.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T07:39:45.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411330 2026-02-23T07:39:45.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:39:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411330 2026-02-23T07:39:45.340 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411330 2026-02-23T07:39:45.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411330' 2026-02-23T07:39:45.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T07:39:45.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411330 -lt 77309411330 2026-02-23T07:39:45.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:39:45.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:39:45.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:39:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:39:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:39:45.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:39:45.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:39:45.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:39:45.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:39:46.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:39:46.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:39:46.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:39:46.083 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: ceph osd dump 2026-02-23T07:39:46.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: grep '^pool.*['\'']test['\'']' 2026-02-23T07:39:46.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: awk '{ print $2 }' 2026-02-23T07:39:46.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:63: TEST_recovery_scrub_1: poolid=1 2026-02-23T07:39:46.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:65: TEST_recovery_scrub_1: ceph pg dump pgs 2026-02-23T07:39:46.420 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:46.420 INFO:tasks.workunit.client.0.trial129.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-23T07:39:41.258629+0000 0'0 21:12 [1] 1 [1] 1 0'0 2026-02-23T07:39:40.952809+0000 0'0 2026-02-23T07:39:40.952809+0000 0 0 periodic scrub scheduled @ 2026-02-24T17:11:33.707226+0000 0 0 2026-02-23T07:39:46.420 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:46.420 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:46.420 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:46.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:67: TEST_recovery_scrub_1: dd if=/dev/urandom of=testdata.47907 bs=1M count=50 2026-02-23T07:39:46.534 INFO:tasks.workunit.client.0.trial129.stderr:50+0 records in 2026-02-23T07:39:46.534 INFO:tasks.workunit.client.0.trial129.stderr:50+0 records out 2026-02-23T07:39:46.534 INFO:tasks.workunit.client.0.trial129.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.101397 s, 517 MB/s 2026-02-23T07:39:46.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: seq 1 100 2026-02-23T07:39:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj1 testdata.47907 2026-02-23T07:39:46.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj2 testdata.47907 2026-02-23T07:39:46.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj3 testdata.47907 2026-02-23T07:39:46.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj4 testdata.47907 2026-02-23T07:39:46.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj5 testdata.47907 2026-02-23T07:39:46.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj6 testdata.47907 2026-02-23T07:39:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj7 testdata.47907 2026-02-23T07:39:46.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:46.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj8 testdata.47907 2026-02-23T07:39:47.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj9 testdata.47907 2026-02-23T07:39:47.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj10 testdata.47907 2026-02-23T07:39:47.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj11 testdata.47907 2026-02-23T07:39:47.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj12 testdata.47907 2026-02-23T07:39:47.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj13 testdata.47907 2026-02-23T07:39:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj14 testdata.47907 2026-02-23T07:39:47.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj15 testdata.47907 2026-02-23T07:39:47.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj16 testdata.47907 2026-02-23T07:39:47.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj17 testdata.47907 2026-02-23T07:39:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj18 testdata.47907 2026-02-23T07:39:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj19 testdata.47907 2026-02-23T07:39:47.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj20 testdata.47907 2026-02-23T07:39:47.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj21 testdata.47907 2026-02-23T07:39:47.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj22 testdata.47907 2026-02-23T07:39:47.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj23 testdata.47907 2026-02-23T07:39:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj24 testdata.47907 2026-02-23T07:39:47.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:47.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj25 testdata.47907 2026-02-23T07:39:48.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj26 testdata.47907 2026-02-23T07:39:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj27 testdata.47907 2026-02-23T07:39:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj28 testdata.47907 2026-02-23T07:39:48.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj29 testdata.47907 2026-02-23T07:39:48.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj30 testdata.47907 2026-02-23T07:39:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj31 testdata.47907 2026-02-23T07:39:48.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj32 testdata.47907 2026-02-23T07:39:48.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj33 testdata.47907 2026-02-23T07:39:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj34 testdata.47907 2026-02-23T07:39:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj35 testdata.47907 2026-02-23T07:39:48.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj36 testdata.47907 2026-02-23T07:39:48.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj37 testdata.47907 2026-02-23T07:39:48.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj38 testdata.47907 2026-02-23T07:39:48.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj39 testdata.47907 2026-02-23T07:39:48.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj40 testdata.47907 2026-02-23T07:39:48.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj41 testdata.47907 2026-02-23T07:39:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj42 testdata.47907 2026-02-23T07:39:48.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:48.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj43 testdata.47907 2026-02-23T07:39:49.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj44 testdata.47907 2026-02-23T07:39:49.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj45 testdata.47907 2026-02-23T07:39:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj46 testdata.47907 2026-02-23T07:39:49.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj47 testdata.47907 2026-02-23T07:39:49.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj48 testdata.47907 2026-02-23T07:39:49.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj49 testdata.47907 2026-02-23T07:39:49.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj50 testdata.47907 2026-02-23T07:39:49.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj51 testdata.47907 2026-02-23T07:39:49.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj52 testdata.47907 2026-02-23T07:39:49.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj53 testdata.47907 2026-02-23T07:39:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj54 testdata.47907 2026-02-23T07:39:49.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj55 testdata.47907 2026-02-23T07:39:49.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj56 testdata.47907 2026-02-23T07:39:49.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj57 testdata.47907 2026-02-23T07:39:49.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj58 testdata.47907 2026-02-23T07:39:49.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj59 testdata.47907 2026-02-23T07:39:49.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:49.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj60 testdata.47907 2026-02-23T07:39:50.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj61 testdata.47907 2026-02-23T07:39:50.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj62 testdata.47907 2026-02-23T07:39:50.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj63 testdata.47907 2026-02-23T07:39:50.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj64 testdata.47907 2026-02-23T07:39:50.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj65 testdata.47907 2026-02-23T07:39:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj66 testdata.47907 2026-02-23T07:39:50.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj67 testdata.47907 2026-02-23T07:39:50.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj68 testdata.47907 2026-02-23T07:39:50.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj69 testdata.47907 2026-02-23T07:39:50.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj70 testdata.47907 2026-02-23T07:39:50.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj71 testdata.47907 2026-02-23T07:39:50.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj72 testdata.47907 2026-02-23T07:39:50.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj73 testdata.47907 2026-02-23T07:39:50.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj74 testdata.47907 2026-02-23T07:39:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj75 testdata.47907 2026-02-23T07:39:50.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:50.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj76 testdata.47907 2026-02-23T07:39:51.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj77 testdata.47907 2026-02-23T07:39:51.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj78 testdata.47907 2026-02-23T07:39:51.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj79 testdata.47907 2026-02-23T07:39:51.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj80 testdata.47907 2026-02-23T07:39:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj81 testdata.47907 2026-02-23T07:39:51.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj82 testdata.47907 2026-02-23T07:39:51.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj83 testdata.47907 2026-02-23T07:39:51.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj84 testdata.47907 2026-02-23T07:39:51.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj85 testdata.47907 2026-02-23T07:39:51.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj86 testdata.47907 2026-02-23T07:39:51.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj87 testdata.47907 2026-02-23T07:39:51.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj88 testdata.47907 2026-02-23T07:39:51.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj89 testdata.47907 2026-02-23T07:39:51.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj90 testdata.47907 2026-02-23T07:39:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj91 testdata.47907 2026-02-23T07:39:52.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj92 testdata.47907 2026-02-23T07:39:52.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj93 testdata.47907 2026-02-23T07:39:52.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj94 testdata.47907 2026-02-23T07:39:52.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj95 testdata.47907 2026-02-23T07:39:52.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj96 testdata.47907 2026-02-23T07:39:52.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj97 testdata.47907 2026-02-23T07:39:52.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj98 testdata.47907 2026-02-23T07:39:52.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj99 testdata.47907 2026-02-23T07:39:52.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:68: TEST_recovery_scrub_1: for i in $(seq 1 $OBJECTS) 2026-02-23T07:39:52.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:70: TEST_recovery_scrub_1: rados -p test put obj100 testdata.47907 2026-02-23T07:39:52.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:72: TEST_recovery_scrub_1: rm -f testdata.47907 2026-02-23T07:39:52.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:74: TEST_recovery_scrub_1: ceph osd pool set test size 4 2026-02-23T07:39:52.789 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 4 2026-02-23T07:39:52.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:77: TEST_recovery_scrub_1: set -o pipefail 2026-02-23T07:39:52.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:78: TEST_recovery_scrub_1: count=0 2026-02-23T07:39:52.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-23T07:39:52.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-23T07:39:52.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-23T07:39:52.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-23T07:39:52.953 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:52.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:86: TEST_recovery_scrub_1: sleep 2 2026-02-23T07:39:54.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub_1: test 0 -eq 10 2026-02-23T07:39:54.965 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: expr 0 + 1 2026-02-23T07:39:54.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: count=1 2026-02-23T07:39:54.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-23T07:39:54.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-23T07:39:54.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-23T07:39:54.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-23T07:39:55.124 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:55.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:86: TEST_recovery_scrub_1: sleep 2 2026-02-23T07:39:57.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub_1: test 1 -eq 10 2026-02-23T07:39:57.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: expr 1 + 1 2026-02-23T07:39:57.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: count=2 2026-02-23T07:39:57.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-23T07:39:57.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-23T07:39:57.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-23T07:39:57.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-23T07:39:57.298 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:57.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:86: TEST_recovery_scrub_1: sleep 2 2026-02-23T07:39:59.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:87: TEST_recovery_scrub_1: test 2 -eq 10 2026-02-23T07:39:59.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: expr 2 + 1 2026-02-23T07:39:59.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:92: TEST_recovery_scrub_1: count=3 2026-02-23T07:39:59.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:79: TEST_recovery_scrub_1: true 2026-02-23T07:39:59.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:81: TEST_recovery_scrub_1: ceph --format json pg dump pgs 2026-02-23T07:39:59.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: jq '.pg_stats | [.[] | .state | contains("recovering")]' 2026-02-23T07:39:59.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:82: TEST_recovery_scrub_1: grep -q true 2026-02-23T07:39:59.474 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:59.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:84: TEST_recovery_scrub_1: break 2026-02-23T07:39:59.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:94: TEST_recovery_scrub_1: set +o pipefail 2026-02-23T07:39:59.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:95: TEST_recovery_scrub_1: ceph pg dump pgs 2026-02-23T07:39:59.647 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:39:59.647 INFO:tasks.workunit.client.0.trial129.stdout:1.0 100 0 267 0 0 5242880000 0 0 1300 0 1300 active+recovering+undersized+degraded+remapped 2026-02-23T07:39:53.959805+0000 21'1300 24:1367 [1,0,2,3] 1 [1,0] 1 0'0 2026-02-23T07:39:40.952809+0000 0'0 2026-02-23T07:39:40.952809+0000 0 0 no scrub is scheduled 0 0 2026-02-23T07:39:59.647 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:39:59.647 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:39:59.647 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:39:59.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:97: TEST_recovery_scrub_1: sleep 10 2026-02-23T07:40:09.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:99: TEST_recovery_scrub_1: kill_daemons td/osd-recovery-scrub 2026-02-23T07:40:09.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:40:09.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:40:09.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:40:09.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:40:09.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:40:14.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:40:14.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:101: TEST_recovery_scrub_1: declare -a err_strings 2026-02-23T07:40:14.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:102: TEST_recovery_scrub_1: err_strings[0]='recovery in progress.*scrubs' 2026-02-23T07:40:14.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: expr 4 - 1 2026-02-23T07:40:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: seq 0 3 2026-02-23T07:40:14.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:14.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.0.log 2026-02-23T07:40:14.982 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:54.353+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.982 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:55.381+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.982 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:56.352+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.982 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:57.352+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.982 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:58.341+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.982 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:59.317+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:00.305+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:01.340+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:02.385+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:03.385+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:04.373+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:05.407+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:06.457+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:07.497+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:08.481+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:09.457+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:10.425+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:11.442+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:12.400+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.983 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:13.394+0000 7f397175a6c0 15 osd.0 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:14.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.1.log 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:54.083+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:55.128+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:56.094+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:57.080+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:58.120+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:59.142+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:00.187+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:01.213+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:02.241+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:03.237+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:04.242+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:05.235+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:06.236+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:07.190+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:08.174+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:09.155+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:10.139+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:11.127+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:12.148+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:13.122+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.993 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:14.095+0000 7fc8b855a6c0 15 osd.1 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:14.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.2.log 2026-02-23T07:40:14.996 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:54.534+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:55.568+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:56.603+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:57.589+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:58.636+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:59.617+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:00.632+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:01.621+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:02.657+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:03.647+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:04.600+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:05.585+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:06.558+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:07.559+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:08.601+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:09.557+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:10.524+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:11.561+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:12.592+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:13.570+0000 7fc3df6d96c0 15 osd.2 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:104: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:14.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:106: TEST_recovery_scrub_1: grep 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.3.log 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:54.965+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:55.922+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:56.928+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:57.928+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:58.886+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:39:59.874+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:00.878+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:01.855+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:02.897+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:03.868+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:04.911+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:05.907+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:06.879+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:07.856+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:08.818+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:09.817+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:10.865+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:11.851+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:12.844+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:40:13.851+0000 7f1d1bb5a6c0 15 osd.3 osd-scrub:restrictions_on_scrubbing: recovery in progress. Operator-initiated scrubs only. 2026-02-23T07:40:15.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:108: TEST_recovery_scrub_1: for err_string in "${err_strings[@]}" 2026-02-23T07:40:15.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:110: TEST_recovery_scrub_1: found=false 2026-02-23T07:40:15.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:111: TEST_recovery_scrub_1: count=0 2026-02-23T07:40:15.001 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: expr 4 - 1 2026-02-23T07:40:15.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: seq 0 3 2026-02-23T07:40:15.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:15.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.0.log 2026-02-23T07:40:15.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-23T07:40:15.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 0 + 1 2026-02-23T07:40:15.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=1 2026-02-23T07:40:15.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:15.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.1.log 2026-02-23T07:40:15.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-23T07:40:15.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 1 + 1 2026-02-23T07:40:15.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=2 2026-02-23T07:40:15.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:15.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.2.log 2026-02-23T07:40:15.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-23T07:40:15.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 2 + 1 2026-02-23T07:40:15.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=3 2026-02-23T07:40:15.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:112: TEST_recovery_scrub_1: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T07:40:15.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:114: TEST_recovery_scrub_1: grep -q 'recovery in progress.*scrubs' td/osd-recovery-scrub/osd.3.log 2026-02-23T07:40:15.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:116: TEST_recovery_scrub_1: found=true 2026-02-23T07:40:15.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: expr 3 + 1 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:117: TEST_recovery_scrub_1: count=4 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:120: TEST_recovery_scrub_1: '[' true = false ']' 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:124: TEST_recovery_scrub_1: '[' 4 -eq 4 ']' 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:127: TEST_recovery_scrub_1: teardown td/osd-recovery-scrub 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-recovery-scrub 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-recovery-scrub KILL 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:40:15.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:40:15.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:40:15.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:40:15.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:40:15.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:40:15.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:40:15.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:40:15.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:40:15.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:40:15.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:40:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:40:15.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:40:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:40:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:40:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-recovery-scrub 2026-02-23T07:40:15.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:40:15.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:40:15.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:40:15.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47907 2026-02-23T07:40:15.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:40:15.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:40:15.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:129: TEST_recovery_scrub_1: '[' 0 '!=' 0 ']' 2026-02-23T07:40:15.069 INFO:tasks.workunit.client.0.trial129.stdout:TEST PASSED 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:135: TEST_recovery_scrub_1: echo 'TEST PASSED' 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh:136: TEST_recovery_scrub_1: return 0 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-recovery-scrub 0 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-recovery-scrub 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-recovery-scrub KILL 2026-02-23T07:40:15.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:40:15.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:40:15.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:40:15.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:40:15.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:40:15.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:40:15.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:40:15.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:40:15.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:40:15.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:40:15.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:40:15.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:40:15.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:40:15.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:40:15.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:40:15.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:40:15.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:40:15.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-23T07:40:15.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-recovery-scrub 2026-02-23T07:40:15.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:40:15.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:40:15.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.47907 2026-02-23T07:40:15.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.47907 2026-02-23T07:40:15.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:40:15.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:40:15.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-23T07:40:15.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T07:40:15.080 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T07:40:15.148 INFO:tasks.workunit:Running workunit scrub/osd-scrub-dump.sh... 2026-02-23T07:40:15.148 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-scrub-dump.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh 2026-02-23T07:40:15.212 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T07:40:15.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-dump 2026-02-23T07:40:15.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:23: run: local dir=td/osd-scrub-dump 2026-02-23T07:40:15.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:24: run: shift 2026-02-23T07:40:15.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:26: run: export CEPH_MON=127.0.0.1:7138 2026-02-23T07:40:15.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:26: run: CEPH_MON=127.0.0.1:7138 2026-02-23T07:40:15.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:27: run: export CEPH_ARGS 2026-02-23T07:40:15.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:28: run: uuidgen 2026-02-23T07:40:15.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:28: run: CEPH_ARGS+='--fsid=c9a75e74-65fb-48e6-b9c1-e151f5fdc458 --auth-supported=none ' 2026-02-23T07:40:15.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:29: run: CEPH_ARGS+='--mon-host=127.0.0.1:7138 --osd_op_queue=wpq ' 2026-02-23T07:40:15.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:31: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T07:40:15.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: set 2026-02-23T07:40:15.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:32: run: local 'funcs=TEST_rmobj_1 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_large_objects 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_large_objects_2 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_large_objects_2b 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_large_objects_3 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_measurements_basic_1 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_measurements_basic_2 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_measurements_basic_2b 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_measurements_basic_2c 2026-02-23T07:40:15.221 INFO:tasks.workunit.client.0.trial129.stderr:TEST_time_measurements_basic_3' 2026-02-23T07:40:15.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:33: run: for func in $funcs 2026-02-23T07:40:15.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:34: run: echo '-------------- Prepare Test TEST_rmobj_1 -------------------' 2026-02-23T07:40:15.222 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_rmobj_1 ------------------- 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:35: run: setup td/osd-scrub-dump 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-dump 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-dump 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-dump 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-dump KILL 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:40:15.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:40:15.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:40:15.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:40:15.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:40:15.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:40:15.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:40:15.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:40:15.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:40:15.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-dump 2026-02-23T07:40:15.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:40:15.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:40:15.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56839 2026-02-23T07:40:15.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.56839 2026-02-23T07:40:15.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:40:15.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:40:15.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-dump 2026-02-23T07:40:15.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:40:15.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:40:15.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.56839 2026-02-23T07:40:15.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.56839 2026-02-23T07:40:15.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:40:15.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T07:40:15.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T07:40:15.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:40:15.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-dump 1' TERM HUP INT 2026-02-23T07:40:15.234 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_rmobj_1 ----------------------- 2026-02-23T07:40:15.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:36: run: echo '-------------- Run Test TEST_rmobj_1 -----------------------' 2026-02-23T07:40:15.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:37: run: TEST_rmobj_1 td/osd-scrub-dump 2026-02-23T07:40:15.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:667: TEST_rmobj_1: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='4' ['pool_name']='test' ['pool_default_size']='3' ['msg']='rm1' ['objects_per_pg']='16' ['modify_as_prim_cnt']='2' ['modify_as_repl_cnt']='2' ['manipulations']='rm_object') 2026-02-23T07:40:15.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:667: TEST_rmobj_1: local -A cluster_conf 2026-02-23T07:40:15.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:678: TEST_rmobj_1: corrupt_and_measure td/osd-scrub-dump cluster_conf rmobj_1 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:380: corrupt_and_measure: local dir=td/osd-scrub-dump 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:381: corrupt_and_measure: local -n alargs=cluster_conf 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:382: corrupt_and_measure: local test_name=rmobj_1 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:384: corrupt_and_measure: local OSDS=3 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:385: corrupt_and_measure: local PGS=4 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:386: corrupt_and_measure: local OBJS_PER_PG=16 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:387: corrupt_and_measure: local OBJECT_SIZE=256 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:388: corrupt_and_measure: local modify_as_prim_cnt=2 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:389: corrupt_and_measure: local modify_as_repl_cnt=2 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:390: corrupt_and_measure: local stride_override=0 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:392: corrupt_and_measure: local objects=64 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:394: corrupt_and_measure: '[' 4 -gt 64 ']' 2026-02-23T07:40:15.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:399: corrupt_and_measure: local extr_dbg=2 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:401: corrupt_and_measure: standard_scrub_wpq_cluster td/osd-scrub-dump alargs 0 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:302: standard_scrub_wpq_cluster: local dir=td/osd-scrub-dump 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:303: standard_scrub_wpq_cluster: local -n conf=alargs 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:304: standard_scrub_wpq_cluster: local osd_sleep=0 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:306: standard_scrub_wpq_cluster: conf['extras']=' --osd_op_queue=wpq --osd_scrub_sleep=0 ' 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:308: standard_scrub_wpq_cluster: standard_scrub_cluster td/osd-scrub-dump conf 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-dump 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=conf 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-23T07:40:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-23T07:40:15.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-23T07:40:15.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars= --osd_op_queue=wpq --osd_scrub_sleep=0 ' 2026-02-23T07:40:15.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=rm1 2026-02-23T07:40:15.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T07:40:15.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T07:40:15.507 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 20c2cc22-5b17-4a9a-a71c-a5ffccc84ce6 2026-02-23T07:40:15.605 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:40:15.633 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:15.632+0000 7fbe5760f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:15.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:15.633+0000 7fbe5760f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:15.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:15.634+0000 7fbe5760f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:15.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:15.634+0000 7fbe5760f780 -1 bdev(0x557141c97400 td/osd-scrub-dump/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:40:15.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:15.634+0000 7fbe5760f780 -1 bluestore(td/osd-scrub-dump/0) _read_fsid unparsable uuid 2026-02-23T07:40:16.045 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:40:16.140 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:40:16.156 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:16.155+0000 7f8489ea6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:16.157 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:16.157+0000 7f8489ea6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:16.158 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:16.158+0000 7f8489ea6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:16.233 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:40:16.392 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:16.392+0000 7f8489ea6780 -1 Falling back to public interface 2026-02-23T07:40:16.753 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:16.753+0000 7f8489ea6780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:40:17.326 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:40:17.415 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4168923800,v1:127.0.0.1:6801/4168923800] [v2:127.0.0.1:6802/4168923800,v1:127.0.0.1:6803/4168923800] exists,up 20c2cc22-5b17-4a9a-a71c-a5ffccc84ce6 2026-02-23T07:40:17.419 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 f14329e4-788f-48c5-9353-1b7da2ed382c 2026-02-23T07:40:17.515 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:40:17.541 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:17.540+0000 7f23bb786780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:17.542 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:17.542+0000 7f23bb786780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:17.543 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:17.543+0000 7f23bb786780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:17.543 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:17.543+0000 7f23bb786780 -1 bdev(0x55f472a33400 td/osd-scrub-dump/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:40:17.543 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:17.543+0000 7f23bb786780 -1 bluestore(td/osd-scrub-dump/1) _read_fsid unparsable uuid 2026-02-23T07:40:17.937 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:40:18.139 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:40:18.155 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:18.154+0000 7fad8a354780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:18.156 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:18.156+0000 7fad8a354780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:18.157 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:18.156+0000 7fad8a354780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:18.306 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:40:18.336 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:18.336+0000 7fad8a354780 -1 Falling back to public interface 2026-02-23T07:40:18.715 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:18.714+0000 7fad8a354780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:40:19.471 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:40:19.637 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3828233309,v1:127.0.0.1:6811/3828233309] [v2:127.0.0.1:6812/3828233309,v1:127.0.0.1:6813/3828233309] exists,up f14329e4-788f-48c5-9353-1b7da2ed382c 2026-02-23T07:40:19.641 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 2745649c-62fa-40bf-9b12-b37d7f32b134 2026-02-23T07:40:19.808 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:40:19.836 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:19.835+0000 7fa8c8f4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:19.837 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:19.837+0000 7fa8c8f4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:19.838 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:19.837+0000 7fa8c8f4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:19.838 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:19.838+0000 7fa8c8f4a780 -1 bdev(0x5572eb52f400 td/osd-scrub-dump/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:40:19.838 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:19.838+0000 7fa8c8f4a780 -1 bluestore(td/osd-scrub-dump/2) _read_fsid unparsable uuid 2026-02-23T07:40:20.258 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:40:20.461 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:40:20.476 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:20.476+0000 7fb646408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:20.477 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:20.477+0000 7fb646408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:20.478 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:20.478+0000 7fb646408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:40:20.628 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:40:20.688 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:20.688+0000 7fb646408780 -1 Falling back to public interface 2026-02-23T07:40:21.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:40:21.015+0000 7fb646408780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:40:21.792 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:40:21.955 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2985250592,v1:127.0.0.1:6819/2985250592] [v2:127.0.0.1:6820/2985250592,v1:127.0.0.1:6821/2985250592] exists,up 2745649c-62fa-40bf-9b12-b37d7f32b134 2026-02-23T07:40:22.196 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T07:40:23.678 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T07:40:26.179 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705669 2026-02-23T07:40:26.347 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574851 2026-02-23T07:40:28.244 INFO:tasks.workunit.client.0.trial129.stdout:standard_scrub_cluster: rm1: test pool is test 1 2026-02-23T07:40:28.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:402: corrupt_and_measure: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd_op_queue=wpq --osd_scrub_sleep=0 ' 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:403: corrupt_and_measure: echo --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd_op_queue=wpq --osd_scrub_sleep=0 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:403: corrupt_and_measure: orig_osd_args=' --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_pool_default_pg_autoscale_mode=off --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=5 --osd_scrub_retry_pg_state=5 --osd_scrub_retry_delay=3 --osd_pool_default_size=3 --osd_op_queue=wpq --osd_scrub_sleep=0' 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:405: corrupt_and_measure: local poolid=1 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:406: corrupt_and_measure: local poolname=test 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:40:28.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:40:28.447 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:40:28.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:40:28.651 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 256 4 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-23T07:40:28.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-23T07:40:28.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:40:28.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:40:28.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832428663071726 2026-02-23T07:40:28.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-23T07:40:28.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-23T07:40:28.665 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:40:28.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.FZC2G74q4B bs=256 count=1 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.8382e-05 s, 6.7 MB/s 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:40:28.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:40:28.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:40:28.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:40:28.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:40:28.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.FZC2G74q4B 2026-02-23T07:40:28.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:40:28.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832428948873066 2026-02-23T07:40:28.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=285 2026-02-23T07:40:28.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 285 ms' 2026-02-23T07:40:28.949 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 64 objects in pool test in 285 ms 2026-02-23T07:40:28.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:40:28.950 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:40:28.949991013 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:40:28.949991013' 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:40:28.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:40:28.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:40:28.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:40:28.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:40:29.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:40:29.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:40:29.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:40:29.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:40:29.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:40:29.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:40:29.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:40:29.192 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:40:29.192 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:40:29.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:40:29.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:40:29.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:40:29.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T07:40:29.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T07:40:29.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T07:40:29.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:40:29.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:40:29.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-23T07:40:29.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-23T07:40:29.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676' 2026-02-23T07:40:29.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:40:29.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:40:29.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-23T07:40:29.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-23T07:40:29.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676 2-55834574858' 2026-02-23T07:40:29.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:40:29.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T07:40:29.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:40:29.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:40:29.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T07:40:29.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:40:29.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T07:40:29.413 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836494 2026-02-23T07:40:29.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T07:40:29.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:40:29.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T07:40:29.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:40:29.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-23T07:40:29.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:40:29.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:40:29.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-23T07:40:29.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:40:29.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-23T07:40:29.580 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705676 2026-02-23T07:40:29.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-23T07:40:29.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:40:29.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-23T07:40:29.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:40:29.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-23T07:40:29.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:40:29.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:40:29.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-23T07:40:29.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:40:29.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-23T07:40:29.749 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574858 2026-02-23T07:40:29.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-23T07:40:29.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:40:29.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-23T07:40:29.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:40:29.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:40:29.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:40:30.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:40:30.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:40:30.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:40:30.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:40:30.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:40:30.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:40:30.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:40:30.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:40:30.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:40:30.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:40:30.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:40:30.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:40:30.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:40:30.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:40:30.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:40:30.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:40:30.637 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:40:30.637 INFO:tasks.workunit.client.0.trial129.stdout: nothing is going on 2026-02-23T07:40:30.637 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:40:30.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:40:30.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:40:35.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:40:35.801 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:40:35.802 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:40:22.302954+0000 19'14 19:36 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:35.802 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:40:22.302807+0000 19'14 19:34 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:35.802 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:40:22.302974+0000 19'19 19:39 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:35.802 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:40:22.302654+0000 19'17 19:41 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:35.802 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:40:35.802 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:40:35.803 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:40:35.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:35.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:40:35.813 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:40:35.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:40:35.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:40:35.886 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:40:35.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:40:35.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:40:35.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:40:35.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:40:35.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:40:35.959252315' 2026-02-23T07:40:35.959 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:40:35.959252315 2026-02-23T07:40:35.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:40:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832435960453218 2026-02-23T07:40:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:40:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:40:37.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:40:37.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832437028079128 2026-02-23T07:40:37.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:40:37.029 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:40:37.028859061 (1067 ms) 2026-02-23T07:40:37.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:40:37.028859061 (1067 ms)' 2026-02-23T07:40:37.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=4 2026-02-23T07:40:37.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:40:37.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:40:37.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 4 2026-02-23T07:40:37.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 4' 2026-02-23T07:40:37.031 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 4 2026-02-23T07:40:37.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.032 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj18 2026-02-23T07:40:37.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj18' 2026-02-23T07:40:37.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-23T07:40:37.033 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 64 2026-02-23T07:40:37.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:40:37.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:40:37.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:40:37.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 2 )) 2026-02-23T07:40:37.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj18' 2026-02-23T07:40:37.035 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj18 2026-02-23T07:40:37.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj18 2026-02-23T07:40:37.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:40:37.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj18 ' 2026-02-23T07:40:37.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:40:37.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 2 )) 2026-02-23T07:40:37.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.037 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj30 2026-02-23T07:40:37.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj30' 2026-02-23T07:40:37.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj30 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj30 ' 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 2 )) 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=2 )) 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 4 )) 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj8 2026-02-23T07:40:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.040 INFO:tasks.workunit.client.0.trial129.stdout:Object obj8: acting: 2 0 1 2026-02-23T07:40:37.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj8: acting: 2 0 1' 2026-02-23T07:40:37.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:40:37.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:40:37.041 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:40:37.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:40:37.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj8 (2) 0 1 2' 2026-02-23T07:40:37.042 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj8 (2) 0 1 2 2026-02-23T07:40:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:40:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:40:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj8' 2026-02-23T07:40:37.043 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj8 2026-02-23T07:40:37.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj8 ' 2026-02-23T07:40:37.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:40:37.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 4 )) 2026-02-23T07:40:37.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj25 2026-02-23T07:40:37.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.045 INFO:tasks.workunit.client.0.trial129.stdout:Object obj25: acting: 0 1 2 2026-02-23T07:40:37.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj25: acting: 0 1 2' 2026-02-23T07:40:37.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:40:37.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:40:37.046 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:40:37.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:40:37.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.047 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj25 (3) 1 2 0 2026-02-23T07:40:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj25 (3) 1 2 0' 2026-02-23T07:40:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:40:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:40:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:37.048 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj25 2026-02-23T07:40:37.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj25' 2026-02-23T07:40:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj25 ' 2026-02-23T07:40:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:40:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 4 )) 2026-02-23T07:40:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:40:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:40:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:40:37.099 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:40:37.099 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:40:37.099 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:37.106 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:40:37.106 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:40:37.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:37.113 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:40:37.113 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:40:37.113 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:37.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:40:37.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:40:37.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:40:37.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:40:37.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:40:37.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:40:37.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:40:37.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:40:38.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:40:38.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:40:38.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj30 ' 2026-02-23T07:40:38.231 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj30 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:40:38.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj30 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj30 2026-02-23T07:40:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj30 remove 2026-02-23T07:40:38.370 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:4eb30133:::obj30:head# 2026-02-23T07:40:38.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:40:38.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:40:38.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:40:38.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj8 ' obj_to_pgid rm_object 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj8 ' 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=rm_object 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj8 ]] 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:40:38.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj8 ' 2026-02-23T07:40:38.437 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj8 2026-02-23T07:40:38.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj8 2026-02-23T07:40:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:40:38.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-23T07:40:38.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj8 2026-02-23T07:40:38.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj8 remove 2026-02-23T07:40:38.543 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:a557efb1:::obj8:head# 2026-02-23T07:40:38.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:40:38.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:40:38.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:40:38.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:40:38.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:40:38.603 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj18 2026-02-23T07:40:38.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj18 ' 2026-02-23T07:40:38.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj18 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:40:38.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-23T07:40:38.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj18 2026-02-23T07:40:38.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj18 remove 2026-02-23T07:40:38.728 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:b9836a99:::obj18:head# 2026-02-23T07:40:38.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:40:38.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:40:38.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj25 ' obj_to_pgid rm_object 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj25 ' 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=rm_object 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj25 ]] 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:40:38.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj25 ' 2026-02-23T07:40:38.785 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj25 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:40:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj25 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj25 2026-02-23T07:40:38.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj25 remove 2026-02-23T07:40:38.893 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:7109478f:::obj25:head# 2026-02-23T07:40:38.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:40:38.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:40:38.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:40:38.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:40:38.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:40:50.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:40:55.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:40:42.844277+0000 19'14 32:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:40:42.843990+0000 19'14 32:71 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:40:42.843980+0000 19'19 32:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:40:42.844666+0000 19'17 32:68 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:40:55.222 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:40:55.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:55.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:40:55.233 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:40:55.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:40:55.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:40:55.306 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:40:55.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:40:55.371 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:40:55.372 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:40:55.372 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:55.379 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:40:55.379 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:40:55.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:55.386 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:40:55.386 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:40:55.386 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:55.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:40:56.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:40:56.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832456397646680 2026-02-23T07:40:56.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:40:56.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:40:56.399416330' 2026-02-23T07:40:56.399 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:40:56.399416330 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:40:56.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:40:56.554 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:40:56.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:40:56.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832456570925312 2026-02-23T07:40:56.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:40:56.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:40:56.571987424 (173 ms)' 2026-02-23T07:40:56.572 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:40:56.571987424 (173 ms) 2026-02-23T07:40:56.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:56.573 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:40:56.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:40:56.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:56.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:56.573 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:40:56.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:40:56.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:56.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:56.574 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:40:56.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:40:56.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:56.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:56.575 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:40:56.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:40:56.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:56.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:40:56.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:40:56.576 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:40:56.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:40:56.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:40:56.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:40:56.893 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:40:42.844277+0000 19'14 32:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:40:42.843990+0000 19'14 32:72 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:40:42.843980+0000 19'19 32:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:40:42.844666+0000 19'17 32:69 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:40:22.195768+0000 0 0 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:40:56.894 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:40:56.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:40:56.969 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:40:56.969 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:40:56.969 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:56.976 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:40:56.976 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:40:56.976 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:56.982 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:40:56.982 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:40:56.983 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:56.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:40:56.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832456992717466 2026-02-23T07:40:56.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:56.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:56.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:40:56.993 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:40:56.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:40:57.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:40:57.056 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:40:57.057 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:40:57.057 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:40:57.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:57.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:57.064 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:40:57.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:40:57.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:40:57.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:40:57.127 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:40:57.127 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:40:57.127 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:40:57.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:57.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:57.134 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:40:57.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:40:57.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:40:57.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:40:57.196 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:40:57.197 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:40:57.197 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:40:57.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:57.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:40:57.205 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:40:57.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:40:57.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:40:57.266 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:40:57.266 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:40:57.266 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:40:57.266 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:40:57.267 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:40:57.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:40:57.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:40:57.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:40:57.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:40:57.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:40:57.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:40:57.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:40:57.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:40:57.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832457440094407 2026-02-23T07:40:57.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=447 2026-02-23T07:40:57.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:40:57.503 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:40:57.503 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:40:57.503 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.509 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:40:57.510 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:40:57.510 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.516 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:40:57.516 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:40:57.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:40:57.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:40:59.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:40:59.678 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:40:59.678 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean+scrubbing+deep 2026-02-23T07:40:59.023796+0000 19'14 32:65 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:40:22.195768+0000 0'0 2026-02-23T07:40:22.195768+0000 0 0 deep scrubbing for 1s 0 0 2026-02-23T07:40:59.679 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean+inconsistent 2026-02-23T07:40:57.542199+0000 19'14 32:83 [0,1,2] 0 [0,1,2] 0 19'14 2026-02-23T07:40:57.542174+0000 19'14 2026-02-23T07:40:57.542174+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:40:57.542174+0000 13 0 2026-02-23T07:40:59.679 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean+inconsistent 2026-02-23T07:40:57.430186+0000 19'19 32:70 [2,0,1] 2 [2,0,1] 2 19'19 2026-02-23T07:40:57.430155+0000 19'19 2026-02-23T07:40:57.430155+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:40:57.430155+0000 18 0 2026-02-23T07:40:59.679 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:40:58.008759+0000 19'17 32:83 [1,0,2] 1 [1,0,2] 1 19'17 2026-02-23T07:40:58.008733+0000 19'17 2026-02-23T07:40:58.008733+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:40:58.008733+0000 17 0 2026-02-23T07:40:59.679 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:40:59.679 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:40:59.679 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:40:59.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' rmobj_1 3 4 16 2 2 256 4194304 0 447 2026-02-23T07:40:59.689 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ rmobj_1@ NAUT 3 4 16 2/ 2 256 4194304/ 0 447 2026-02-23T07:40:59.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:59.690 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:40:59.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:40:59.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:40:59.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:40:59.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:40:59.704 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T07:40:59.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:59.705 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:40:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:40:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:40:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:40:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:40:59.718 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:40:59.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:59.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:40:59.720 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:40:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:40:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:40:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:40:59.733 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:40:59.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:40:59.734 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:40:59.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:40:59.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:40:59.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:40:59.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:40:59.748 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T07:40:59.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:40:59.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:41:05.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:41:05.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:41:05.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:41:05.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:41:05.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:41:05.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:41:05.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:41:05.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:41:05.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:41:05.469 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:41:05.469 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:41:05.469 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:05.476 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:41:05.476 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:41:05.476 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:05.483 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:41:05.483 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:41:05.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:05.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:41:05.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832465493558980 2026-02-23T07:41:05.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:41:05.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:41:05.648 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:41:05.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:41:05.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:41:05.813 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:41:05.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:41:05.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:41:05.974 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:41:05.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:41:05.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:41:06.137 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:41:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:41:06.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:41:06.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:41:06.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:41:06.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:41:06.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:41:06.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:41:06.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:41:06.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:41:06.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832466314819705 2026-02-23T07:41:06.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=821 2026-02-23T07:41:06.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:41:06.380 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:41:06.380 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:41:06.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:06.387 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:41:06.387 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:41:06.387 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:06.394 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:41:06.394 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:41:06.395 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:06.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:41:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:41:11.556 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:41:07.010492+0000 19'14 32:85 [1,2,0] 1 [1,2,0] 1 19'14 2026-02-23T07:41:07.010462+0000 19'14 2026-02-23T07:41:07.010462+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:41:07.010462+0000 14 0 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:41:06.414120+0000 19'14 32:105 [0,1,2] 0 [0,1,2] 0 19'14 2026-02-23T07:41:06.412151+0000 19'14 2026-02-23T07:41:06.412151+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:41:06.412151+0000 13 0 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:41:06.337956+0000 19'19 32:95 [2,0,1] 2 [2,0,1] 2 19'19 2026-02-23T07:41:06.336266+0000 19'19 2026-02-23T07:41:06.336266+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:41:06.336266+0000 18 0 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:41:06.017276+0000 19'17 32:100 [1,0,2] 1 [1,0,2] 1 19'17 2026-02-23T07:41:06.017253+0000 19'17 2026-02-23T07:41:06.017253+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:41:06.017253+0000 17 0 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:41:11.557 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:41:11.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' rmobj_1 3 4 16 2 2 256 4194304 0 821 2026-02-23T07:41:11.568 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ rmobj_1@ REPR 3 4 16 2/ 2 256 4194304/ 0 821 2026-02-23T07:41:11.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:41:11.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:41:11.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:41:11.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:41:11.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:41:11.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:41:11.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0741 2026-02-23T07:41:11.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:41:11.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:41:11.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:11.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.673 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:11.674 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.675 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.676 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:11.677 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:11.678 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:41:11.679 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:11.680 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 31744 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:11.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.005999980, 2026-02-23T07:41:11.683 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002999990 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:11.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.689 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.694 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.695 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.696 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.697 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 31744 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.005999980, 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002999990 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.702 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.703 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.704 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.705 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:11.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.709 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.709 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.709 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.709 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:41:11.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.734 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 14, 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.735 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.736 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.737 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 32768 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:11.738 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.015999943, 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003999985 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.739 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.740 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.744 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.745 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.746 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 14, 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.747 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.748 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.749 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.750 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "value": 32768 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.751 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:41:11.752 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.015999943, 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003999985 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.753 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.754 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.755 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:41:11.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.811 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 8, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.812 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.813 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 124 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 31744 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.007999972, 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003999986 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.815 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.817 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.818 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.820 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 8, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.821 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:11.822 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 124 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 31744 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.007999972, 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003999986 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.827 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:11.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:11.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:41:11.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:19.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:41:19.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.451 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.452 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 9, 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.453 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:19.454 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.455 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.456 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.457 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.458 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "value": 48128 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:19.459 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.460 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.008999972, 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002999990 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.461 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.462 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:19.463 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.464 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:19.465 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.466 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.467 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.468 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.470 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.470 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:41:19.470 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.470 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:19.470 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.470 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.471 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 9, 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:19.472 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.473 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.474 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "value": 48128 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.475 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:19.476 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.008999972, 2026-02-23T07:41:19.477 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002999990 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.478 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.479 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:19.480 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.481 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:19.482 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:41:19.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.506 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 21, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.507 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:19.508 INFO:tasks.workunit.client.0.trial129.stderr: "value": 49152 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.024999921, 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.004166653 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:41:19.509 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:41:19.510 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.511 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.512 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.513 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 21, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.514 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:19.515 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 49152 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.024999921, 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.004166653 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:19.517 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:41:19.518 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.519 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.520 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:41:19.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.583 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 12, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.584 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 188 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 48128 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.012999960, 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.004333320 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.589 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:19.590 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:41:19.591 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:41:19.592 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.593 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 12, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:41:19.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 188 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 48128 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:41:19.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.012999960, 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.004333320 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.597 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.599 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.600 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.601 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:41:19.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:41:32.781 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:41:32.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:41:32.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:41:32.985 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:41:32.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:41:33.189 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:41:33.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:41:33.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:41:33.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 128 1048576 4 2026-02-23T07:41:33.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:41:33.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:41:33.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=128 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=1048576 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832493204718247 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 1048576 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1048576 2026-02-23T07:41:33.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:41:33.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.4c0sC3t9Kr bs=1048576 count=1 2026-02-23T07:41:33.213 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:41:33.213 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:41:33.214 INFO:tasks.workunit.client.0.trial129.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00235907 s, 444 MB/s 2026-02-23T07:41:33.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:41:33.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:41:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:41:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:34.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:41:34.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:41:34.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:41:34.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.4c0sC3t9Kr 2026-02-23T07:41:34.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:41:34.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832494015620091 2026-02-23T07:41:34.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=810 2026-02-23T07:41:34.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 128 objects in pool test in 810 ms' 2026-02-23T07:41:34.018 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 128 objects in pool test in 810 ms 2026-02-23T07:41:34.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:41:34.019 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:41:34.016871551 2026-02-23T07:41:34.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:41:34.016871551' 2026-02-23T07:41:34.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:41:34.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:41:34.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:41:34.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:41:34.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:41:34.022 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:41:34.022 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:41:34.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:41:34.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:41:34.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:41:34.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:41:34.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:41:34.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:41:34.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:41:34.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:41:34.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:41:34.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:41:34.257 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:41:34.257 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:41:34.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:41:34.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:41:34.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:41:34.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T07:41:34.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T07:41:34.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T07:41:34.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:41:34.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:41:34.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705677 2026-02-23T07:41:34.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705677 2026-02-23T07:41:34.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-38654705677' 2026-02-23T07:41:34.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:41:34.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:41:34.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-23T07:41:34.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-23T07:41:34.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-38654705677 2-55834574858' 2026-02-23T07:41:34.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:41:34.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T07:41:34.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:41:34.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:41:34.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T07:41:34.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:41:34.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T07:41:34.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T07:41:34.480 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836495 2026-02-23T07:41:34.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:41:34.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:41:34.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:41:35.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:41:35.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:41:35.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:41:35.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:41:36.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:41:36.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:41:36.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T07:41:36.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:41:36.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705677 2026-02-23T07:41:36.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:41:36.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:41:36.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705677 2026-02-23T07:41:36.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:41:36.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705677 2026-02-23T07:41:36.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705677' 2026-02-23T07:41:36.978 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705677 2026-02-23T07:41:36.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:41:37.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705679 -lt 38654705677 2026-02-23T07:41:37.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:41:37.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-23T07:41:37.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:41:37.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:41:37.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-23T07:41:37.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:41:37.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-23T07:41:37.148 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574858 2026-02-23T07:41:37.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-23T07:41:37.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:41:37.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574860 -lt 55834574858 2026-02-23T07:41:37.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:41:37.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:41:37.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:41:37.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:41:37.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:41:37.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T07:41:37.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:41:37.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:41:37.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:41:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T07:41:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:41:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:41:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:41:38.030 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:41:38.031 INFO:tasks.workunit.client.0.trial129.stdout: client io 22 MiB/s wr, 0 op/s rd, 21 op/s wr 2026-02-23T07:41:38.031 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:41:38.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:41:38.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:41:43.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:26.841515+0000 19'14 19:37 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-23T07:41:26.841528+0000 19'16 19:39 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-23T07:41:27.107202+0000 19'23 19:43 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:26.841581+0000 19'14 19:38 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:26.841433+0000 19'14 19:38 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-23T07:41:26.840956+0000 19'12 19:34 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-23T07:41:27.107236+0000 19'11 19:33 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-23T07:41:26.841342+0000 19'24 19:50 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:41:43.198 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:41:43.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:41:43.209 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:41:43.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:41:43.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:41:43.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:41:43.281 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:41:43.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:41:43.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:41:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:41:43.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:41:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:41:43.355563225' 2026-02-23T07:41:43.356 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:41:43.355563225 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832503356745895 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 128 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:41:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=128 2026-02-23T07:41:43.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:41:43.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:41:43.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:41:43.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:41:43.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:41:45.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:41:45.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832505391589996 2026-02-23T07:41:45.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:41:45.392 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:41:45.392736639 (2034 ms) 2026-02-23T07:41:45.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:41:45.392736639 (2034 ms)' 2026-02-23T07:41:45.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=10 2026-02-23T07:41:45.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:41:45.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 10 2026-02-23T07:41:45.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj97 obj96 obj95 obj94 obj93 obj92 obj91 obj90 obj99 obj98 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj118 obj119 obj112 obj113 obj110 obj111 obj116 obj117 obj114 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj109 obj108 obj105 obj104 obj107 obj106 obj101 obj100 obj103 obj102 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj84 obj85 obj86 obj87 obj80 obj81 obj82 obj83 obj88 obj89 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj127 obj126 obj125 obj124 obj123 obj122 obj121 obj120 obj128 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:41:45.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.394 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 10 2026-02-23T07:41:45.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 10' 2026-02-23T07:41:45.395 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj72 2026-02-23T07:41:45.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj72' 2026-02-23T07:41:45.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 128' 2026-02-23T07:41:45.396 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 128 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 0 )) 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=0 )) 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj72 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.397 INFO:tasks.workunit.client.0.trial129.stdout:Object obj72: acting: 0 1 2 2026-02-23T07:41:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj72: acting: 0 1 2' 2026-02-23T07:41:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:41:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.398 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:41:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj72 (0) 1 2 0' 2026-02-23T07:41:45.399 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj72 (0) 1 2 0 2026-02-23T07:41:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-23T07:41:45.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.400 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj72 2026-02-23T07:41:45.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj72' 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj72 ' 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj76 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stdout:Object obj76: acting: 1 0 2 2026-02-23T07:41:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj76: acting: 1 0 2' 2026-02-23T07:41:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:41:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.402 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:41:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj76 (1) 0 2 1' 2026-02-23T07:41:45.403 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj76 (1) 0 2 1 2026-02-23T07:41:45.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:41:45.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj76 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj76' 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj76 ' 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj102 2026-02-23T07:41:45.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.405 INFO:tasks.workunit.client.0.trial129.stdout:Object obj102: acting: 1 0 2 2026-02-23T07:41:45.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj102: acting: 1 0 2' 2026-02-23T07:41:45.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:41:45.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.405 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:41:45.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj102 (2) 0 2 1' 2026-02-23T07:41:45.406 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj102 (2) 0 2 1 2026-02-23T07:41:45.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj102 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj102' 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj102 ' 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj54 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stdout:Object obj54: acting: 2 0 1 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj54: acting: 2 0 1' 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:41:45.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.409 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:41:45.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj54 (3) 0 1 2' 2026-02-23T07:41:45.409 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj54 (3) 0 1 2 2026-02-23T07:41:45.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:41:45.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.410 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj54 2026-02-23T07:41:45.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj54' 2026-02-23T07:41:45.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj54 ' 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj120 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stdout:Object obj120: acting: 1 0 2 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj120: acting: 1 0 2' 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:41:45.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.412 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:41:45.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.412 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj120 (4) 0 2 1 2026-02-23T07:41:45.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj120 (4) 0 2 1' 2026-02-23T07:41:45.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:41:45.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.413 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj120 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj120' 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj120 ' 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj75 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj75: acting: 2 0 1' 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stdout:Object obj75: acting: 2 0 1 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:41:45.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.415 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:41:45.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.415 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj75 (5) 0 1 2 2026-02-23T07:41:45.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj75 (5) 0 1 2' 2026-02-23T07:41:45.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:41:45.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.416 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj75 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj75' 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj75 ' 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj45 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj45: acting: 1 2 0' 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stdout:Object obj45: acting: 1 2 0 2026-02-23T07:41:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj45 (6) 2 0 1' 2026-02-23T07:41:45.418 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj45 (6) 2 0 1 2026-02-23T07:41:45.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:41:45.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.419 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj45 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj45' 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj45 ' 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj67 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj67: acting: 1 2 0' 2026-02-23T07:41:45.420 INFO:tasks.workunit.client.0.trial129.stdout:Object obj67: acting: 1 2 0 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj67 (7) 2 0 1' 2026-02-23T07:41:45.422 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj67 (7) 2 0 1 2026-02-23T07:41:45.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:41:45.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.422 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj67 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj67' 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj67 ' 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj17 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stdout:Object obj17: acting: 1 0 2 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj17: acting: 1 0 2' 2026-02-23T07:41:45.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj17 (8) 0 2 1' 2026-02-23T07:41:45.424 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj17 (8) 0 2 1 2026-02-23T07:41:45.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:41:45.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.425 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj17 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj17' 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj17 ' 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj92 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stdout:Object obj92: acting: 1 0 2 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj92: acting: 1 0 2' 2026-02-23T07:41:45.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:41:45.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:41:45.427 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:41:45.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:41:45.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.427 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj92 (9) 0 2 1 2026-02-23T07:41:45.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj92 (9) 0 2 1' 2026-02-23T07:41:45.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:41:45.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:41:45.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:41:45.428 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj92 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj92' 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj92 ' 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:41:45.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:41:45.473 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:41:45.473 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:41:45.474 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:45.480 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:41:45.480 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:41:45.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:45.487 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:41:45.488 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:41:45.488 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:41:45.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:41:45.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:41:45.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:41:45.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:41:45.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:41:45.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:41:45.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:41:45.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:41:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:41:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj102 obj120 obj67 obj17 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj102 obj120 obj67 obj17 ' 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:46.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj102 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj102 2026-02-23T07:41:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj102 remove 2026-02-23T07:41:46.893 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:6681cfe7:::obj102:head# 2026-02-23T07:41:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:41:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:41:46.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:46.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:46.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:46.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:46.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:46.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj120 2026-02-23T07:41:46.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:46.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-23T07:41:46.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj120 2026-02-23T07:41:46.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj120 remove 2026-02-23T07:41:47.053 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:1efaad2b:::obj120:head# 2026-02-23T07:41:47.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:47.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:47.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:47.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:41:47.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:41:47.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:47.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj67 2026-02-23T07:41:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-23T07:41:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj67 2026-02-23T07:41:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj67 remove 2026-02-23T07:41:47.226 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:d1c8135f:::obj67:head# 2026-02-23T07:41:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:41:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:41:47.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:47.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:47.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:47.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:47.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 0 obj17 2026-02-23T07:41:47.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:47.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=0 2026-02-23T07:41:47.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj17 2026-02-23T07:41:47.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj17 remove 2026-02-23T07:41:47.371 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:24fc6e92:::obj17:head# 2026-02-23T07:41:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:41:47.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:41:47.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:41:47.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj72 obj54 obj75 ' 2026-02-23T07:41:47.434 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj72 obj54 obj75 2026-02-23T07:41:47.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:41:47.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj72 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-23T07:41:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj72 2026-02-23T07:41:47.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj72 remove 2026-02-23T07:41:47.551 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:492a75ed:::obj72:head# 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:47.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj54 2026-02-23T07:41:47.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:47.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-23T07:41:47.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj54 2026-02-23T07:41:47.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj54 remove 2026-02-23T07:41:47.706 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:bb038e88:::obj54:head# 2026-02-23T07:41:47.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:47.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:47.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:47.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:41:47.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:41:47.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:47.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 1 obj75 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=1 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj75 2026-02-23T07:41:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj75 remove 2026-02-23T07:41:47.862 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:a555be2b:::obj75:head# 2026-02-23T07:41:47.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:47.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:47.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:41:47.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:41:47.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:41:47.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj76 obj45 obj92 ' 2026-02-23T07:41:47.917 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj76 obj45 obj92 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj76 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj76 2026-02-23T07:41:47.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj76 remove 2026-02-23T07:41:48.030 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:00833431:::obj76:head# 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:48.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj45 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj45 2026-02-23T07:41:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj45 remove 2026-02-23T07:41:48.211 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:cc461e5d:::obj45:head# 2026-02-23T07:41:48.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo rm_object 2026-02-23T07:41:48.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:41:48.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=rm_object 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f rm_object 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: rm_object td/osd-scrub-dump 2 obj92 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:125: rm_object: local dir=td/osd-scrub-dump 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:126: rm_object: local target_osd=2 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:127: rm_object: local obj=obj92 2026-02-23T07:41:48.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:129: rm_object: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj92 remove 2026-02-23T07:41:48.392 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:76c71d4e:::obj92:head# 2026-02-23T07:41:48.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:130: rm_object: return 0 2026-02-23T07:41:48.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:41:48.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:41:48.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:41:48.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:41:59.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:42:04.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345372+0000 19'14 33:62 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-23T07:41:52.345633+0000 19'16 33:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-23T07:41:52.344706+0000 19'23 33:61 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345592+0000 19'14 33:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345378+0000 19'14 33:65 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-23T07:41:52.344550+0000 19'12 33:75 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-23T07:41:52.344500+0000 19'11 33:53 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-23T07:41:52.344990+0000 19'24 33:81 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:42:04.727 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:42:04.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:04.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:42:04.740 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:42:04.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:42:04.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:42:04.814 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:42:04.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:42:04.878 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:42:04.878 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:42:04.878 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:04.885 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:42:04.885 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:42:04.885 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:04.892 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:42:04.892 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:42:04.892 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:04.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:42:05.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:42:05.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832525903535045 2026-02-23T07:42:05.903 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:42:05.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:42:05.905029801' 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:42:05.905029801 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:42:05.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:42:06.056 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:42:06.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:42:06.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832526071000701 2026-02-23T07:42:06.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:42:06.072 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:42:06.072058056 (167 ms) 2026-02-23T07:42:06.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:42:06.072058056 (167 ms)' 2026-02-23T07:42:06.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.073 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:42:06.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:42:06.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.074 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-23T07:42:06.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-23T07:42:06.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.075 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-23T07:42:06.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-23T07:42:06.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.076 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-23T07:42:06.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-23T07:42:06.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.077 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-23T07:42:06.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-23T07:42:06.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.078 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:42:06.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:42:06.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:42:06.079 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:42:06.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.080 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:42:06.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:42:06.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.081 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:42:06.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:06.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:42:06.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:42:06.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:42:06.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:42:06.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:42:06.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:42:06.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:42:06.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:42:06.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:42:06.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345372+0000 19'14 33:62 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-23T07:41:52.345633+0000 19'16 33:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-23T07:41:52.344706+0000 19'23 33:61 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345592+0000 19'14 33:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345378+0000 19'14 33:65 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-23T07:41:52.344550+0000 19'12 33:75 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-23T07:41:52.344500+0000 19'11 33:54 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.394 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-23T07:41:52.344990+0000 19'24 33:82 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:06.395 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:42:06.395 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:42:06.395 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:42:06.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:42:06.468 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:42:06.469 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:06.469 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.476 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:42:06.476 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:06.476 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.483 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:42:06.483 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:06.483 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:42:06.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832526492506797 2026-02-23T07:42:06.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.493 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:42:06.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:42:06.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:42:06.556 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.556 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.556 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.556 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.556 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.564 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:42:06.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:42:06.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:42:06.627 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.627 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.627 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.627 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.627 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:42:06.636 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:42:06.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:42:06.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.698 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.698 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.698 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.706 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:42:06.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:42:06.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:42:06.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.770 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.770 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.770 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:42:06.781 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:42:06.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:42:06.845 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.845 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.845 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.845 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.845 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:42:06.854 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:42:06.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:42:06.916 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.916 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.916 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.916 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.916 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:42:06.925 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:42:06.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:42:06.987 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:06.987 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:06.987 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:06.987 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:06.987 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:06.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:06.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:06.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:42:06.995 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:42:06.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:42:07.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:07.060 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:42:07.060 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:42:07.060 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:42:07.060 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:42:07.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:42:07.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:42:07.236 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:42:07.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832527236691295 2026-02-23T07:42:07.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=744 2026-02-23T07:42:07.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:42:07.301 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:42:07.301 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:07.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:07.308 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:42:07.308 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:07.308 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:07.315 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:42:07.315 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:07.315 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:07.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:42:09.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:42:09.478 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:42:09.478 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345372+0000 19'14 33:63 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:42:09.478 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-23T07:41:52.345633+0000 19'16 33:66 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:09.478 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean+scrubbing+deep 2026-02-23T07:42:07.139399+0000 19'23 33:67 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 deep scrubbing for 1s 5 0 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean+inconsistent 2026-02-23T07:42:07.424042+0000 19'14 33:74 [1,0,2] 1 [1,0,2] 1 19'14 2026-02-23T07:42:07.424004+0000 19'14 2026-02-23T07:42:07.424004+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:07.424004+0000 14 0 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:41:52.345378+0000 19'14 33:66 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean+inconsistent 2026-02-23T07:42:07.058893+0000 19'12 33:86 [0,1,2] 0 [0,1,2] 0 19'12 2026-02-23T07:42:07.058865+0000 19'12 2026-02-23T07:42:07.058865+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:07.058865+0000 12 0 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-23T07:41:52.344500+0000 19'11 33:55 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-23T07:41:52.344990+0000 19'24 33:83 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:41:26.731210+0000 0'0 2026-02-23T07:41:26.731210+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:41:26.731210+0000 0 0 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:42:09.479 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:42:09.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj 3 8 16 0 10 1048576 4194304 0 744 2026-02-23T07:42:09.489 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj@ NAUT 3 8 16 0/ 10 1048576 4194304/ 0 744 2026-02-23T07:42:09.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.489 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:42:09.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:42:09.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:42:09.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.503 INFO:tasks.workunit.client.0.trial129.stdout:78 2026-02-23T07:42:09.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:42:09.504 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:42:09.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:42:09.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.518 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:42:09.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.518 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:42:09.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:42:09.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:42:09.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.532 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:42:09.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:42:09.533 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:42:09.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:42:09.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.547 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T07:42:09.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.547 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:42:09.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:42:09.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:42:09.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.560 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.0 2026-02-23T07:42:09.560 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:42:09.561 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:42:09.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:42:09.562 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:42:09.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:42:09.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.575 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T07:42:09.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:42:09.576 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:42:09.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:42:09.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.590 INFO:tasks.workunit.client.0.trial129.stdout:78 2026-02-23T07:42:09.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:09.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:42:09.590 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:42:09.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:42:09.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:42:09.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:42:09.603 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:42:09.603 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:42:09.605 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:42:09.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:42:09.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:42:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:42:15.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:42:15.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:42:15.329 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:42:15.329 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:15.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:15.336 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:42:15.336 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:15.336 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:15.343 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:42:15.343 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:15.343 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:15.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:42:15.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832535352865074 2026-02-23T07:42:15.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:15.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:42:15.505 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-23T07:42:15.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:15.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:42:15.667 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:42:15.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:15.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:42:15.829 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-23T07:42:15.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:15.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:42:15.991 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:42:16.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:16.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:42:16.153 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:42:16.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:16.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:42:16.315 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:42:16.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:16.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:42:16.477 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:42:16.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:42:16.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:42:16.643 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:42:16.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:42:16.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:42:16.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:42:16.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832536819527638 2026-02-23T07:42:16.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1466 2026-02-23T07:42:16.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:42:16.883 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:42:16.883 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:16.883 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:16.890 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:42:16.890 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:16.890 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:16.896 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:42:16.897 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:42:16.897 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:16.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:42:21.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:42:22.059 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:42:18.502676+0000 19'14 33:84 [1,2,0] 1 [1,2,0] 1 19'14 2026-02-23T07:42:18.502629+0000 19'14 2026-02-23T07:42:18.502629+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:18.502629+0000 14 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 16777216 0 0 16 0 16 active+clean 2026-02-23T07:42:17.525240+0000 19'16 33:99 [1,0,2] 1 [1,0,2] 1 19'16 2026-02-23T07:42:17.519549+0000 19'16 2026-02-23T07:42:17.519549+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:17.519549+0000 16 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 24117248 0 0 23 0 23 active+clean 2026-02-23T07:42:16.048956+0000 19'23 33:98 [2,0,1] 2 [2,0,1] 2 19'23 2026-02-23T07:42:16.043034+0000 19'23 2026-02-23T07:42:16.043034+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:16.043034+0000 23 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:42:16.511442+0000 19'14 33:94 [1,0,2] 1 [1,0,2] 1 19'14 2026-02-23T07:42:16.508171+0000 19'14 2026-02-23T07:42:16.508171+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:16.508171+0000 14 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 14680064 0 0 14 0 14 active+clean 2026-02-23T07:42:20.471232+0000 19'14 33:98 [1,2,0] 1 [1,2,0] 1 19'14 2026-02-23T07:42:20.465873+0000 19'14 2026-02-23T07:42:20.465873+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:20.465873+0000 14 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 12582912 0 0 12 0 12 active+clean 2026-02-23T07:42:17.046307+0000 19'12 33:108 [0,1,2] 0 [0,1,2] 0 19'12 2026-02-23T07:42:17.043222+0000 19'12 2026-02-23T07:42:17.043222+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:17.043222+0000 12 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 11534336 0 0 11 0 11 active+clean 2026-02-23T07:42:17.009937+0000 19'11 33:81 [2,0,1] 2 [2,0,1] 2 19'11 2026-02-23T07:42:17.009907+0000 19'11 2026-02-23T07:42:17.009907+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:17.009907+0000 11 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 25165824 0 0 24 0 24 active+clean 2026-02-23T07:42:19.482106+0000 19'24 33:124 [1,0,2] 1 [1,0,2] 1 19'24 2026-02-23T07:42:19.476399+0000 19'24 2026-02-23T07:42:19.476399+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:42:19.476399+0000 24 0 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:42:22.060 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:42:22.061 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:42:22.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj 3 8 16 0 10 1048576 4194304 0 1466 2026-02-23T07:42:22.070 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj@ REPR 3 8 16 0/ 10 1048576 4194304/ 0 1466 2026-02-23T07:42:22.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:42:22.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:42:22.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:42:22.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:42:22.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:42:22.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:42:22.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0742 2026-02-23T07:42:22.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:42:22.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:42:22.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:22.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:42:22.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:22.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.171 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.171 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.171 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.173 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.174 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.175 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.176 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: "value": 248 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.177 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "value": 248 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "value": 248 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.178 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "value": 248 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "value": 248 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "value": 260046848 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.179 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.180 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.029999894, 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.014999947 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.181 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.184 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.186 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.187 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.188 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.190 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.191 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.192 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.193 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "value": 248 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "value": 248 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:42:22.194 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "value": 248 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "value": 248 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "value": 248 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "value": 260046848 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.029999894, 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.014999947 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:22.197 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:22.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:42:22.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.229 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 36, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.230 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.231 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:22.232 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 262144000 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.205999032, 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.020599903 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:22.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.240 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 36, 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.241 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.242 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 262144000 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:42:22.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.205999032, 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.020599903 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:42:22.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.303 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 16, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:22.304 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.305 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 250 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": 262144000 2026-02-23T07:42:22.306 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.080999677, 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.020249919 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:22.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:22.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:22.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.313 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 16, 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:22.314 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:22.315 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 250 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": 262144000 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:22.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.080999677, 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.020249919 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:22.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.320 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:22.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:22.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:42:22.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:30.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:42:30.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.676 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:30.677 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 9, 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.678 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.679 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.680 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.681 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 376 2026-02-23T07:42:30.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 376 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 376 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 376 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 376 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 394264576 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:30.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.044999823, 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.014999941 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:30.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.690 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.691 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.692 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.693 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:30.694 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.695 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.696 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.697 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.697 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:42:30.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 9, 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.701 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 376 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 376 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:30.702 INFO:tasks.workunit.client.0.trial129.stdout: "value": 376 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 376 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 376 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 394264576 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:30.703 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:42:30.704 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.044999823, 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.014999941 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.705 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:42:30.707 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.708 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.709 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:30.710 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.711 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:42:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.740 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 54, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.741 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.742 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.743 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 396361728 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:30.744 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.745 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 15, 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.304998565, 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.020333237 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:30.746 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:30.747 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.748 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.749 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.750 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.751 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.752 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.753 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 54, 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:30.754 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.755 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.756 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 396361728 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:30.757 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 15, 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.304998565, 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.020333237 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.758 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:30.759 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:42:30.760 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.761 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.762 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:42:30.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:42:30.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:42:30.813 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:30.813 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.813 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.813 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 24, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.814 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:42:30.815 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:30.816 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 396361728 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.817 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.123999474, 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.020666579 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.818 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.819 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.820 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.821 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.822 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.823 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 24, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.824 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:42:30.825 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:42:30.826 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 396361728 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.827 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.123999474, 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.020666579 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.828 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.829 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.830 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.831 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.832 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:30.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:42:30.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:42:44.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:42:44.004 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:42:44.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:42:44.203 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:42:44.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:42:44.408 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:42:44.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:42:44.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:42:44.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 4194304 4 2026-02-23T07:42:44.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:42:44.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:42:44.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-23T07:42:44.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=4194304 2026-02-23T07:42:44.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:42:44.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:42:44.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832564421770988 2026-02-23T07:42:44.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 4194304 2026-02-23T07:42:44.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=4194304 2026-02-23T07:42:44.423 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:42:44.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.Y08bisAp6n bs=4194304 count=1 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00909124 s, 461 MB/s 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:42:44.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:44.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:44.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:45.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:45.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:45.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:42:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:42:45.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:42:45.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:42:45.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.Y08bisAp6n 2026-02-23T07:42:45.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:42:45.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832565319834795 2026-02-23T07:42:45.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=898 2026-02-23T07:42:45.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 898 ms' 2026-02-23T07:42:45.320 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 64 objects in pool test in 898 ms 2026-02-23T07:42:45.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:42:45.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:42:45.321086653' 2026-02-23T07:42:45.321 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:42:45.321086653 2026-02-23T07:42:45.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:42:45.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:42:45.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:42:45.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:42:45.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:42:45.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:42:45.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:42:45.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:42:45.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:42:45.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:42:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:42:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:42:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:42:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:42:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:42:45.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:42:45.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:42:45.563 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:42:45.563 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:42:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:42:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:42:45.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:42:45.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T07:42:45.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T07:42:45.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T07:42:45.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:42:45.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:42:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672973 2026-02-23T07:42:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672973 2026-02-23T07:42:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973' 2026-02-23T07:42:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:42:45.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:42:45.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-23T07:42:45.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-23T07:42:45.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-60129542154' 2026-02-23T07:42:45.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:42:45.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T07:42:45.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:42:45.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:42:45.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T07:42:45.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:42:45.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T07:42:45.783 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836495 2026-02-23T07:42:45.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T07:42:45.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:42:45.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:42:45.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:42:46.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:42:46.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:42:47.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:42:47.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:42:48.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:42:48.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:42:48.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T07:42:48.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:42:48.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672973 2026-02-23T07:42:48.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:42:48.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:42:48.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672973 2026-02-23T07:42:48.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:42:48.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672973 2026-02-23T07:42:48.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2026-02-23T07:42:48.287 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672973 2026-02-23T07:42:48.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:42:48.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672974 -lt 42949672973 2026-02-23T07:42:48.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:42:48.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-23T07:42:48.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:42:48.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:42:48.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-23T07:42:48.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:42:48.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-23T07:42:48.456 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542154 2026-02-23T07:42:48.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-23T07:42:48.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:42:48.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542154 2026-02-23T07:42:48.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:42:48.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:42:48.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:42:48.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:42:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T07:42:48.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:42:48.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:42:48.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:42:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T07:42:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:42:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:42:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:42:49.345 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:42:49.345 INFO:tasks.workunit.client.0.trial129.stdout: client io 45 MiB/s wr, 0 op/s rd, 11 op/s wr 2026-02-23T07:42:49.345 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:42:49.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:42:49.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:42:54.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:42:54.510 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:42:38.162136+0000 20'6 20:28 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:42:38.162328+0000 20'7 20:29 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-23T07:42:38.062287+0000 20'16 20:39 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:42:38.161477+0000 20'6 20:29 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-23T07:42:38.162159+0000 20'8 20:31 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:42:38.161667+0000 20'7 20:28 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-23T07:42:38.062506+0000 20'3 20:28 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-23T07:42:38.162016+0000 20'11 20:36 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:42:54.511 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:42:54.512 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:42:54.512 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:42:54.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:42:54.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:42:54.523 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:42:54.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:42:54.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:42:54.595 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:42:54.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:42:54.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:42:54.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:42:54.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:42:54.669 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:42:54.669564623 2026-02-23T07:42:54.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:42:54.669564623' 2026-02-23T07:42:54.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:42:54.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832574670695263 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:42:54.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:42:54.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:42:54.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:42:55.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:42:55.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832575715874457 2026-02-23T07:42:55.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:42:55.717 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:42:55.717071031 (1045 ms) 2026-02-23T07:42:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:42:55.717071031 (1045 ms)' 2026-02-23T07:42:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=40 2026-02-23T07:42:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:42:55.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:42:55.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 40 2026-02-23T07:42:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.719 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 40 2026-02-23T07:42:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 40' 2026-02-23T07:42:55.719 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj3 2026-02-23T07:42:55.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj3' 2026-02-23T07:42:55.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.720 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 64 2026-02-23T07:42:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-23T07:42:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:42:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:42:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:42:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.722 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj3 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj3' 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj3 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj3 ' 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.724 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj11 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj11' 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj11 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj11 ' 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj22' 2026-02-23T07:42:55.726 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj22 2026-02-23T07:42:55.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj22 2026-02-23T07:42:55.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj22 ' 2026-02-23T07:42:55.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.727 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj5 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj5' 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj5 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj5 ' 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.729 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj7 2026-02-23T07:42:55.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj7' 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj7 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj7 ' 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.730 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj25 2026-02-23T07:42:55.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj25' 2026-02-23T07:42:55.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj25 2026-02-23T07:42:55.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj25 ' 2026-02-23T07:42:55.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.732 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj47 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj47' 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj47 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj47 ' 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.734 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj43 2026-02-23T07:42:55.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj43' 2026-02-23T07:42:55.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj43 2026-02-23T07:42:55.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj43 ' 2026-02-23T07:42:55.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.735 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj2 2026-02-23T07:42:55.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj2' 2026-02-23T07:42:55.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj2 2026-02-23T07:42:55.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj2 ' 2026-02-23T07:42:55.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.737 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj45 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj45' 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj45 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj45 ' 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.738 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj64 2026-02-23T07:42:55.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj64' 2026-02-23T07:42:55.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj64 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj64 ' 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj14' 2026-02-23T07:42:55.740 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj14 2026-02-23T07:42:55.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj14 2026-02-23T07:42:55.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj14 ' 2026-02-23T07:42:55.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.742 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj56 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj56' 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj56 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj56 ' 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj19' 2026-02-23T07:42:55.744 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj19 2026-02-23T07:42:55.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj19 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj19 ' 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj33' 2026-02-23T07:42:55.745 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj33 2026-02-23T07:42:55.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj33 2026-02-23T07:42:55.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:42:55.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj33 ' 2026-02-23T07:42:55.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj51' 2026-02-23T07:42:55.747 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj51 2026-02-23T07:42:55.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj51 2026-02-23T07:42:55.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:42:55.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj51 ' 2026-02-23T07:42:55.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.749 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj30 2026-02-23T07:42:55.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj30' 2026-02-23T07:42:55.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj30 2026-02-23T07:42:55.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:42:55.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj30 ' 2026-02-23T07:42:55.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.750 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj50 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj50' 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj50 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj50 ' 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj40' 2026-02-23T07:42:55.752 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj40 2026-02-23T07:42:55.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj40 2026-02-23T07:42:55.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:42:55.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj40 ' 2026-02-23T07:42:55.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj39' 2026-02-23T07:42:55.753 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj39 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj39 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj39 ' 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=20 )) 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj41 2026-02-23T07:42:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj41: acting: 2 0 1' 2026-02-23T07:42:55.755 INFO:tasks.workunit.client.0.trial129.stdout:Object obj41: acting: 2 0 1 2026-02-23T07:42:55.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.756 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.756 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj41 (20) 0 1 2 2026-02-23T07:42:55.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj41 (20) 0 1 2' 2026-02-23T07:42:55.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.757 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj41 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj41' 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj41 ' 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj55 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj55: acting: 2 0 1' 2026-02-23T07:42:55.758 INFO:tasks.workunit.client.0.trial129.stdout:Object obj55: acting: 2 0 1 2026-02-23T07:42:55.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.759 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj55 (21) 0 1 2' 2026-02-23T07:42:55.760 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj55 (21) 0 1 2 2026-02-23T07:42:55.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj55' 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj55 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj55 ' 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj60 2026-02-23T07:42:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.762 INFO:tasks.workunit.client.0.trial129.stdout:Object obj60: acting: 1 0 2 2026-02-23T07:42:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj60: acting: 1 0 2' 2026-02-23T07:42:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.763 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.763 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj60 (22) 0 2 1 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj60 (22) 0 2 1' 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj60 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj60' 2026-02-23T07:42:55.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj60 ' 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj38 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stdout:Object obj38: acting: 0 1 2 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj38: acting: 0 1 2' 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:42:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.766 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.766 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj38 (23) 1 2 0 2026-02-23T07:42:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj38 (23) 1 2 0' 2026-02-23T07:42:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj38 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj38' 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj38 ' 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj24 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stdout:Object obj24: acting: 1 0 2 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj24: acting: 1 0 2' 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.768 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj24 (24) 0 2 1 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj24 (24) 0 2 1' 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.769 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj24 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj24' 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj24 ' 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj4 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.770 INFO:tasks.workunit.client.0.trial129.stdout:Object obj4: acting: 1 0 2 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj4: acting: 1 0 2' 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.771 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj4 (25) 0 2 1 2026-02-23T07:42:55.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj4 (25) 0 2 1' 2026-02-23T07:42:55.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.772 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj4 2026-02-23T07:42:55.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj4' 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj4 ' 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj32 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stdout:Object obj32: acting: 1 2 0 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj32: acting: 1 2 0' 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.773 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj32 (26) 2 0 1 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj32 (26) 2 0 1' 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj32 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj32' 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj32 ' 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj61 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.775 INFO:tasks.workunit.client.0.trial129.stdout:Object obj61: acting: 1 0 2 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj61: acting: 1 0 2' 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.776 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj61 (27) 0 2 1 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj61 (27) 0 2 1' 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj61' 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj61 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj61 ' 2026-02-23T07:42:55.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj35 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stdout:Object obj35: acting: 2 0 1 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj35: acting: 2 0 1' 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.778 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj35 (28) 0 1 2 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj35 (28) 0 1 2' 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj35' 2026-02-23T07:42:55.779 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj35 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj35 ' 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj63 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stdout:Object obj63: acting: 1 0 2 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj63: acting: 1 0 2' 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj63 (29) 0 2 1 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj63 (29) 0 2 1' 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj63' 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj63 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj63 ' 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj20 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stdout:Object obj20: acting: 1 0 2 2026-02-23T07:42:55.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj20: acting: 1 0 2' 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj20 (30) 0 2 1 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj20 (30) 0 2 1' 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj20 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj20' 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj20 ' 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj9 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stdout:Object obj9: acting: 1 2 0 2026-02-23T07:42:55.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj9: acting: 1 2 0' 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj9 (31) 2 0 1 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj9 (31) 2 0 1' 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj9 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj9' 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj9 ' 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj13 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj13: acting: 2 0 1' 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stdout:Object obj13: acting: 2 0 1 2026-02-23T07:42:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj13 (32) 0 1 2 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj13 (32) 0 1 2' 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj13 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj13' 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj13 ' 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj52 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj52: acting: 2 0 1' 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stdout:Object obj52: acting: 2 0 1 2026-02-23T07:42:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj52 (33) 0 1 2 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj52 (33) 0 1 2' 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj52' 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj52 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj52 ' 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj53 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stdout:Object obj53: acting: 1 0 2 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj53: acting: 1 0 2' 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.790 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj53 (34) 0 2 1' 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj53 (34) 0 2 1 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj53' 2026-02-23T07:42:55.791 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj53 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj53 ' 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj21 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stdout:Object obj21: acting: 1 0 2 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj21: acting: 1 0 2' 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj21 (35) 0 2 1 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj21 (35) 0 2 1' 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj21 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj21' 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj21 ' 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj10 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stdout:Object obj10: acting: 1 2 0 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj10: acting: 1 2 0' 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.794 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj10 (36) 2 0 1 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj10 (36) 2 0 1' 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj10' 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj10 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj10 ' 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj15 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.795 INFO:tasks.workunit.client.0.trial129.stdout:Object obj15: acting: 2 0 1 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj15: acting: 2 0 1' 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj15 (37) 0 1 2' 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj15 (37) 0 1 2 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj15' 2026-02-23T07:42:55.796 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj15 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj15 ' 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj36 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj36: acting: 2 0 1' 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stdout:Object obj36: acting: 2 0 1 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.797 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj36 (38) 0 1 2' 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj36 (38) 0 1 2 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj36 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj36' 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj36 ' 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj44 2026-02-23T07:42:55.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stdout:Object obj44: acting: 0 1 2 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj44: acting: 0 1 2' 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj44 (39) 1 2 0' 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj44 (39) 1 2 0 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:42:55.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj44 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj44' 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj44 ' 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:42:55.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:42:55.815 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:42:55.815 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:42:55.815 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:55.822 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:42:55.822 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:42:55.822 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:55.830 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:42:55.830 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:42:55.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:42:55.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:42:55.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:42:55.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:42:55.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:42:55.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:42:55.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:42:55.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:42:55.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:42:56.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:42:56.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:42:56.948 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj64 obj56 obj33 obj30 2026-02-23T07:42:56.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj64 obj56 obj33 obj30 ' 2026-02-23T07:42:56.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:42:56.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:56.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj64 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj64 2026-02-23T07:42:56.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj64 rm-attr _ 2026-02-23T07:42:57.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:57.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:57.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj56 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj56 2026-02-23T07:42:57.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj56 rm-attr _ 2026-02-23T07:42:57.252 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:57.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:57.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj33 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj33 2026-02-23T07:42:57.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj33 rm-attr _ 2026-02-23T07:42:57.422 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:57.422 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:57.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:57.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:57.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:57.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:57.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj30 2026-02-23T07:42:57.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:57.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj30 2026-02-23T07:42:57.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj30 rm-attr _ 2026-02-23T07:42:57.584 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:57.584 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:57.585 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj41 obj60 obj24 obj35 obj20 obj9 obj13 obj53 obj36 ' obj_to_pgid delete_oi 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj41 obj60 obj24 obj35 obj20 obj9 obj13 obj53 obj36 ' 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:42:57.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:42:57.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:42:57.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj41 obj60 obj24 obj35 obj20 obj9 obj13 obj53 obj36 ]] 2026-02-23T07:42:57.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:42:57.639 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj41 obj60 obj24 obj35 obj20 obj9 obj13 obj53 obj36 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj41 obj60 obj24 obj35 obj20 obj9 obj13 obj53 obj36 ' 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:57.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj41 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj41 2026-02-23T07:42:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj41 rm-attr _ 2026-02-23T07:42:57.751 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:57.751 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:57.752 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:57.752 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:57.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:57.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:57.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:57.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:42:57.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:42:57.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:57.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:57.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:57.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:57.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj60 2026-02-23T07:42:57.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:57.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-23T07:42:57.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj60 rm-attr _ 2026-02-23T07:42:57.931 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:57.932 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:57.932 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:57.932 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:57.932 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:42:57.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:57.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj24 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj24 2026-02-23T07:42:57.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj24 rm-attr _ 2026-02-23T07:42:58.098 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:58.098 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:58.099 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:58.099 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:58.099 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:58.099 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:58.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:58.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj35 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj35 2026-02-23T07:42:58.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj35 rm-attr _ 2026-02-23T07:42:58.283 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-23T07:42:58.283 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:58.283 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:58.284 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:58.284 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:58.284 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:58.284 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:58.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:58.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:58.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:58.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:42:58.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:42:58.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:58.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj20 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj20 2026-02-23T07:42:58.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj20 rm-attr _ 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:58.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:58.442 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:58.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj9 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj9 2026-02-23T07:42:58.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj9 rm-attr _ 2026-02-23T07:42:58.606 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-23T07:42:58.606 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:58.606 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:42:58.607 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:42:58.607 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:58.607 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:58.607 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:58.607 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:58.607 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:58.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:58.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:58.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:58.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:58.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj13 2026-02-23T07:42:58.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:58.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:58.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj13 2026-02-23T07:42:58.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj13 rm-attr _ 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:58.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:58.766 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:58.766 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:58.766 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:58.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:58.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:58.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj53 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj53 2026-02-23T07:42:58.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj53 rm-attr _ 2026-02-23T07:42:58.936 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-23T07:42:58.936 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:58.936 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:42:58.936 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:42:58.936 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-23T07:42:58.936 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:42:58.937 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:58.937 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:58.937 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:58.937 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:58.937 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:58.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:58.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:58.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:58.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:42:58.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj36 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj36 2026-02-23T07:42:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj36 rm-attr _ 2026-02-23T07:42:59.114 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:42:59.114 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7eacede5:::obj24:head#, (61) No data available 2026-02-23T07:42:59.114 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fe351e27:::obj9:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:42:59.115 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:42:59.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:59.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:59.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:42:59.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:42:59.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:42:59.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj11 obj22 obj5 obj25 obj47 obj43 obj2 obj45 obj14 obj19 obj50 obj39 ' 2026-02-23T07:42:59.169 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj11 obj22 obj5 obj25 obj47 obj43 obj2 obj45 obj14 obj19 obj50 obj39 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:59.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj11 2026-02-23T07:42:59.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:59.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:42:59.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-23T07:42:59.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj11 rm-attr _ 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:59.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj22 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj22 2026-02-23T07:42:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj22 rm-attr _ 2026-02-23T07:42:59.447 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:42:59.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:59.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:59.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:59.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:42:59.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:42:59.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:59.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:59.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:59.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:59.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj5 2026-02-23T07:42:59.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:59.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:42:59.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj5 2026-02-23T07:42:59.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj5 rm-attr _ 2026-02-23T07:42:59.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:42:59.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:42:59.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:59.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:59.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:59.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:42:59.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:42:59.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:59.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj25 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj25 2026-02-23T07:42:59.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj25 rm-attr _ 2026-02-23T07:42:59.784 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:42:59.784 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:42:59.784 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:42:59.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:42:59.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:42:59.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:42:59.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:42:59.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:42:59.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:42:59.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj47 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj47 2026-02-23T07:42:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj47 rm-attr _ 2026-02-23T07:42:59.954 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:42:59.954 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:42:59.954 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:42:59.954 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:00.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:00.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:00.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:00.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:00.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:00.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:00.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:00.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:00.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj43 2026-02-23T07:43:00.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:00.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:00.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj43 2026-02-23T07:43:00.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj43 rm-attr _ 2026-02-23T07:43:00.137 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:00.137 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:00.137 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:00.137 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.137 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:00.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:00.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj2 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-23T07:43:00.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj2 rm-attr _ 2026-02-23T07:43:00.287 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:00.287 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:00.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:00.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:00.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:00.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj45 2026-02-23T07:43:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:00.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj45 2026-02-23T07:43:00.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj45 rm-attr _ 2026-02-23T07:43:00.440 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:00.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:00.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:00.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:00.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:00.441 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:43:00.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:43:00.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:00.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:00.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:00.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:00.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj14 2026-02-23T07:43:00.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:00.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:00.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj14 2026-02-23T07:43:00.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj14 rm-attr _ 2026-02-23T07:43:00.613 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:00.613 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:00.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:00.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:00.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:00.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:00.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:00.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:00.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj19 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj19 2026-02-23T07:43:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj19 rm-attr _ 2026-02-23T07:43:00.775 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:00.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:00.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:00.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:00.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:00.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:43:00.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:43:00.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:00.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj50 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj50 2026-02-23T07:43:00.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj50 rm-attr _ 2026-02-23T07:43:00.968 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:00.968 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:00.968 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:00.969 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:01.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:01.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:01.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:01.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:43:01.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:43:01.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:01.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:01.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:01.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:01.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj39 2026-02-23T07:43:01.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:01.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj39 2026-02-23T07:43:01.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj39 rm-attr _ 2026-02-23T07:43:01.128 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:43:01.128 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:01.128 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:01.128 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:01.128 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:01.129 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:43:01.129 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:01.129 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:43:01.129 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:01.129 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:01.129 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj55 obj52 obj15 ' obj_to_pgid delete_oi 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj55 obj52 obj15 ' 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:43:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:43:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:43:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj55 obj52 obj15 ]] 2026-02-23T07:43:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:43:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj55 obj52 obj15 ' 2026-02-23T07:43:01.181 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj55 obj52 obj15 2026-02-23T07:43:01.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:43:01.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:01.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:43:01.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj55 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj55 2026-02-23T07:43:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj55 rm-attr _ 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:43:01.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:01.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:43:01.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:01.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:01.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:01.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:01.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:01.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:01.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:43:01.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:43:01.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:01.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:01.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:01.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:01.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj52 2026-02-23T07:43:01.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:01.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj52 2026-02-23T07:43:01.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj52 rm-attr _ 2026-02-23T07:43:01.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-23T07:43:01.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:43:01.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:01.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:43:01.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:01.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:01.498 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:01.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:01.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:01.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:01.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:43:01.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:43:01.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:01.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj15 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-23T07:43:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj15 rm-attr _ 2026-02-23T07:43:01.688 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6727c4f6:::obj39:head#, (61) No data available 2026-02-23T07:43:01.688 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:43:01.688 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:43:01.688 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:43:01.688 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c0c49def:::obj22:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:43:01.689 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:43:01.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:01.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:01.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:43:01.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:43:01.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:43:01.753 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj3 obj7 obj51 obj40 2026-02-23T07:43:01.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj3 obj7 obj51 obj40 ' 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:01.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj3 2026-02-23T07:43:01.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:01.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj3 2026-02-23T07:43:01.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj3 rm-attr _ 2026-02-23T07:43:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:01.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:01.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj7 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-23T07:43:01.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj7 rm-attr _ 2026-02-23T07:43:02.027 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:02.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:02.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:02.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj51 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj51 2026-02-23T07:43:02.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj51 rm-attr _ 2026-02-23T07:43:02.192 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:02.193 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:02.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:02.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:02.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:02.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:43:02.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:43:02.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:02.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj40 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj40 2026-02-23T07:43:02.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj40 rm-attr _ 2026-02-23T07:43:02.370 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:02.370 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:02.370 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj38 obj4 obj32 obj61 obj63 obj21 obj10 obj44 ' obj_to_pgid delete_oi 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:43:02.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj38 obj4 obj32 obj61 obj63 obj21 obj10 obj44 ' 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj38 obj4 obj32 obj61 obj63 obj21 obj10 obj44 ]] 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj38 obj4 obj32 obj61 obj63 obj21 obj10 obj44 ' 2026-02-23T07:43:02.429 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj38 obj4 obj32 obj61 obj63 obj21 obj10 obj44 2026-02-23T07:43:02.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:43:02.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:02.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:43:02.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj38 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj38 2026-02-23T07:43:02.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj38 rm-attr _ 2026-02-23T07:43:02.536 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:02.536 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:02.536 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:02.536 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:02.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:02.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:02.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:02.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:02.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:02.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:02.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj4 2026-02-23T07:43:02.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:02.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj4 2026-02-23T07:43:02.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj4 rm-attr _ 2026-02-23T07:43:02.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:02.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:02.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:02.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:02.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:02.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:02.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:02.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj32 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj32 2026-02-23T07:43:02.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj32 rm-attr _ 2026-02-23T07:43:02.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:02.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:02.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:02.866 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:02.866 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:02.866 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:43:02.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:02.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:02.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj61 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj61 2026-02-23T07:43:02.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj61 rm-attr _ 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:03.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:43:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:03.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:03.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:03.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:03.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:03.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj63 2026-02-23T07:43:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-23T07:43:03.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj63 rm-attr _ 2026-02-23T07:43:03.225 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:03.225 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:03.225 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:43:03.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:03.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:03.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:03.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:43:03.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:43:03.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:03.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:03.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:03.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:43:03.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:43:03.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:03.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj21 2026-02-23T07:43:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj21 2026-02-23T07:43:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj21 rm-attr _ 2026-02-23T07:43:03.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:03.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:03.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:43:03.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:03.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:03.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:03.387 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:43:03.387 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:43:03.387 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:03.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj10 2026-02-23T07:43:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:03.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:03.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj10 2026-02-23T07:43:03.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj10 rm-attr _ 2026-02-23T07:43:03.549 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:43:03.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:43:03.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:43:03.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:43:03.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj44 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj44 2026-02-23T07:43:03.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj44 rm-attr _ 2026-02-23T07:43:03.725 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b8510467:::obj40:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1337354:::obj10:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4dd77094:::obj38:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:43:03.726 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:43:03.727 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:43:03.727 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:43:03.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:43:03.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:43:03.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:43:03.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:43:03.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:43:14.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:43:19.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:43:20.048 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:43:20.048 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:07.580466+0000 20'6 33:53 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.048 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:07.580329+0000 20'7 33:54 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-23T07:43:07.579762+0000 20'16 33:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:07.580444+0000 20'6 33:54 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-23T07:43:07.580605+0000 20'8 33:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:07.579410+0000 20'7 33:66 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-23T07:43:07.579409+0000 20'3 33:48 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-23T07:43:07.580741+0000 20'11 33:66 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:43:20.049 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:43:20.050 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:43:20.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:20.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:43:20.060 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:43:20.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:43:20.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:43:20.132 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:43:20.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:43:20.196 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:43:20.196 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:43:20.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:20.203 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:43:20.203 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:43:20.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:20.210 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:43:20.210 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:43:20.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:20.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:43:21.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:43:21.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832601221583213 2026-02-23T07:43:21.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:43:21.223 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:43:21.223468556 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:43:21.223468556' 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:43:21.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:43:21.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:43:21.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:43:21.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:43:21.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:43:21.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:43:21.378 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:43:21.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:43:21.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832601393804988 2026-02-23T07:43:21.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:43:21.395 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:43:21.394909574 (172 ms) 2026-02-23T07:43:21.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:43:21.394909574 (172 ms)' 2026-02-23T07:43:21.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:43:21.396 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:43:21.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.397 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-23T07:43:21.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-23T07:43:21.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.398 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-23T07:43:21.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-23T07:43:21.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.399 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-23T07:43:21.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-23T07:43:21.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.400 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-23T07:43:21.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-23T07:43:21.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.401 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:43:21.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:43:21.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.402 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:43:21.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:43:21.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.403 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:43:21.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:43:21.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:43:21.404 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:43:21.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:43:21.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:43:21.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:43:21.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:43:21.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:43:21.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:43:21.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:43:21.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:43:21.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:43:21.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:43:21.712 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:43:21.712 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:07.580466+0000 20'6 33:53 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.712 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:07.580329+0000 20'7 33:54 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.712 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-23T07:43:07.579762+0000 20'16 33:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.712 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:07.580444+0000 20'6 33:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.712 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-23T07:43:07.580605+0000 20'8 33:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.713 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:07.579410+0000 20'7 33:67 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.713 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-23T07:43:07.579409+0000 20'3 33:48 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.713 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-23T07:43:07.580741+0000 20'11 33:67 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:21.713 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:43:21.713 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:43:21.713 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:43:21.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:43:21.786 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:43:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:21.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:21.793 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:43:21.793 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:21.793 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:21.800 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:43:21.800 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:21.801 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:21.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:43:21.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832601809550986 2026-02-23T07:43:21.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:21.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:43:21.810 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:43:21.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:43:21.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:21.873 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:21.874 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:21.874 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:21.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:21.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:21.881 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:43:21.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:43:21.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:43:21.948 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:21.948 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:21.948 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:21.948 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:21.948 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:21.956 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:43:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:43:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:43:22.020 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:22.020 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:22.020 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:22.020 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:22.020 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:22.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:22.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:43:22.030 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:43:22.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:43:22.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:22.094 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:22.095 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:22.095 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:22.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:22.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:22.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:43:22.102 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:43:22.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:43:22.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:22.165 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:22.165 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:22.166 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:22.166 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:22.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:22.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:43:22.174 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:43:22.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:43:22.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:22.236 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:22.236 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:22.236 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:22.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:43:22.244 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:43:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:43:22.307 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:22.307 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:22.307 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:22.307 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:22.308 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:22.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:43:22.315 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:43:22.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:43:22.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:43:22.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:22.378 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:43:22.378 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:43:22.379 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:43:22.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:43:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:43:22.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:43:22.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:43:22.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832602554866456 2026-02-23T07:43:22.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=745 2026-02-23T07:43:22.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:43:22.619 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:43:22.619 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:22.619 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.626 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:43:22.626 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:22.626 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.633 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:43:22.633 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:22.633 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:22.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:43:24.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:07.580466+0000 20'6 33:54 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean+scrubbing+deep 2026-02-23T07:43:22.897993+0000 20'7 33:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 deep scrubbing for 1s 0 0 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean+scrubbing+deep 2026-02-23T07:43:22.345263+0000 20'16 33:63 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 deep scrubbing for 1s 10 0 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean+inconsistent 2026-02-23T07:43:21.919844+0000 20'6 33:65 [1,0,2] 1 [1,0,2] 1 20'6 2026-02-23T07:43:21.919805+0000 20'6 2026-02-23T07:43:21.919805+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:21.919805+0000 6 0 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-23T07:43:07.580605+0000 20'8 33:58 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:07.579410+0000 20'7 33:68 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:43:24.794 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-23T07:43:07.579409+0000 20'3 33:49 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:42:37.951724+0000 0 0 2026-02-23T07:43:24.795 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-23T07:43:07.580741+0000 20'11 33:69 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:42:37.951724+0000 0'0 2026-02-23T07:42:37.951724+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:43:24.795 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:43:24.795 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:43:24.795 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:43:24.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2 3 8 8 20 20 4194304 4194304 0 745 2026-02-23T07:43:24.804 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj_2@ NAUT 3 8 8 20/ 20 4194304 4194304/ 0 745 2026-02-23T07:43:24.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.805 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:43:24.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:43:24.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:43:24.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.818 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:43:24.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.819 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:43:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:43:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:43:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.834 INFO:tasks.workunit.client.0.trial129.stdout:1319 2026-02-23T07:43:24.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:43:24.835 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:43:24.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:43:24.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.850 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:43:24.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.851 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:43:24.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:43:24.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:43:24.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.864 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:43:24.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:43:24.866 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:43:24.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:43:24.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.878 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.0 2026-02-23T07:43:24.878 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.894 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:43:24.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:43:24.894 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:43:24.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:43:24.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.910 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:43:24.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:24.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:43:24.910 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:43:24.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:43:24.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:43:24.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:43:24.923 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:43:24.923 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:43:24.924 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:43:24.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:43:24.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:43:30.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:43:30.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:43:30.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:43:30.647 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:43:30.647 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:30.647 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:30.654 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:43:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:30.654 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:30.661 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:43:30.661 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:30.661 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:30.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:43:30.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832610671189874 2026-02-23T07:43:30.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:30.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:43:30.823 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-23T07:43:30.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:30.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:43:30.989 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:43:31.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:31.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:43:31.156 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-23T07:43:31.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:31.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:43:31.324 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:43:31.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:31.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:43:31.492 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:43:31.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:31.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:43:31.658 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:43:31.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:31.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:43:31.822 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:43:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:43:31.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:43:31.985 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:43:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:43:32.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:43:32.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:43:32.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832612166563663 2026-02-23T07:43:32.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1495 2026-02-23T07:43:32.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:43:32.231 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:43:32.232 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:32.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:32.238 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:43:32.238 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:32.238 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:32.245 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:43:32.245 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:43:32.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:32.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:43:37.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:33.088583+0000 20'6 33:84 [1,2,0] 1 [1,2,0] 1 20'6 2026-02-23T07:43:33.068007+0000 20'6 2026-02-23T07:43:33.068007+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:33.068007+0000 6 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:32.060519+0000 20'7 33:91 [1,0,2] 1 [1,0,2] 1 20'7 2026-02-23T07:43:32.023475+0000 20'7 2026-02-23T07:43:32.023475+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:32.023475+0000 7 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108864 0 0 16 0 16 active+clean 2026-02-23T07:43:31.544666+0000 20'16 33:105 [2,0,1] 2 [2,0,1] 2 20'16 2026-02-23T07:43:31.479051+0000 20'16 2026-02-23T07:43:31.479051+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:31.479051+0000 16 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165824 0 0 6 0 6 active+clean 2026-02-23T07:43:31.009651+0000 20'6 33:84 [1,0,2] 1 [1,0,2] 1 20'6 2026-02-23T07:43:31.002427+0000 20'6 2026-02-23T07:43:31.002427+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:31.002427+0000 6 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554432 0 0 8 0 8 active+clean 2026-02-23T07:43:35.113172+0000 20'8 33:94 [1,2,0] 1 [1,2,0] 1 20'8 2026-02-23T07:43:35.078041+0000 20'8 2026-02-23T07:43:35.078041+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:35.078041+0000 8 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360128 0 0 7 0 7 active+clean 2026-02-23T07:43:32.323756+0000 20'7 33:107 [0,1,2] 0 [0,1,2] 0 20'7 2026-02-23T07:43:32.282883+0000 20'7 2026-02-23T07:43:32.282883+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:32.282883+0000 7 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582912 0 0 3 0 3 active+clean 2026-02-23T07:43:32.448690+0000 20'3 33:79 [2,0,1] 2 [2,0,1] 2 20'3 2026-02-23T07:43:32.435081+0000 20'3 2026-02-23T07:43:32.435081+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:32.435081+0000 3 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137344 0 0 11 0 11 active+clean 2026-02-23T07:43:34.108774+0000 20'11 33:120 [1,0,2] 1 [1,0,2] 1 20'11 2026-02-23T07:43:34.046369+0000 20'11 2026-02-23T07:43:34.046369+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:43:34.046369+0000 11 0 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:43:37.407 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:43:37.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2 3 8 8 20 20 4194304 4194304 0 1495 2026-02-23T07:43:37.417 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj_2@ REPR 3 8 8 20/ 20 4194304 4194304/ 0 1495 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0743 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:43:37.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.518 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.519 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 4, 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.520 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.521 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.522 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.523 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 536870912 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.056997855, 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.028498927 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.529 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.530 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.531 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.532 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.533 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.534 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.535 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.536 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.537 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.538 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.539 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.540 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 4, 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.541 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.542 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.543 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.544 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "value": 536870912 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.545 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.546 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.056997855, 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.028498927 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.547 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.548 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:37.549 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.550 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.551 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.552 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:43:37.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:37.578 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 22, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.579 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.580 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.581 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 536870912 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.582 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.309989384, 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.030998938 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:37.583 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.584 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.585 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.586 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:37.587 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.588 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.589 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 22, 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:37.590 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.591 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.592 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "value": 536870912 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.593 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.309989384, 2026-02-23T07:43:37.594 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.030998938 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.595 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.596 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.598 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:43:37.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 10, 2026-02-23T07:43:37.651 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:37.652 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.653 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 536870912 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.654 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.149994355, 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.037498588 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.655 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.656 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.657 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.658 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:37.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.660 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.661 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 10, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:37.662 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.663 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 536870912 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.664 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.149994355, 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.037498588 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.665 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.666 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:37.667 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:37.669 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:37.670 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:37.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:43:37.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:45.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:43:45.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.024 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.025 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.026 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.027 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:46.028 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.029 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": 184 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": 184 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.030 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": 184 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": 184 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 184 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 771751936 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.033 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.084997723, 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.028332574 2026-02-23T07:43:46.034 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.035 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.036 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.037 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:46.038 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.039 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.040 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.044 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:46.045 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:46.046 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:46.047 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:46.048 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "value": 184 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.049 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "value": 184 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "value": 184 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "value": 184 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "value": 184 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "value": 771751936 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.051 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.084997723, 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.028332574 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:43:46.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:43:46.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.086 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 33, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.087 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.088 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:46.089 INFO:tasks.workunit.client.0.trial129.stderr: "value": 805306368 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.090 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 15, 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.464988655, 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.030999243 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.091 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:43:46.092 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.093 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.094 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.095 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.096 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.097 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 33, 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.098 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.099 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.100 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "value": 805306368 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.101 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 15, 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.464988655, 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.030999243 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.103 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.104 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.105 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.106 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.107 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:43:46.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:43:46.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:43:46.163 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:46.163 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.163 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 15, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.164 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:43:46.165 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:46.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 805306368 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:43:46.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.221994018, 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.036999003 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:46.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.170 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.173 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 15, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.174 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:43:46.175 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:43:46.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 805306368 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:43:46.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.221994018, 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.036999003 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:43:46.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:43:46.184 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:43:46.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:43:46.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:43:59.330 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:43:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:43:59.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:43:59.534 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:43:59.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:43:59.737 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:43:59.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:43:59.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 4194300 4 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=4194300 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:43:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832639751598343 2026-02-23T07:43:59.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 4194300 2026-02-23T07:43:59.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=4194300 2026-02-23T07:43:59.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:43:59.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.u4ISlmIzfk bs=4194300 count=1 2026-02-23T07:43:59.763 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:43:59.763 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:43:59.763 INFO:tasks.workunit.client.0.trial129.stderr:4194300 bytes (4.2 MB, 4.0 MiB) copied, 0.00950612 s, 441 MB/s 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:43:59.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:43:59.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:43:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:43:59.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:43:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:44:00.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:44:00.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:44:00.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:44:00.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.u4ISlmIzfk 2026-02-23T07:44:00.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:44:00.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832640667225441 2026-02-23T07:44:00.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=915 2026-02-23T07:44:00.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 915 ms' 2026-02-23T07:44:00.668 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 64 objects in pool test in 915 ms 2026-02-23T07:44:00.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:44:00.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:44:00.668380988' 2026-02-23T07:44:00.669 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:44:00.668380988 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:44:00.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:44:00.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:44:00.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:44:00.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:44:00.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:44:00.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:44:00.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:44:00.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:44:00.909 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:44:00.909 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:44:00.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:44:00.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:44:00.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:44:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T07:44:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T07:44:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T07:44:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:44:00.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:44:01.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672973 2026-02-23T07:44:01.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672973 2026-02-23T07:44:01.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973' 2026-02-23T07:44:01.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:44:01.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:44:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-23T07:44:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-23T07:44:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-60129542154' 2026-02-23T07:44:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:44:01.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T07:44:01.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:44:01.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:44:01.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T07:44:01.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:44:01.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T07:44:01.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T07:44:01.132 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836495 2026-02-23T07:44:01.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:44:01.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:44:01.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:44:02.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:44:02.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:44:02.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:44:02.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:44:03.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:44:03.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:44:03.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T07:44:03.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:44:03.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672973 2026-02-23T07:44:03.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:44:03.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:44:03.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672973 2026-02-23T07:44:03.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:44:03.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672973 2026-02-23T07:44:03.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2026-02-23T07:44:03.634 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672973 2026-02-23T07:44:03.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:44:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672974 -lt 42949672973 2026-02-23T07:44:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:44:03.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-23T07:44:03.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:44:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:44:03.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-23T07:44:03.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:44:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-23T07:44:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-23T07:44:03.806 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542154 2026-02-23T07:44:03.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:44:03.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542154 2026-02-23T07:44:03.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:44:03.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:44:03.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:44:04.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T07:44:04.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:44:04.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:44:04.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:44:04.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:44:04.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:44:04.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:44:04.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:44:04.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T07:44:04.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:44:04.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:44:04.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:44:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T07:44:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:44:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:44:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:44:04.694 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:44:04.694 INFO:tasks.workunit.client.0.trial129.stdout: client io 44 MiB/s wr, 0 op/s rd, 10 op/s wr 2026-02-23T07:44:04.694 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:44:04.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:44:04.706 INFO:tasks.workunit.client.0.trial129.stdout:Setting osd_deep_scrub_stride to 4194304 2026-02-23T07:44:04.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:423: corrupt_and_measure: echo 'Setting osd_deep_scrub_stride to 4194304' 2026-02-23T07:44:04.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:424: corrupt_and_measure: ceph tell 'osd.*' config set osd_deep_scrub_stride 4194304 2026-02-23T07:44:04.772 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:04.772 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-23T07:44:04.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:04.779 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:04.779 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-23T07:44:04.779 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:04.786 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:04.786 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-23T07:44:04.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:04.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:44:09.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:44:09.950 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:43:53.383390+0000 20'6 20:25 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:43:53.383373+0000 20'7 20:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-23T07:43:53.382914+0000 20'16 20:37 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:43:53.383382+0000 20'6 20:26 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-23T07:43:53.383596+0000 20'8 20:28 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:43:53.383138+0000 20'7 20:27 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-23T07:43:53.382978+0000 20'3 20:26 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-23T07:43:53.383408+0000 20'11 20:33 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:09.951 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:44:09.952 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:44:09.952 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:44:09.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:09.961 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:44:09.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:44:09.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:44:09.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:44:10.033 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:44:10.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:44:10.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:44:10.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:44:10.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:44:10.110 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:44:10.109955870 2026-02-23T07:44:10.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:44:10.109955870' 2026-02-23T07:44:10.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832650110978027 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:44:10.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:44:10.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-23T07:44:10.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:44:10.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:44:10.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:44:10.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:44:10.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:44:11.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:44:11.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832651152323417 2026-02-23T07:44:11.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:44:11.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:44:11.153454588 (1041 ms)' 2026-02-23T07:44:11.154 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:44:11.153454588 (1041 ms) 2026-02-23T07:44:11.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=40 2026-02-23T07:44:11.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:44:11.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 40 2026-02-23T07:44:11.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:44:11.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.156 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 40 2026-02-23T07:44:11.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 40' 2026-02-23T07:44:11.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.157 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj16 2026-02-23T07:44:11.157 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 64 2026-02-23T07:44:11.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj16' 2026-02-23T07:44:11.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-23T07:44:11.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:44:11.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:44:11.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:44:11.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.159 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj16 2026-02-23T07:44:11.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj16' 2026-02-23T07:44:11.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj16 2026-02-23T07:44:11.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:44:11.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj16 ' 2026-02-23T07:44:11.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.161 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj58 2026-02-23T07:44:11.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj58' 2026-02-23T07:44:11.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj58 2026-02-23T07:44:11.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj58 ' 2026-02-23T07:44:11.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj49' 2026-02-23T07:44:11.163 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj49 2026-02-23T07:44:11.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj49 2026-02-23T07:44:11.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj49 ' 2026-02-23T07:44:11.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.165 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj63 2026-02-23T07:44:11.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj63' 2026-02-23T07:44:11.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj63 2026-02-23T07:44:11.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj63 ' 2026-02-23T07:44:11.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.167 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj48 2026-02-23T07:44:11.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj48' 2026-02-23T07:44:11.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj48 2026-02-23T07:44:11.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj48 ' 2026-02-23T07:44:11.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.168 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj45 2026-02-23T07:44:11.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj45' 2026-02-23T07:44:11.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj45 2026-02-23T07:44:11.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj45 ' 2026-02-23T07:44:11.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.170 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj43 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj43' 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj43 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj43 ' 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.172 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj46 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj46' 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj46 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj46 ' 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.173 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj56 2026-02-23T07:44:11.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj56' 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj56 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj56 ' 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj2' 2026-02-23T07:44:11.175 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj2 2026-02-23T07:44:11.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj2 2026-02-23T07:44:11.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj2 ' 2026-02-23T07:44:11.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.177 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj51 2026-02-23T07:44:11.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj51' 2026-02-23T07:44:11.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj51 2026-02-23T07:44:11.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:44:11.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj51 ' 2026-02-23T07:44:11.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.179 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj62 2026-02-23T07:44:11.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj62' 2026-02-23T07:44:11.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj62 2026-02-23T07:44:11.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj62 ' 2026-02-23T07:44:11.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.181 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj26 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj26' 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj26 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj26 ' 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.183 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj4 2026-02-23T07:44:11.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj4' 2026-02-23T07:44:11.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj4 2026-02-23T07:44:11.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj4 ' 2026-02-23T07:44:11.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.184 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1 2026-02-23T07:44:11.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1' 2026-02-23T07:44:11.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1 2026-02-23T07:44:11.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1 ' 2026-02-23T07:44:11.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.186 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj35 2026-02-23T07:44:11.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj35' 2026-02-23T07:44:11.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj35 2026-02-23T07:44:11.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:44:11.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj35 ' 2026-02-23T07:44:11.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.188 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj7 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj7' 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj7 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj7 ' 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.189 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj27 2026-02-23T07:44:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj27' 2026-02-23T07:44:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj27 2026-02-23T07:44:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj27 ' 2026-02-23T07:44:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj47' 2026-02-23T07:44:11.191 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj47 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj47 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj47 ' 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.192 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj17 2026-02-23T07:44:11.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj17' 2026-02-23T07:44:11.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj17 2026-02-23T07:44:11.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:44:11.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj17 ' 2026-02-23T07:44:11.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=20 )) 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj13 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stdout:Object obj13: acting: 2 0 1 2026-02-23T07:44:11.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj13: acting: 2 0 1' 2026-02-23T07:44:11.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:44:11.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.195 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:44:11.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.196 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj13 (20) 0 1 2 2026-02-23T07:44:11.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj13 (20) 0 1 2' 2026-02-23T07:44:11.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.196 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj13 2026-02-23T07:44:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj13' 2026-02-23T07:44:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj13 ' 2026-02-23T07:44:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj14 2026-02-23T07:44:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj14: acting: 1 2 0' 2026-02-23T07:44:11.198 INFO:tasks.workunit.client.0.trial129.stdout:Object obj14: acting: 1 2 0 2026-02-23T07:44:11.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:44:11.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.199 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:44:11.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.199 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj14 (21) 2 0 1 2026-02-23T07:44:11.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj14 (21) 2 0 1' 2026-02-23T07:44:11.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.200 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj14 2026-02-23T07:44:11.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj14' 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj14 ' 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj61 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stdout:Object obj61: acting: 1 0 2 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj61: acting: 1 0 2' 2026-02-23T07:44:11.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj61 (22) 0 2 1' 2026-02-23T07:44:11.202 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj61 (22) 0 2 1 2026-02-23T07:44:11.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.203 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj61 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj61' 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj61 ' 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj23 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stdout:Object obj23: acting: 1 0 2 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj23: acting: 1 0 2' 2026-02-23T07:44:11.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj23 (23) 0 2 1' 2026-02-23T07:44:11.205 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj23 (23) 0 2 1 2026-02-23T07:44:11.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:44:11.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.206 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj23 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj23' 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj23 ' 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj41 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stdout:Object obj41: acting: 2 0 1 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj41: acting: 2 0 1' 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:44:11.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.208 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:44:11.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj41 (24) 0 1 2' 2026-02-23T07:44:11.208 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj41 (24) 0 1 2 2026-02-23T07:44:11.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.209 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj41 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj41' 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj41 ' 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj34 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj34: acting: 1 2 0' 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stdout:Object obj34: acting: 1 2 0 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:44:11.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj34 (25) 2 0 1 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj34 (25) 2 0 1' 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj34 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj34' 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj34 ' 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj21 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj21: acting: 1 0 2' 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stdout:Object obj21: acting: 1 0 2 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj21 (26) 0 2 1 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj21 (26) 0 2 1' 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj21' 2026-02-23T07:44:11.214 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj21 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj21 ' 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj8 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj8: acting: 2 0 1' 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stdout:Object obj8: acting: 2 0 1 2026-02-23T07:44:11.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj8 (27) 0 1 2' 2026-02-23T07:44:11.216 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj8 (27) 0 1 2 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj8' 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj8 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj8 ' 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj12 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.217 INFO:tasks.workunit.client.0.trial129.stdout:Object obj12: acting: 2 0 1 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj12: acting: 2 0 1' 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj12 (28) 0 1 2 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj12 (28) 0 1 2' 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj12' 2026-02-23T07:44:11.219 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj12 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj12 ' 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj50 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj50: acting: 1 0 2' 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stdout:Object obj50: acting: 1 0 2 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.220 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj50 (29) 0 2 1' 2026-02-23T07:44:11.221 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj50 (29) 0 2 1 2026-02-23T07:44:11.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj50 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj50' 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj50 ' 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj25 2026-02-23T07:44:11.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj25: acting: 1 0 2' 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stdout:Object obj25: acting: 1 0 2 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj25 (30) 0 2 1' 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj25 (30) 0 2 1 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj25' 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj25 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj25 ' 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj5 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj5: acting: 1 2 0' 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stdout:Object obj5: acting: 1 2 0 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj5 (31) 2 0 1' 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj5 (31) 2 0 1 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj5 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj5' 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj5 ' 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj38 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj38: acting: 0 1 2' 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stdout:Object obj38: acting: 0 1 2 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj38 (32) 1 2 0' 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj38 (32) 1 2 0 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj38 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj38' 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj38 ' 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj32 2026-02-23T07:44:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stdout:Object obj32: acting: 1 2 0 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj32: acting: 1 2 0' 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj32 (33) 2 0 1' 2026-02-23T07:44:11.229 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj32 (33) 2 0 1 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj32 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj32' 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj32 ' 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj15 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.230 INFO:tasks.workunit.client.0.trial129.stdout:Object obj15: acting: 2 0 1 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj15: acting: 2 0 1' 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj15 (34) 0 1 2' 2026-02-23T07:44:11.231 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj15 (34) 0 1 2 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj15 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj15' 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj15 ' 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj44 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stdout:Object obj44: acting: 0 1 2 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj44: acting: 0 1 2' 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj44 (35) 1 2 0' 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj44 (35) 1 2 0 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.233 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj44 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj44' 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj44 ' 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj52 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stdout:Object obj52: acting: 2 0 1 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj52: acting: 2 0 1' 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj52 (36) 0 1 2' 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj52 (36) 0 1 2 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj52 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj52' 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj52 ' 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj64 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.235 INFO:tasks.workunit.client.0.trial129.stdout:Object obj64: acting: 0 1 2 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj64: acting: 0 1 2' 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj64 (37) 1 2 0' 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj64 (37) 1 2 0 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.236 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj64 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj64' 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj64 ' 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj39 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stdout:Object obj39: acting: 1 0 2 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj39: acting: 1 0 2' 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.237 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj39 (38) 0 2 1' 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj39 (38) 0 2 1 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj39' 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj39 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj39 ' 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj60 2026-02-23T07:44:11.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stdout:Object obj60: acting: 1 0 2 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj60: acting: 1 0 2' 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj60 (39) 0 2 1' 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj60 (39) 0 2 1 2026-02-23T07:44:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj60 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj60' 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj60 ' 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:44:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:44:11.252 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:11.252 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:44:11.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:11.259 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:11.259 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:44:11.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:11.266 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:11.266 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:44:11.267 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:11.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:44:11.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:44:11.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:44:11.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:44:11.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:44:11.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:44:11.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:44:11.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:44:12.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:44:12.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:44:12.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj16 obj56 ' 2026-02-23T07:44:12.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:44:12.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:12.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:12.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:44:12.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj16 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj16 2026-02-23T07:44:12.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj16 rm-attr _ 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:12.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:12.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:12.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:12.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:12.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj56 2026-02-23T07:44:12.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:12.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:12.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj56 2026-02-23T07:44:12.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj56 rm-attr _ 2026-02-23T07:44:12.893 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:12.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj13 obj14 obj61 obj41 obj34 obj21 obj12 obj25 obj5 obj32 obj15 obj52 obj39 ' obj_to_pgid delete_oi 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj13 obj14 obj61 obj41 obj34 obj21 obj12 obj25 obj5 obj32 obj15 obj52 obj39 ' 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj13 obj14 obj61 obj41 obj34 obj21 obj12 obj25 obj5 obj32 obj15 obj52 obj39 ]] 2026-02-23T07:44:12.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:44:12.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj13 obj14 obj61 obj41 obj34 obj21 obj12 obj25 obj5 obj32 obj15 obj52 obj39 ' 2026-02-23T07:44:12.954 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj13 obj14 obj61 obj41 obj34 obj21 obj12 obj25 obj5 obj32 obj15 obj52 obj39 2026-02-23T07:44:12.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:44:12.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:12.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:12.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:12.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj13 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj13 2026-02-23T07:44:12.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj13 rm-attr _ 2026-02-23T07:44:13.082 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:13.082 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:13.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:13.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:13.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:13.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:44:13.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:44:13.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:13.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj14 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj14 2026-02-23T07:44:13.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj14 rm-attr _ 2026-02-23T07:44:13.255 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:13.255 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:13.255 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:13.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:13.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:13.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:13.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:13.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:13.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:13.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:13.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:13.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:13.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj61 2026-02-23T07:44:13.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:13.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:13.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj61 2026-02-23T07:44:13.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj61 rm-attr _ 2026-02-23T07:44:13.452 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:13.453 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:13.453 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:13.453 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:13.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:13.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:13.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:13.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:13.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:13.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:13.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:13.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:13.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj41 2026-02-23T07:44:13.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:13.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:13.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj41 2026-02-23T07:44:13.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj41 rm-attr _ 2026-02-23T07:44:13.617 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:13.617 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:13.617 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:13.617 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:13.618 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:44:13.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:13.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj34 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj34 2026-02-23T07:44:13.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj34 rm-attr _ 2026-02-23T07:44:13.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:13.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:13.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:13.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:13.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:13.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:13.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj21 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj21 2026-02-23T07:44:13.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj21 rm-attr _ 2026-02-23T07:44:13.978 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:13.978 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:13.979 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:13.979 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:13.979 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:13.979 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:13.979 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:14.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:14.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:14.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:14.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:14.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:14.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:14.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj12 2026-02-23T07:44:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:14.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:14.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj12 2026-02-23T07:44:14.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj12 rm-attr _ 2026-02-23T07:44:14.145 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:14.146 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:14.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:14.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj25 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj25 2026-02-23T07:44:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj25 rm-attr _ 2026-02-23T07:44:14.338 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:14.338 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:14.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:14.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:14.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:14.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:14.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:44:14.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:44:14.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:14.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj5 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj5 2026-02-23T07:44:14.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj5 rm-attr _ 2026-02-23T07:44:14.517 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:44:14.517 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:14.517 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:14.517 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:44:14.517 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:14.517 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:14.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:14.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:14.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:14.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:14.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:14.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:14.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:14.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:14.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj32 2026-02-23T07:44:14.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:14.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:14.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj32 2026-02-23T07:44:14.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj32 rm-attr _ 2026-02-23T07:44:14.696 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:14.697 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:14.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:14.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:14.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:14.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:14.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:14.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:14.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:14.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:14.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj15 2026-02-23T07:44:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-23T07:44:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj15 rm-attr _ 2026-02-23T07:44:14.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:44:14.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:14.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:14.878 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:14.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:14.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:14.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:14.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:14.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:14.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:14.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:14.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:14.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:14.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:14.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj52 2026-02-23T07:44:14.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:14.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:14.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj52 2026-02-23T07:44:14.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj52 rm-attr _ 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:15.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:15.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:15.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:15.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:15.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:44:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:44:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj39 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:44:15.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj39 2026-02-23T07:44:15.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj39 rm-attr _ 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7109478f:::obj25:head#, (61) No data available 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a383681b:::obj41:head#, (61) No data available 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bdc5b82e:::obj52:head#, (61) No data available 2026-02-23T07:44:15.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c52c9666:::obj5:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cb843a8e:::obj34:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e0a44829:::obj14:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4987b93a:::obj56:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:44:15.235 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:44:15.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:15.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:15.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:44:15.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:44:15.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:44:15.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj58 obj49 obj63 obj48 obj45 obj43 obj46 obj2 obj62 obj26 obj4 obj1 obj27 obj47 obj17 ' 2026-02-23T07:44:15.289 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj58 obj49 obj63 obj48 obj45 obj43 obj46 obj2 obj62 obj26 obj4 obj1 obj27 obj47 obj17 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:15.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:15.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:15.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:15.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj58 2026-02-23T07:44:15.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:15.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:15.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj58 2026-02-23T07:44:15.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj58 rm-attr _ 2026-02-23T07:44:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:44:15.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:44:15.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:15.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj49 2026-02-23T07:44:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:15.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj49 2026-02-23T07:44:15.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj49 rm-attr _ 2026-02-23T07:44:15.574 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:15.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:15.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:15.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:15.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:15.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:15.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:15.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj63 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-23T07:44:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj63 rm-attr _ 2026-02-23T07:44:15.762 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:15.762 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:15.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:15.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:15.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:15.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:15.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj48 2026-02-23T07:44:15.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:15.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:15.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj48 2026-02-23T07:44:15.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj48 rm-attr _ 2026-02-23T07:44:15.929 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:15.929 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:15.930 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:15.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:15.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:15.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:15.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:44:15.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:44:15.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:15.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:15.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:15.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:15.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:15.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj45 2026-02-23T07:44:15.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:15.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:15.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj45 2026-02-23T07:44:15.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj45 rm-attr _ 2026-02-23T07:44:16.108 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:16.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:16.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:16.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:16.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:16.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:16.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:16.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:16.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:16.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:16.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:16.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:16.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:16.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj43 2026-02-23T07:44:16.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:16.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:16.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj43 2026-02-23T07:44:16.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj43 rm-attr _ 2026-02-23T07:44:16.270 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:16.270 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:16.271 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:16.271 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:16.271 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:16.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:16.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:16.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:16.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:44:16.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:44:16.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:16.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:16.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:16.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:16.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj46 2026-02-23T07:44:16.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:16.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:16.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj46 2026-02-23T07:44:16.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj46 rm-attr _ 2026-02-23T07:44:16.449 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:16.450 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:16.450 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:16.450 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:16.450 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:16.450 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:16.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:16.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:16.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:16.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:16.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:16.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:16.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:16.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:16.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:16.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj2 2026-02-23T07:44:16.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:16.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:16.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-23T07:44:16.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj2 rm-attr _ 2026-02-23T07:44:16.633 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:16.633 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:16.633 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:16.634 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:16.634 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:16.634 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:16.634 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:16.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:16.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:16.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:16.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:16.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:16.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:16.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj62 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:16.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj62 2026-02-23T07:44:16.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj62 rm-attr _ 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:16.801 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:16.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:16.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj26 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-23T07:44:16.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj26 rm-attr _ 2026-02-23T07:44:16.988 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:16.988 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:16.988 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:16.988 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:16.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:16.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:16.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:16.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:16.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:17.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:17.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:17.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:17.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:17.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:17.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:17.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj4 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:17.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj4 2026-02-23T07:44:17.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj4 rm-attr _ 2026-02-23T07:44:17.163 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:17.163 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:17.164 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:17.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:17.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:17.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:17.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:44:17.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:44:17.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:17.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:17.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:17.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:17.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1 2026-02-23T07:44:17.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:17.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1 2026-02-23T07:44:17.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1 rm-attr _ 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:17.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:17.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj27 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj27 2026-02-23T07:44:17.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj27 rm-attr _ 2026-02-23T07:44:17.483 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:17.483 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:17.483 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:17.483 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:17.484 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:17.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:17.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:17.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:17.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:17.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:17.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:17.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj47 2026-02-23T07:44:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:17.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj47 2026-02-23T07:44:17.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj47 rm-attr _ 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:17.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:17.648 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:44:17.648 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:17.648 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:17.648 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:17.648 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:17.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:17.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:17.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:17.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:44:17.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:44:17.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:17.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:17.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:17.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:17.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj17 2026-02-23T07:44:17.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:17.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj17 2026-02-23T07:44:17.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj17 rm-attr _ 2026-02-23T07:44:17.832 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:17.832 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:17.833 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:17.834 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:44:17.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj8 obj38 ' obj_to_pgid delete_oi 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj8 obj38 ' 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:44:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj8 obj38 ]] 2026-02-23T07:44:17.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:44:17.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj8 obj38 ' 2026-02-23T07:44:17.879 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj8 obj38 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj8 2026-02-23T07:44:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj8 2026-02-23T07:44:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj8 rm-attr _ 2026-02-23T07:44:18.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:18.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:18.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:18.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:18.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj38 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj38 2026-02-23T07:44:18.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj38 rm-attr _ 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6dc7b1fd:::obj49:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a557efb1:::obj8:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24fc6e92:::obj17:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0ee9ae15:::obj4:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:44:18.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:11a85aa0:::obj43:head#, (61) No data available 2026-02-23T07:44:18.172 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:44:18.172 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:44:18.172 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:44:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:44:18.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:44:18.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:44:18.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj51 obj35 obj7 ' 2026-02-23T07:44:18.232 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj51 obj35 obj7 2026-02-23T07:44:18.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:44:18.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:18.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:18.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj51 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj51 2026-02-23T07:44:18.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj51 rm-attr _ 2026-02-23T07:44:18.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:18.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj35 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj35 2026-02-23T07:44:18.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj35 rm-attr _ 2026-02-23T07:44:18.520 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:18.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:18.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:18.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj7 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-23T07:44:18.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj7 rm-attr _ 2026-02-23T07:44:18.712 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:44:18.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj23 obj50 obj44 obj64 obj60 ' obj_to_pgid delete_oi 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:44:18.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj23 obj50 obj44 obj64 obj60 ' 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj23 obj50 obj44 obj64 obj60 ]] 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj23 obj50 obj44 obj64 obj60 ' 2026-02-23T07:44:18.771 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj23 obj50 obj44 obj64 obj60 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:18.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj23 2026-02-23T07:44:18.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:18.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj23 2026-02-23T07:44:18.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj23 rm-attr _ 2026-02-23T07:44:18.892 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:44:18.892 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:18.892 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:44:18.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:18.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:18.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:18.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:44:18.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:44:18.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:18.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:18.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:18.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:18.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:18.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj50 2026-02-23T07:44:18.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:18.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:18.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj50 2026-02-23T07:44:18.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj50 rm-attr _ 2026-02-23T07:44:19.051 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:44:19.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:19.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:44:19.052 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:44:19.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:19.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:19.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:19.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:19.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:44:19.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:44:19.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:19.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:19.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:19.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:19.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:19.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj44 2026-02-23T07:44:19.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:19.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:19.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj44 2026-02-23T07:44:19.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj44 rm-attr _ 2026-02-23T07:44:19.213 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:44:19.213 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:44:19.213 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:19.213 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:44:19.213 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:44:19.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:19.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:19.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:19.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:19.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:44:19.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:44:19.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:19.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:19.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:19.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:19.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:19.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj64 2026-02-23T07:44:19.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:19.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:19.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj64 2026-02-23T07:44:19.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj64 rm-attr _ 2026-02-23T07:44:19.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:44:19.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:44:19.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:19.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:44:19.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:44:19.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:44:19.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj60 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:44:19.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-23T07:44:19.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj60 rm-attr _ 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:699d4764:::obj50:head#, (61) No data available 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af44a1d6:::obj35:head#, (61) No data available 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:beac82f5:::obj51:head#, (61) No data available 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:44:19.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:44:19.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:44:19.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:44:19.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:44:19.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:44:19.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:44:30.743 INFO:tasks.workunit.client.0.trial129.stdout:Setting osd_deep_scrub_stride to 4194304 2026-02-23T07:44:30.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:516: corrupt_and_measure: echo 'Setting osd_deep_scrub_stride to 4194304' 2026-02-23T07:44:30.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:517: corrupt_and_measure: ceph tell 'osd.*' config set osd_deep_scrub_stride 4194304 2026-02-23T07:44:30.807 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:30.807 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-23T07:44:30.807 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:30.814 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:30.815 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-23T07:44:30.815 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:30.822 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:30.822 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_stride = '' (not observed, change may require restart) " 2026-02-23T07:44:30.822 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:30.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:44:35.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:44:35.989 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:44:35.989 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:23.431637+0000 20'6 32:48 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.989 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:44:23.431548+0000 20'7 32:49 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.989 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-23T07:44:23.430886+0000 20'16 32:53 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.989 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:23.431680+0000 20'6 32:49 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.990 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-23T07:44:23.431305+0000 20'8 32:52 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.990 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:44:23.430827+0000 20'7 32:64 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.990 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-23T07:44:23.430701+0000 20'3 32:44 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.990 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-23T07:44:23.431337+0000 20'11 32:61 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:35.990 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:44:35.990 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:44:35.991 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:44:36.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:36.000 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:44:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:44:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:44:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:44:36.077 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:44:36.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:44:36.145 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:36.145 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:44:36.146 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:36.153 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:36.153 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:44:36.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:36.160 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:36.160 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:44:36.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:36.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:44:37.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:44:37.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832677172333284 2026-02-23T07:44:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:44:37.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:44:37.174098725' 2026-02-23T07:44:37.175 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:44:37.174098725 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:44:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:44:37.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:44:37.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:44:37.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:44:37.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:44:37.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:44:37.331 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:44:37.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:44:37.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832677346346279 2026-02-23T07:44:37.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:44:37.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:44:37.347599769 (174 ms)' 2026-02-23T07:44:37.347 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:44:37.347599769 (174 ms) 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-23T07:44:37.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:44:37.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:44:37.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:44:37.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:44:37.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:44:37.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:44:37.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:44:37.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:44:37.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:44:37.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:44:37.661 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:23.431637+0000 20'6 32:48 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:44:23.431548+0000 20'7 32:49 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-23T07:44:23.430886+0000 20'16 32:53 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:23.431680+0000 20'6 32:50 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-23T07:44:23.431305+0000 20'8 32:52 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:44:23.430827+0000 20'7 32:64 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-23T07:44:23.430701+0000 20'3 32:45 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-23T07:44:23.431337+0000 20'11 32:62 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:44:37.662 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:44:37.663 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:44:37.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:44:37.737 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:37.737 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:37.737 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:37.744 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:37.744 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:37.744 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:37.751 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:37.751 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:37.751 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:37.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:44:37.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832677760441866 2026-02-23T07:44:37.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:37.761 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:44:37.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:44:37.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:44:37.824 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:37.824 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:37.824 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:37.824 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:37.824 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:37.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:37.832 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:44:37.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:44:37.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:44:37.894 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:37.895 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:37.895 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:37.895 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:37.895 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:37.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:37.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:44:37.903 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:44:37.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:44:37.965 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:37.965 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:37.965 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:37.965 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:37.965 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:37.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:37.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:37.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:44:37.973 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:44:37.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:44:38.035 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:38.036 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:38.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:38.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:44:38.044 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:44:38.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:44:38.105 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:38.105 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:38.105 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:38.105 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:38.105 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:38.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:38.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:44:38.114 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:44:38.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:44:38.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:38.178 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:38.178 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:38.178 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:38.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:38.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:38.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:44:38.186 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:44:38.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:44:38.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:38.251 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:38.251 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:38.251 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:38.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:38.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:44:38.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:44:38.260 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:44:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:44:38.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:38.322 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:44:38.322 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:44:38.322 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:44:38.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:44:38.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:44:38.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:44:38.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:44:38.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832678496814815 2026-02-23T07:44:38.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=736 2026-02-23T07:44:38.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:44:38.560 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:38.560 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:38.560 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.567 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:38.567 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:38.567 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.574 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:38.574 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:38.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:38.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:44:40.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:23.431637+0000 20'6 32:49 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean+scrubbing+deep 2026-02-23T07:44:39.749606+0000 20'7 32:54 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 deep scrubbing for 1s 0 0 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean+inconsistent 2026-02-23T07:44:38.252608+0000 20'16 32:66 [2,0,1] 2 [2,0,1] 2 20'16 2026-02-23T07:44:38.252578+0000 20'16 2026-02-23T07:44:38.252578+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:38.252578+0000 16 0 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean+inconsistent 2026-02-23T07:44:38.780248+0000 20'6 32:60 [1,0,2] 1 [1,0,2] 1 20'6 2026-02-23T07:44:38.780219+0000 20'6 2026-02-23T07:44:38.780219+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:38.780219+0000 6 0 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-23T07:44:23.431305+0000 20'8 32:53 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:43:53.277120+0000 0 0 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean+inconsistent 2026-02-23T07:44:39.180377+0000 20'7 32:74 [0,1,2] 0 [0,1,2] 0 20'7 2026-02-23T07:44:39.180336+0000 20'7 2026-02-23T07:44:39.180336+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:39.180336+0000 7 0 2026-02-23T07:44:40.737 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean+inconsistent 2026-02-23T07:44:39.218180+0000 20'3 32:55 [2,0,1] 2 [2,0,1] 2 20'3 2026-02-23T07:44:39.218154+0000 20'3 2026-02-23T07:44:39.218154+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:39.218154+0000 3 0 2026-02-23T07:44:40.738 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-23T07:44:23.431337+0000 20'11 32:65 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:43:53.277120+0000 0'0 2026-02-23T07:43:53.277120+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:44:40.738 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:44:40.738 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:44:40.738 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:44:40.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2b 3 8 8 20 20 4194300 4194304 4194304 736 2026-02-23T07:44:40.749 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj_2b@ NAUT 3 8 8 20/ 20 4194300 4194304/4194304 736 2026-02-23T07:44:40.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.750 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:44:40.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:44:40.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:44:40.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.763 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:44:40.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.764 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:44:40.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:44:40.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:44:40.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.778 INFO:tasks.workunit.client.0.trial129.stdout:1173 2026-02-23T07:44:40.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.779 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:44:40.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:44:40.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:44:40.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.794 INFO:tasks.workunit.client.0.trial129.stdout:589 2026-02-23T07:44:40.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.795 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:44:40.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:44:40.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:44:40.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.809 INFO:tasks.workunit.client.0.trial129.stdout:589 2026-02-23T07:44:40.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:44:40.810 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:44:40.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:44:40.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.822 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.0 2026-02-23T07:44:40.823 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:44:40.824 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:44:40.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:44:40.824 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:44:40.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:44:40.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.838 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:44:40.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:44:40.839 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:44:40.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:44:40.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.854 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:44:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:40.855 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:44:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:44:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:44:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:44:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:44:40.868 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:44:40.868 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:44:40.869 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:44:40.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:44:40.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:44:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:44:46.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:44:46.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:44:46.596 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:46.597 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:46.597 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:46.603 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:46.603 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:46.603 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:46.610 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:46.611 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:46.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:46.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:44:46.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832686619612391 2026-02-23T07:44:46.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:46.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:44:46.770 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-23T07:44:46.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:46.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:44:46.936 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:44:46.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:46.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:44:47.099 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-23T07:44:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:44:47.265 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:44:47.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:47.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:44:47.427 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:44:47.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:47.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:44:47.593 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:44:47.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:47.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:44:47.759 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:44:47.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:44:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:44:47.923 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:44:47.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:44:48.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:44:48.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:44:48.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832688096234036 2026-02-23T07:44:48.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1476 2026-02-23T07:44:48.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:44:48.166 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:44:48.167 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:48.167 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:48.173 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:44:48.173 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:48.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:48.181 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:44:48.181 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:44:48.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:48.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:44:53.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:44:53.347 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:44:53.347 INFO:tasks.workunit.client.0.trial129.stdout:1.7 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:49.726383+0000 20'6 32:81 [1,2,0] 1 [1,2,0] 1 20'6 2026-02-23T07:44:49.696862+0000 20'6 2026-02-23T07:44:49.696862+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:49.696862+0000 6 0 2026-02-23T07:44:53.347 INFO:tasks.workunit.client.0.trial129.stdout:1.6 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:44:48.758818+0000 20'7 32:83 [1,0,2] 1 [1,0,2] 1 20'7 2026-02-23T07:44:48.730189+0000 20'7 2026-02-23T07:44:48.730189+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:48.730189+0000 7 0 2026-02-23T07:44:53.347 INFO:tasks.workunit.client.0.trial129.stdout:1.5 16 0 0 0 0 67108800 0 0 16 0 16 active+clean 2026-02-23T07:44:47.277102+0000 20'16 32:100 [2,0,1] 2 [2,0,1] 2 20'16 2026-02-23T07:44:47.218413+0000 20'16 2026-02-23T07:44:47.218413+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:47.218413+0000 16 0 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout:1.4 6 0 0 0 0 25165800 0 0 6 0 6 active+clean 2026-02-23T07:44:47.758268+0000 20'6 32:82 [1,0,2] 1 [1,0,2] 1 20'6 2026-02-23T07:44:47.737245+0000 20'6 2026-02-23T07:44:47.737245+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:47.737245+0000 6 0 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout:1.3 8 0 0 0 0 33554400 0 0 8 0 8 active+clean 2026-02-23T07:44:51.718135+0000 20'8 32:89 [1,2,0] 1 [1,2,0] 1 20'8 2026-02-23T07:44:51.682651+0000 20'8 2026-02-23T07:44:51.682651+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:51.682651+0000 8 0 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout:1.2 7 0 0 0 0 29360100 0 0 7 0 7 active+clean 2026-02-23T07:44:48.155945+0000 20'7 32:102 [0,1,2] 0 [0,1,2] 0 20'7 2026-02-23T07:44:48.115077+0000 20'7 2026-02-23T07:44:48.115077+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:48.115077+0000 7 0 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout:1.1 3 0 0 0 0 12582900 0 0 3 0 3 active+clean 2026-02-23T07:44:48.163627+0000 20'3 32:75 [2,0,1] 2 [2,0,1] 2 20'3 2026-02-23T07:44:48.151308+0000 20'3 2026-02-23T07:44:48.151308+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:48.151308+0000 3 0 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout:1.0 11 0 0 0 0 46137300 0 0 11 0 11 active+clean 2026-02-23T07:44:50.791470+0000 20'11 32:117 [1,0,2] 1 [1,0,2] 1 20'11 2026-02-23T07:44:50.723680+0000 20'11 2026-02-23T07:44:50.723680+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:44:50.723680+0000 11 0 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:44:53.348 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:44:53.349 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:44:53.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_2b 3 8 8 20 20 4194300 4194304 4194304 1476 2026-02-23T07:44:53.358 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj_2b@ REPR 3 8 8 20/ 20 4194300 4194304/4194304 1476 2026-02-23T07:44:53.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:44:53.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0744 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:44:53.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:44:53.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:44:53.459 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:44:53.459 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.459 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.459 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.460 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:44:53.461 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 4, 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.462 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:44:53.463 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.464 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.465 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.466 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.467 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:44:53.468 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.469 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr: "value": 536870400 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:44:53.470 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.471 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:44:53.472 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:44:53.473 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.058999721, 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.029499860 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.474 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.475 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.476 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:44:53.477 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.478 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.479 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.480 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.481 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:44:53.482 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.483 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.484 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.485 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.486 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 4, 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.487 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:44:53.488 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.489 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "value": 536870400 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:44:53.490 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.491 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.058999721, 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.029499860 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:44:53.492 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.493 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.494 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.495 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.496 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:44:53.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.518 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 22, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.519 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.520 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.521 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 536870400 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.522 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.311998529, 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.031199852 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.523 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.524 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.525 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:44:53.526 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.527 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.528 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:44:53.529 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 22, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.530 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.531 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 536870400 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.532 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:44:53.533 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.311998529, 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.031199852 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.534 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.535 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:44:53.536 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.537 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.538 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:44:53.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 10, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.594 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:44:53.595 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.596 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 536870400 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.597 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.150999287, 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.037749821 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:44:53.598 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:44:53.599 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.600 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.601 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:44:53.602 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:44:53.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.604 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 10, 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.605 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:44:53.606 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout: "value": 536870400 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.607 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.608 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.150999287, 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.037749821 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:44:53.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:44:53.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:44:53.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:44:53.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:45:03.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:45:03.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.115 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 805305600 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.085999594, 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.028666531 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:45:03.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:45:03.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:45:03.122 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.123 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.124 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 805305600 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.085999594, 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.028666531 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:45:03.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:45:03.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.133 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.133 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:45:03.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:45:03.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 33, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.194 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:45:03.195 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 805305600 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 15, 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.465997803, 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.031066520 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:45:03.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:45:03.200 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.201 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.202 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.203 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:45:03.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 33, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 805305600 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 15, 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.465997803, 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.031066520 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:45:03.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:45:03.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.213 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.214 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:45:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.266 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 15, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:45:03.267 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.268 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 805305600 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:45:03.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:45:03.270 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.224998938, 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.037499823 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.271 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:45:03.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.275 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 15, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.276 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:45:03.277 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.278 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 805305600 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:45:03.280 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.224998938, 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.037499823 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.281 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:45:03.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:45:03.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:03.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:45:03.286 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:45:03.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:45:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:45:16.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:45:16.500 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:45:16.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:45:16.702 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:45:16.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:45:16.905 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:45:16.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 128 12582912 4 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=128 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=12582912 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832716917524628 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 12582912 2026-02-23T07:45:16.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=12582912 2026-02-23T07:45:16.920 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:45:16.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:16.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.z4U6u7GxtL bs=12582912 count=1 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr:12582912 bytes (13 MB, 12 MiB) copied, 0.0267456 s, 470 MB/s 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:45:16.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:16.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:16.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:16.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:16.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:16.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:17.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:17.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:17.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:18.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:19.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:19.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:19.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:45:20.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:45:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:45:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:45:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.z4U6u7GxtL 2026-02-23T07:45:21.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:45:21.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832721034834847 2026-02-23T07:45:21.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=4117 2026-02-23T07:45:21.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 128 objects in pool test in 4117 ms' 2026-02-23T07:45:21.035 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 128 objects in pool test in 4117 ms 2026-02-23T07:45:21.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:45:21.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:45:21.036092856' 2026-02-23T07:45:21.036 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:45:21.036092856 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:45:21.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:45:21.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:45:21.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:45:21.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:45:21.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:45:21.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:45:21.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:45:21.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:45:21.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:45:21.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:45:21.276 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:45:21.276 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:45:21.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:45:21.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:45:21.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:45:21.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836498 2026-02-23T07:45:21.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836498 2026-02-23T07:45:21.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498' 2026-02-23T07:45:21.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:45:21.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:45:21.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672976 2026-02-23T07:45:21.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672976 2026-02-23T07:45:21.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-42949672976' 2026-02-23T07:45:21.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:45:21.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:45:21.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-23T07:45:21.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-23T07:45:21.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-42949672976 2-60129542157' 2026-02-23T07:45:21.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:45:21.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836498 2026-02-23T07:45:21.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:45:21.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:45:21.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836498 2026-02-23T07:45:21.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:45:21.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836498 2026-02-23T07:45:21.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-23T07:45:21.501 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836498 2026-02-23T07:45:21.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:45:21.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836498 2026-02-23T07:45:21.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:45:22.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:45:22.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:45:22.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836498 2026-02-23T07:45:22.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:45:22.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672976 2026-02-23T07:45:22.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:45:22.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:45:22.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672976 2026-02-23T07:45:22.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:45:22.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672976 2026-02-23T07:45:22.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672976' 2026-02-23T07:45:22.832 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672976 2026-02-23T07:45:22.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:45:22.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672976 -lt 42949672976 2026-02-23T07:45:22.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:45:22.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-23T07:45:22.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:45:23.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:45:23.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-23T07:45:23.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:45:23.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-23T07:45:23.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-23T07:45:23.002 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542157 2026-02-23T07:45:23.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:45:23.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542158 -lt 60129542157 2026-02-23T07:45:23.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:45:23.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:45:23.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:45:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:45:23.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:45:23.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T07:45:23.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:45:23.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:45:23.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:45:23.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T07:45:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:45:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:45:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:45:23.891 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:45:23.891 INFO:tasks.workunit.client.0.trial129.stdout: client io 238 MiB/s wr, 0 op/s rd, 59 op/s wr 2026-02-23T07:45:23.892 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:45:23.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:45:23.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:45:28.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:45:29.059 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:45:29.059 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:10.549170+0000 19'42 19:63 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-23T07:45:10.548992+0000 19'48 19:69 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-23T07:45:10.548646+0000 19'69 19:91 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:10.548500+0000 19'42 19:64 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:10.549250+0000 19'42 19:64 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-23T07:45:10.548105+0000 19'36 19:59 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-23T07:45:10.548576+0000 19'33 19:57 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-23T07:45:10.549186+0000 19'72 19:97 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:45:29.060 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:45:29.061 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:45:29.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:29.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:45:29.070 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:45:29.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:45:29.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:45:29.142 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:45:29.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:45:29.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:45:29.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:45:29.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:45:29.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:45:29.217372879' 2026-02-23T07:45:29.217 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:45:29.217372879 2026-02-23T07:45:29.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832729218499962 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 128 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=128 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:45:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:45:31.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:45:31.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832731244497939 2026-02-23T07:45:31.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:45:31.246 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:45:31.245578957 (2025 ms) 2026-02-23T07:45:31.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:45:31.245578957 (2025 ms)' 2026-02-23T07:45:31.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=40 2026-02-23T07:45:31.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:45:31.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj97 obj96 obj95 obj94 obj93 obj92 obj91 obj90 obj99 obj98 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj118 obj119 obj112 obj113 obj110 obj111 obj116 obj117 obj114 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj109 obj108 obj105 obj104 obj107 obj106 obj101 obj100 obj103 obj102 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj84 obj85 obj86 obj87 obj80 obj81 obj82 obj83 obj88 obj89 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj127 obj126 obj125 obj124 obj123 obj122 obj121 obj120 obj128 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:45:31.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 40 2026-02-23T07:45:31.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 40' 2026-02-23T07:45:31.248 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 40 2026-02-23T07:45:31.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.249 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj66 2026-02-23T07:45:31.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj66' 2026-02-23T07:45:31.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.250 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 128 2026-02-23T07:45:31.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 128' 2026-02-23T07:45:31.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:45:31.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:45:31.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:45:31.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.252 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj66 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj66' 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj66 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj66 ' 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.254 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj33 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj33' 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj33 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj33 ' 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.256 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj76 2026-02-23T07:45:31.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj76' 2026-02-23T07:45:31.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj76 2026-02-23T07:45:31.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj76 ' 2026-02-23T07:45:31.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.259 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj128 2026-02-23T07:45:31.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj128' 2026-02-23T07:45:31.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj128 2026-02-23T07:45:31.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj128 ' 2026-02-23T07:45:31.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.262 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj53 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj53' 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj53 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj53 ' 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj107' 2026-02-23T07:45:31.264 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj107 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj107 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj107 ' 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.265 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1 2026-02-23T07:45:31.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1' 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1 ' 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.267 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj100 2026-02-23T07:45:31.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj100' 2026-02-23T07:45:31.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj100 2026-02-23T07:45:31.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj100 ' 2026-02-23T07:45:31.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.269 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj48 2026-02-23T07:45:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj48' 2026-02-23T07:45:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj48 2026-02-23T07:45:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj48 ' 2026-02-23T07:45:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.271 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj113 2026-02-23T07:45:31.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj113' 2026-02-23T07:45:31.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj113 2026-02-23T07:45:31.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj113 ' 2026-02-23T07:45:31.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.273 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj13 2026-02-23T07:45:31.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj13' 2026-02-23T07:45:31.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj13 2026-02-23T07:45:31.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:45:31.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj13 ' 2026-02-23T07:45:31.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.276 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj102 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj102' 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj102 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj102 ' 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.278 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj86 2026-02-23T07:45:31.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj86' 2026-02-23T07:45:31.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj86 2026-02-23T07:45:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:45:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj86 ' 2026-02-23T07:45:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.279 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj114 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj114' 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj114 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj114 ' 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.281 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj58 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj58' 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj58 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj58 ' 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.282 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj3 2026-02-23T07:45:31.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj3' 2026-02-23T07:45:31.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj3 2026-02-23T07:45:31.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:45:31.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj3 ' 2026-02-23T07:45:31.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.284 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj79 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj79' 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj79 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj79 ' 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj12' 2026-02-23T07:45:31.285 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj12 2026-02-23T07:45:31.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj12 2026-02-23T07:45:31.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:45:31.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj12 ' 2026-02-23T07:45:31.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.287 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj36 2026-02-23T07:45:31.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj36' 2026-02-23T07:45:31.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj36 2026-02-23T07:45:31.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:45:31.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj36 ' 2026-02-23T07:45:31.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.288 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj63 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj63' 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj63 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj63 ' 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 20 )) 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=20 )) 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj11 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.289 INFO:tasks.workunit.client.0.trial129.stdout:Object obj11: acting: 1 2 0 2026-02-23T07:45:31.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj11: acting: 1 2 0' 2026-02-23T07:45:31.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:45:31.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.290 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:45:31.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj11 (20) 2 0 1' 2026-02-23T07:45:31.291 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj11 (20) 2 0 1 2026-02-23T07:45:31.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.292 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj11 2026-02-23T07:45:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj11' 2026-02-23T07:45:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj11 ' 2026-02-23T07:45:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj26 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stdout:Object obj26: acting: 1 2 0 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj26: acting: 1 2 0' 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:45:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.294 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:45:31.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.294 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj26 (21) 2 0 1 2026-02-23T07:45:31.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj26 (21) 2 0 1' 2026-02-23T07:45:31.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj26' 2026-02-23T07:45:31.295 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj26 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj26 ' 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj55 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stdout:Object obj55: acting: 2 0 1 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj55: acting: 2 0 1' 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:45:31.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.297 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:45:31.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.297 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj55 (22) 0 1 2 2026-02-23T07:45:31.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj55 (22) 0 1 2' 2026-02-23T07:45:31.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.298 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj55 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj55' 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj55 ' 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj83 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj83: acting: 1 0 2' 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stdout:Object obj83: acting: 1 0 2 2026-02-23T07:45:31.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.300 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.300 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj83 (23) 0 2 1 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj83 (23) 0 2 1' 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj83 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj83' 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj83 ' 2026-02-23T07:45:31.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj23 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stdout:Object obj23: acting: 1 0 2 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj23: acting: 1 0 2' 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.302 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj23 (24) 0 2 1 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj23 (24) 0 2 1' 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.303 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj23 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj23' 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj23 ' 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj89 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj89: acting: 1 2 0' 2026-02-23T07:45:31.304 INFO:tasks.workunit.client.0.trial129.stdout:Object obj89: acting: 1 2 0 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj89 (25) 2 0 1' 2026-02-23T07:45:31.305 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj89 (25) 2 0 1 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj89 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj89' 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj89 ' 2026-02-23T07:45:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj7 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stdout:Object obj7: acting: 2 0 1 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj7: acting: 2 0 1' 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.307 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj7 (26) 0 1 2' 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj7 (26) 0 1 2 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj7' 2026-02-23T07:45:31.308 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj7 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj7 ' 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj70 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stdout:Object obj70: acting: 1 0 2 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj70: acting: 1 0 2' 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj70 (27) 0 2 1' 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj70 (27) 0 2 1 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj70' 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj70 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj70 ' 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj20 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj20: acting: 1 0 2' 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stdout:Object obj20: acting: 1 0 2 2026-02-23T07:45:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj20 (28) 0 2 1 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj20 (28) 0 2 1' 2026-02-23T07:45:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj20' 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj20 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj20 ' 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj44 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.313 INFO:tasks.workunit.client.0.trial129.stdout:Object obj44: acting: 0 1 2 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj44: acting: 0 1 2' 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj44 (29) 1 2 0' 2026-02-23T07:45:31.314 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj44 (29) 1 2 0 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj44 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj44' 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj44 ' 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj46 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj46: acting: 1 0 2' 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stdout:Object obj46: acting: 1 0 2 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.316 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj46 (30) 0 2 1 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj46 (30) 0 2 1' 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj46 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj46' 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj46 ' 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj88 2026-02-23T07:45:31.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stdout:Object obj88: acting: 1 0 2 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj88: acting: 1 0 2' 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj88 (31) 0 2 1' 2026-02-23T07:45:31.318 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj88 (31) 0 2 1 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj88 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj88' 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj88 ' 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj37 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj37: acting: 1 0 2' 2026-02-23T07:45:31.319 INFO:tasks.workunit.client.0.trial129.stdout:Object obj37: acting: 1 0 2 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj37 (32) 0 2 1 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj37 (32) 0 2 1' 2026-02-23T07:45:31.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj37 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj37' 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj37 ' 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj125 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj125: acting: 1 2 0' 2026-02-23T07:45:31.321 INFO:tasks.workunit.client.0.trial129.stdout:Object obj125: acting: 1 2 0 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj125 (33) 2 0 1' 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj125 (33) 2 0 1 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.322 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj125 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj125' 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj125 ' 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj119 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj119: acting: 2 0 1' 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stdout:Object obj119: acting: 2 0 1 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.323 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj119 (34) 0 1 2' 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj119 (34) 0 1 2 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj119 2026-02-23T07:45:31.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj119' 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj119 ' 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj61 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj61: acting: 1 0 2' 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stdout:Object obj61: acting: 1 0 2 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.325 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj61 (35) 0 2 1 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj61 (35) 0 2 1' 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj61' 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj61 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj61 ' 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj97 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.326 INFO:tasks.workunit.client.0.trial129.stdout:Object obj97: acting: 2 0 1 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj97: acting: 2 0 1' 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj97 (36) 0 1 2 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj97 (36) 0 1 2' 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.327 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj97 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj97' 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj97 ' 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj101 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stdout:Object obj101: acting: 1 0 2 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj101: acting: 1 0 2' 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj101 (37) 0 2 1 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj101 (37) 0 2 1' 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj101 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj101' 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj101 ' 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj73 2026-02-23T07:45:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stdout:Object obj73: acting: 1 0 2 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj73: acting: 1 0 2' 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj73 (38) 0 2 1 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj73 (38) 0 2 1' 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:45:31.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj73 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj73' 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj73 ' 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj80 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj80: acting: 1 0 2' 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stdout:Object obj80: acting: 1 0 2 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:45:31.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj80 (39) 0 2 1' 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj80 (39) 0 2 1 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj80 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj80' 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj80 ' 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:45:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:45:31.347 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:45:31.347 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:45:31.348 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:31.354 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:45:31.354 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:45:31.354 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:31.361 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:45:31.362 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:45:31.362 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:31.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:45:31.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:45:31.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:45:31.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:45:31.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:45:31.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:45:31.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:45:31.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:45:32.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:45:32.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:45:32.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj33 obj86 ' 2026-02-23T07:45:32.683 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj33 obj86 2026-02-23T07:45:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:45:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:45:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:45:32.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj33 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj33 2026-02-23T07:45:32.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj33 rm-attr _ 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:32.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj86 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj86 2026-02-23T07:45:32.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj86 rm-attr _ 2026-02-23T07:45:32.968 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:45:33.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj26 obj55 obj23 obj89 obj7 obj20 obj46 obj37 obj125 obj119 obj97 obj73 ' obj_to_pgid delete_oi 2026-02-23T07:45:33.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj26 obj55 obj23 obj89 obj7 obj20 obj46 obj37 obj125 obj119 obj97 obj73 ' 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj26 obj55 obj23 obj89 obj7 obj20 obj46 obj37 obj125 obj119 obj97 obj73 ]] 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj26 obj55 obj23 obj89 obj7 obj20 obj46 obj37 obj125 obj119 obj97 obj73 ' 2026-02-23T07:45:33.016 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj26 obj55 obj23 obj89 obj7 obj20 obj46 obj37 obj125 obj119 obj97 obj73 2026-02-23T07:45:33.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:45:33.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj26 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-23T07:45:33.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj26 rm-attr _ 2026-02-23T07:45:33.123 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:33.124 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:45:33.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:45:33.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj55 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj55 2026-02-23T07:45:33.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj55 rm-attr _ 2026-02-23T07:45:33.290 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:33.290 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:33.290 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:33.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj23 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj23 2026-02-23T07:45:33.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj23 rm-attr _ 2026-02-23T07:45:33.455 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:33.455 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:33.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:33.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:45:33.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:45:33.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj89 2026-02-23T07:45:33.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj89 2026-02-23T07:45:33.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj89 rm-attr _ 2026-02-23T07:45:33.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:33.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:33.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:33.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:33.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj7 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-23T07:45:33.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj7 rm-attr _ 2026-02-23T07:45:33.775 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:33.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:33.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:33.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:33.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:33.776 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:33.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:33.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj20 2026-02-23T07:45:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj20 2026-02-23T07:45:33.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj20 rm-attr _ 2026-02-23T07:45:33.939 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:33.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:33.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:33.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:33.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:33.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:33.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:33.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:33.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:33.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj46 2026-02-23T07:45:33.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:33.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:33.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj46 2026-02-23T07:45:33.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj46 rm-attr _ 2026-02-23T07:45:34.108 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:34.109 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:34.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:34.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:34.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:34.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:34.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:34.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:34.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj37 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj37 2026-02-23T07:45:34.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj37 rm-attr _ 2026-02-23T07:45:34.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:34.294 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:34.294 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:34.294 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:34.294 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:45:34.294 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:45:34.294 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:34.295 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:34.295 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:34.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:34.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:34.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:34.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:45:34.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:45:34.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:34.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:34.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:34.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:34.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj125 2026-02-23T07:45:34.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:34.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:34.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj125 2026-02-23T07:45:34.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj125 rm-attr _ 2026-02-23T07:45:34.455 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:34.455 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:34.455 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:34.455 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:34.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:45:34.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-23T07:45:34.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:45:34.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:34.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:34.456 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:45:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:45:34.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:34.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj119 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj119 2026-02-23T07:45:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj119 rm-attr _ 2026-02-23T07:45:34.611 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:34.612 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:34.613 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:34.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:34.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:34.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:34.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:45:34.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:45:34.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:34.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj97 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj97 2026-02-23T07:45:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj97 rm-attr _ 2026-02-23T07:45:34.785 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:34.785 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:34.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-23T07:45:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:34.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:34.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:34.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:34.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:34.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj73 2026-02-23T07:45:34.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:34.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:45:34.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj73 2026-02-23T07:45:34.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj73 rm-attr _ 2026-02-23T07:45:34.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afbdc8ea:::obj55:head#, (61) No data available 2026-02-23T07:45:34.948 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3a764ab4:::obj37:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:45:34.949 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9c626db4:::obj119:head#, (61) No data available 2026-02-23T07:45:35.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:35.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:35.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:45:35.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:45:35.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:45:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj66 obj76 obj128 obj53 obj1 obj100 obj48 obj113 obj102 obj58 obj79 obj63 ' 2026-02-23T07:45:35.004 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj66 obj76 obj128 obj53 obj1 obj100 obj48 obj113 obj102 obj58 obj79 obj63 2026-02-23T07:45:35.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:35.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj66 2026-02-23T07:45:35.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:35.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:35.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj66 2026-02-23T07:45:35.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj66 rm-attr _ 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:35.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj76 2026-02-23T07:45:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:35.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:35.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj76 2026-02-23T07:45:35.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj76 rm-attr _ 2026-02-23T07:45:35.323 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:35.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:35.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:35.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:35.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:35.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:35.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:35.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:35.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:35.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:35.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj128 2026-02-23T07:45:35.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:35.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:35.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj128 2026-02-23T07:45:35.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj128 rm-attr _ 2026-02-23T07:45:35.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:35.509 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:45:35.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:35.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:35.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:35.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:35.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj53 2026-02-23T07:45:35.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:35.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:35.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj53 2026-02-23T07:45:35.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj53 rm-attr _ 2026-02-23T07:45:35.676 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:35.676 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:35.676 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:35.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:35.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:35.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:35.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:45:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:45:35.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:35.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1 2026-02-23T07:45:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1 rm-attr _ 2026-02-23T07:45:35.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:35.845 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:35.847 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:35.847 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:35.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:35.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:35.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:35.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:35.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:35.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:35.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj100 2026-02-23T07:45:35.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:35.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:35.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj100 2026-02-23T07:45:35.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj100 rm-attr _ 2026-02-23T07:45:36.010 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:36.011 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:36.011 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:36.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:36.013 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:36.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:36.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:36.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:36.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj48 2026-02-23T07:45:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj48 2026-02-23T07:45:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj48 rm-attr _ 2026-02-23T07:45:36.204 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:36.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:36.206 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:36.206 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2a627378:::obj100:head#, (61) No data available 2026-02-23T07:45:36.207 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:36.207 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:36.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:36.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:36.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:36.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:45:36.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:45:36.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:36.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj113 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj113 2026-02-23T07:45:36.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj113 rm-attr _ 2026-02-23T07:45:36.365 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:36.367 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:36.367 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:36.367 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2a627378:::obj100:head#, (61) No data available 2026-02-23T07:45:36.368 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:36.368 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:36.368 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:45:36.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:45:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:45:36.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:36.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:36.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:36.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:36.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj102 2026-02-23T07:45:36.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:36.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:36.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj102 2026-02-23T07:45:36.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj102 rm-attr _ 2026-02-23T07:45:36.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:36.558 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:45:36.558 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:36.558 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:36.559 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2a627378:::obj100:head#, (61) No data available 2026-02-23T07:45:36.559 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:36.559 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:36.559 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:45:36.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:36.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:36.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj58 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj58 2026-02-23T07:45:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj58 rm-attr _ 2026-02-23T07:45:36.732 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6681cfe7:::obj102:head#, (61) No data available 2026-02-23T07:45:36.732 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:36.733 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:45:36.733 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:36.733 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:36.733 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2a627378:::obj100:head#, (61) No data available 2026-02-23T07:45:36.734 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:36.734 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:36.734 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:36.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj79 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj79 2026-02-23T07:45:36.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj79 rm-attr _ 2026-02-23T07:45:36.896 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6681cfe7:::obj102:head#, (61) No data available 2026-02-23T07:45:36.897 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:36.898 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:45:36.898 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:45:36.898 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:36.898 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:36.898 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2a627378:::obj100:head#, (61) No data available 2026-02-23T07:45:36.899 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:36.899 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:36.899 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:36.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj63 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-23T07:45:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj63 rm-attr _ 2026-02-23T07:45:37.056 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:6681cfe7:::obj102:head#, (61) No data available 2026-02-23T07:45:37.056 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:67a26c0a:::obj53:head#, (61) No data available 2026-02-23T07:45:37.056 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:45:37.057 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f11aef48:::obj58:head#, (61) No data available 2026-02-23T07:45:37.057 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:45:37.057 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:239f544e:::obj128:head#, (61) No data available 2026-02-23T07:45:37.057 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2a627378:::obj100:head#, (61) No data available 2026-02-23T07:45:37.058 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00833431:::obj76:head#, (61) No data available 2026-02-23T07:45:37.058 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:095c6b7a:::obj79:head#, (61) No data available 2026-02-23T07:45:37.058 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1abd4411:::obj66:head#, (61) No data available 2026-02-23T07:45:37.058 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b644371:::obj48:head#, (61) No data available 2026-02-23T07:45:37.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:37.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:37.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:45:37.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 '' obj_to_pgid delete_oi 2026-02-23T07:45:37.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:45:37.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:45:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj107 obj13 obj114 obj3 obj12 obj36 ' 2026-02-23T07:45:37.110 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj107 obj13 obj114 obj3 obj12 obj36 2026-02-23T07:45:37.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:45:37.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj107 2026-02-23T07:45:37.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:37.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj107 2026-02-23T07:45:37.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj107 rm-attr _ 2026-02-23T07:45:37.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:37.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:37.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:37.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:45:37.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:45:37.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:37.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:37.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:37.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:37.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj13 2026-02-23T07:45:37.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:37.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj13 2026-02-23T07:45:37.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj13 rm-attr _ 2026-02-23T07:45:37.411 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:37.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:37.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:37.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:37.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:45:37.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:45:37.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:37.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj114 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj114 2026-02-23T07:45:37.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj114 rm-attr _ 2026-02-23T07:45:37.584 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:37.585 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:37.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:37.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:37.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:37.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:45:37.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:45:37.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:37.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj3 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj3 2026-02-23T07:45:37.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj3 rm-attr _ 2026-02-23T07:45:37.745 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:37.745 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:37.746 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:45:37.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:37.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj12 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj12 2026-02-23T07:45:37.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj12 rm-attr _ 2026-02-23T07:45:37.884 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:37.884 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:37.886 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:37.886 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:45:37.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:37.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj36 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj36 2026-02-23T07:45:37.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj36 rm-attr _ 2026-02-23T07:45:38.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:38.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:38.053 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:38.054 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:38.054 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj11 obj83 obj70 obj44 obj88 obj61 obj101 obj80 ' obj_to_pgid delete_oi 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj11 obj83 obj70 obj44 obj88 obj61 obj101 obj80 ' 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj11 obj83 obj70 obj44 obj88 obj61 obj101 obj80 ]] 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:45:38.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj11 obj83 obj70 obj44 obj88 obj61 obj101 obj80 ' 2026-02-23T07:45:38.109 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj11 obj83 obj70 obj44 obj88 obj61 obj101 obj80 2026-02-23T07:45:38.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj11 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj11 2026-02-23T07:45:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj11 rm-attr _ 2026-02-23T07:45:38.214 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:38.214 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:38.214 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:38.214 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:38.215 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:38.215 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:45:38.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:38.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj83 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj83 2026-02-23T07:45:38.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj83 rm-attr _ 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:38.364 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:38.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj70 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj70 2026-02-23T07:45:38.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj70 rm-attr _ 2026-02-23T07:45:38.507 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:38.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:38.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:38.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:38.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:38.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:45:38.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:45:38.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:38.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:38.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj44 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj44 2026-02-23T07:45:38.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj44 rm-attr _ 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:38.686 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:45:38.687 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:38.687 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:38.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:38.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:38.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:38.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:38.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:38.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:38.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:38.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:38.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:38.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj88 2026-02-23T07:45:38.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:38.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj88 2026-02-23T07:45:38.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj88 rm-attr _ 2026-02-23T07:45:38.845 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:45:38.845 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:38.845 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:38.845 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:38.846 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:38.846 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:38.846 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:45:38.846 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:45:38.846 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:38.847 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:38.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:38.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:38.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:38.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:38.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:38.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:38.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:38.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:38.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:38.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:38.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj61 2026-02-23T07:45:38.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:38.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:38.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj61 2026-02-23T07:45:38.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj61 rm-attr _ 2026-02-23T07:45:39.009 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:45:39.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:39.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:39.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:39.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:39.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:39.012 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:45:39.013 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:45:39.013 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:39.013 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:39.013 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-23T07:45:39.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:39.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:39.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:39.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:39.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:39.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj101 2026-02-23T07:45:39.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:39.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:39.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj101 2026-02-23T07:45:39.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj101 rm-attr _ 2026-02-23T07:45:39.172 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:45:39.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:45:39.174 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:39.174 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:39.174 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-23T07:45:39.174 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:45:39.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:39.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:39.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:45:39.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:39.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:45:39.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:45:39.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:45:39.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj80 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj80 2026-02-23T07:45:39.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj80 rm-attr _ 2026-02-23T07:45:39.341 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:45:39.341 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a37ff878:::obj107:head#, (61) No data available 2026-02-23T07:45:39.341 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:45:39.341 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:45:39.341 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:45:39.341 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eeae2a94:::obj11:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8dd16f86:::obj3:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:945b6e2e:::obj114:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:105983a6:::obj88:head#, (61) No data available 2026-02-23T07:45:39.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:45:39.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:45:39.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:45:39.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:45:39.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:45:39.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:45:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:45:55.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:45:55.659 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:45:55.659 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227642+0000 19'42 32:91 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-23T07:45:43.227719+0000 19'48 32:97 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-23T07:45:43.227408+0000 19'69 32:108 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227232+0000 19'42 32:92 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227595+0000 19'42 32:93 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-23T07:45:43.227131+0000 19'36 32:96 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-23T07:45:43.227564+0000 19'33 32:77 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-23T07:45:43.227405+0000 19'72 32:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:55.660 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:45:55.661 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:45:55.661 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:45:55.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:55.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:45:55.671 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:45:55.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:45:55.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:45:55.743 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:45:55.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:45:55.807 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:45:55.807 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:45:55.807 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:55.813 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:45:55.814 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:45:55.814 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:55.820 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:45:55.820 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:45:55.820 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:55.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:45:56.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:45:56.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832756831819110 2026-02-23T07:45:56.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:45:56.833 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:45:56.833272866 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:45:56.833272866' 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:45:56.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:45:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:45:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:45:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:45:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:45:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:45:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:45:56.986 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:45:57.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:45:57.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832757000577834 2026-02-23T07:45:57.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:45:57.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:45:57.001717691 (168 ms)' 2026-02-23T07:45:57.003 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:45:57.001717691 (168 ms) 2026-02-23T07:45:57.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.005 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:45:57.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:45:57.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.007 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-23T07:45:57.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-23T07:45:57.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.010 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-23T07:45:57.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-23T07:45:57.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.012 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-23T07:45:57.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-23T07:45:57.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.014 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-23T07:45:57.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-23T07:45:57.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.015 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:45:57.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:45:57.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.016 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:45:57.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:45:57.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.017 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:45:57.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:45:57.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:45:57.019 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:45:57.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:45:57.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:45:57.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:45:57.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:45:57.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:45:57.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:45:57.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:45:57.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:45:57.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:45:57.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:45:57.319 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:45:57.319 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227642+0000 19'42 32:91 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.319 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-23T07:45:43.227719+0000 19'48 32:97 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-23T07:45:43.227408+0000 19'69 32:108 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227232+0000 19'42 32:92 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227595+0000 19'42 32:93 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-23T07:45:43.227131+0000 19'36 32:96 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-23T07:45:43.227564+0000 19'33 32:77 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-23T07:45:43.227405+0000 19'72 32:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:45:57.320 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:45:57.321 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:45:57.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:45:57.394 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:45:57.394 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:45:57.394 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.400 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:45:57.400 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:45:57.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.407 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:45:57.407 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:45:57.407 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:45:57.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832757416268947 2026-02-23T07:45:57.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.417 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:45:57.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:45:57.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:45:57.481 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.481 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.481 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.481 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.481 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:45:57.489 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:45:57.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:45:57.553 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.553 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.553 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.553 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.553 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:45:57.562 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:45:57.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:45:57.634 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.634 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.634 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.634 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.634 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:45:57.644 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:45:57.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:45:57.713 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.713 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.713 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.713 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.713 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.723 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:45:57.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:45:57.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:45:57.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.787 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.787 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.787 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:45:57.795 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:45:57.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:45:57.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.857 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.857 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.858 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:45:57.866 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:45:57.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:45:57.928 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.929 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.929 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:57.929 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:57.929 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:57.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:45:57.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:45:57.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:45:57.937 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:45:57.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:45:57.999 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:45:57.999 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:45:57.999 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:45:58.000 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:45:58.000 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:58.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:45:58.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:45:58.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:45:58.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:45:58.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:45:58.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:45:58.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:45:58.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:45:58.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:45:58.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832758175308066 2026-02-23T07:45:58.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=759 2026-02-23T07:45:58.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:45:58.242 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:45:58.242 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:45:58.242 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:58.249 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:45:58.249 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:45:58.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:58.257 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:45:58.257 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:45:58.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:45:58.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:46:00.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:46:00.423 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:46:00.424 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227642+0000 19'42 32:92 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:46:00.424 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean+scrubbing+deep 2026-02-23T07:45:58.595976+0000 19'48 32:102 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 deep scrubbing for 1s 0 0 2026-02-23T07:46:00.424 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean+inconsistent 2026-02-23T07:45:58.460560+0000 19'69 32:121 [2,0,1] 2 [2,0,1] 2 19'69 2026-02-23T07:45:58.460493+0000 19'69 2026-02-23T07:45:58.460493+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:45:58.460493+0000 23 0 2026-02-23T07:46:00.425 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean+inconsistent 2026-02-23T07:45:57.722667+0000 19'42 32:103 [1,0,2] 1 [1,0,2] 1 19'42 2026-02-23T07:45:57.722631+0000 19'42 2026-02-23T07:45:57.722631+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:45:57.722631+0000 14 0 2026-02-23T07:46:00.425 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:45:43.227595+0000 19'42 32:94 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:45:10.441936+0000 0 0 2026-02-23T07:46:00.425 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean+inconsistent 2026-02-23T07:45:58.316950+0000 19'36 32:107 [0,1,2] 0 [0,1,2] 0 19'36 2026-02-23T07:45:58.316906+0000 19'36 2026-02-23T07:45:58.316906+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:45:58.316906+0000 12 0 2026-02-23T07:46:00.425 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-23T07:45:43.227564+0000 19'33 32:79 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:46:00.426 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-23T07:45:43.227405+0000 19'72 32:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:45:10.441936+0000 0'0 2026-02-23T07:45:10.441936+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:46:00.426 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:46:00.426 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:46:00.427 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:46:00.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_3 3 8 16 20 20 12582912 4194304 0 759 2026-02-23T07:46:00.434 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj_3@ NAUT 3 8 16 20/ 20 12582912 4194304/ 0 759 2026-02-23T07:46:00.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.435 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:46:00.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:46:00.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:46:00.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.448 INFO:tasks.workunit.client.0.trial129.stdout:1027 2026-02-23T07:46:00.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.449 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:46:00.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:46:00.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:46:00.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.463 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:46:00.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.464 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:46:00.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:46:00.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:46:00.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.478 INFO:tasks.workunit.client.0.trial129.stdout:589 2026-02-23T07:46:00.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.479 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:46:00.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:46:00.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:46:00.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.493 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:46:00.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.494 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:46:00.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:46:00.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:46:00.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.507 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.0 2026-02-23T07:46:00.507 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:46:00.508 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:00.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.509 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:46:00.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:46:00.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:46:00.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.523 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:46:00.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:46:00.524 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:46:00.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:46:00.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.538 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:46:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:00.538 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:46:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:46:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:46:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:46:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:46:00.550 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:46:00.550 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:46:00.551 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:46:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:46:06.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:46:06.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:46:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:46:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:46:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:46:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:46:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:46:06.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:46:06.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:46:06.279 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:46:06.280 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:46:06.280 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:06.286 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:46:06.286 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:46:06.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:06.293 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:46:06.293 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:46:06.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:06.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:46:06.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832766302363764 2026-02-23T07:46:06.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:06.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:46:06.455 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-23T07:46:06.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:06.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:46:06.620 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:46:06.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:06.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:46:06.790 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-23T07:46:06.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:06.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:46:06.962 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:46:06.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:06.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:46:07.125 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:46:07.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:07.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:46:07.288 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:46:07.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:07.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:46:07.459 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:46:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:46:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:46:07.626 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:46:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:46:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:46:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:46:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:46:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:46:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:46:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:46:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:46:07.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:46:07.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832767806628811 2026-02-23T07:46:07.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1504 2026-02-23T07:46:07.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:46:07.874 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:46:07.874 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:46:07.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:07.884 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:46:07.884 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:46:07.884 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:07.891 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:46:07.891 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:46:07.891 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:07.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:46:12.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:46:13.056 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:46:08.971015+0000 19'42 32:132 [1,2,0] 1 [1,2,0] 1 19'42 2026-02-23T07:46:08.841659+0000 19'42 2026-02-23T07:46:08.841659+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:08.841659+0000 14 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 201326592 0 0 48 0 48 active+clean 2026-02-23T07:46:07.944420+0000 19'48 32:136 [1,0,2] 1 [1,0,2] 1 19'48 2026-02-23T07:46:07.853815+0000 19'48 2026-02-23T07:46:07.853815+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:07.853815+0000 16 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 289406976 0 0 69 0 69 active+clean 2026-02-23T07:46:07.516309+0000 19'69 32:150 [2,0,1] 2 [2,0,1] 2 19'69 2026-02-23T07:46:07.405355+0000 19'69 2026-02-23T07:46:07.405355+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:07.405355+0000 23 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 176160768 0 0 42 0 42 active+clean 2026-02-23T07:46:06.967348+0000 19'42 32:134 [1,0,2] 1 [1,0,2] 1 19'42 2026-02-23T07:46:06.811974+0000 19'42 2026-02-23T07:46:06.811974+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:06.811974+0000 14 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 176160768 0 0 42 0 42 active+clean+scrubbing+deep+inconsistent+repair 2026-02-23T07:46:10.666862+0000 19'42 32:114 [1,2,0] 1 [1,2,0] 1 19'42 2026-02-23T07:46:01.807147+0000 19'42 2026-02-23T07:46:01.807147+0000 0 1 deep scrubbing for 1s 10 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 150994944 0 0 36 0 36 active+clean 2026-02-23T07:46:08.213784+0000 19'36 32:133 [0,1,2] 0 [0,1,2] 0 19'36 2026-02-23T07:46:08.114044+0000 19'36 2026-02-23T07:46:08.114044+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:08.114044+0000 12 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 138412032 0 0 33 0 33 active+clean 2026-02-23T07:46:08.383927+0000 19'33 32:118 [2,0,1] 2 [2,0,1] 2 19'33 2026-02-23T07:46:08.278921+0000 19'33 2026-02-23T07:46:08.278921+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:08.278921+0000 11 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 301989888 0 0 72 0 72 active+clean 2026-02-23T07:46:10.153318+0000 19'72 32:191 [1,0,2] 1 [1,0,2] 1 19'72 2026-02-23T07:46:09.965096+0000 19'72 2026-02-23T07:46:09.965096+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:46:09.965096+0000 24 0 2026-02-23T07:46:13.057 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:46:13.058 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:46:13.058 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:46:13.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' large_obj_3 3 8 16 20 20 12582912 4194304 0 1504 2026-02-23T07:46:13.068 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ large_obj_3@ REPR 3 8 16 20/ 20 12582912 4194304/ 0 1504 2026-02-23T07:46:13.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:46:13.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:46:13.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:46:13.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:46:13.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:46:13.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:46:13.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0746 2026-02-23T07:46:13.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:46:13.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:46:13.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:13.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:46:13.180 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.181 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.182 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:46:13.183 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.185 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.186 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 768 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3221225472 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:13.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:13.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.345998322, 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.172999161 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.194 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.195 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:13.196 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.197 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.198 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.199 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.200 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.202 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 768 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3221225472 2026-02-23T07:46:13.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.345998322, 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.172999161 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.206 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.207 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.208 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:13.209 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.210 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.211 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:46:13.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.231 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 36, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.232 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.233 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 768 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3221225472 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.234 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:13.235 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 1.769991435, 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.176999143 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.236 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.237 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.238 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.241 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.242 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 36, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.243 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:13.244 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 768 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3221225472 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:46:13.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 1.769991435, 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.176999143 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:46:13.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.306 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 16, 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:13.307 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:13.308 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 768 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3221225472 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.309 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.850995879, 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.212748969 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.310 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.311 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.312 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.313 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.314 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 16, 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:13.316 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:13.317 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 768 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3221225472 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.318 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.850995879, 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.212748969 2026-02-23T07:46:13.319 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.320 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:13.322 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.323 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:13.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:46:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:21.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:46:21.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:21.698 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:21.699 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 9, 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.700 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.701 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:21.702 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.703 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: "value": 370 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:46:21.704 INFO:tasks.workunit.client.0.trial129.stderr: "value": 370 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr: "value": 370 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:21.705 INFO:tasks.workunit.client.0.trial129.stderr: "value": 370 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1110 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4655677440 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:21.706 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.707 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:46:21.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.520997475, 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.173665825 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:21.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:21.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.715 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.716 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.717 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.718 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.719 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.719 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.719 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.719 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.719 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.720 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 9, 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.721 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 370 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 370 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 370 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.724 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "value": 370 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1110 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4655677440 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.725 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:21.726 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.520997475, 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.173665825 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.727 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.728 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.729 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.730 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.731 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:21.732 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.733 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:46:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:21.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:46:21.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:21.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.765 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.765 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.765 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 53, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.766 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.767 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "value": 377 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "value": 377 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.768 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 378 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1133 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4747952128 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.769 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "value": 14 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 14, 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 2.500987899, 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.178641992 2026-02-23T07:46:21.770 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.771 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.772 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.773 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:21.774 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.775 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.776 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:21.777 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.778 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 53, 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.779 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.780 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "value": 377 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "value": 377 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout: "value": 378 2026-02-23T07:46:21.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1133 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4747952128 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.782 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "value": 14 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 14, 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 2.500987899, 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.178641992 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.785 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.786 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:21.787 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.788 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:46:21.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.843 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 24, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.844 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.845 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1152 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4831838208 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.846 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 1.254993926, 2026-02-23T07:46:21.847 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.209165654 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.848 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.849 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.850 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.851 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:46:21.852 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.853 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 24, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.855 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1152 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4831838208 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.856 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 1.254993926, 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.209165654 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.857 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:46:21.859 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.860 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:46:21.861 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:21.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:46:21.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:46:35.031 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:46:35.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:46:35.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:46:35.233 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:46:35.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:46:35.437 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:46:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:46:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:46:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 128 256 4 2026-02-23T07:46:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:46:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:46:35.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=128 2026-02-23T07:46:35.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-23T07:46:35.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:46:35.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:46:35.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832795449283024 2026-02-23T07:46:35.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-23T07:46:35.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-23T07:46:35.451 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:46:35.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.psEnGfN51f bs=256 count=1 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.7951e-05 s, 6.7 MB/s 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:36.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:36.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:36.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:46:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:46:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.psEnGfN51f 2026-02-23T07:46:36.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:46:36.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:46:36.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:46:36.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.psEnGfN51f 2026-02-23T07:46:36.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:46:36.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832796032615557 2026-02-23T07:46:36.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=583 2026-02-23T07:46:36.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 128 objects in pool test in 583 ms' 2026-02-23T07:46:36.033 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 128 objects in pool test in 583 ms 2026-02-23T07:46:36.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:46:36.033852617' 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:46:36.033852617 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:46:36.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:46:36.035 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:46:36.035 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:46:36.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:46:36.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:46:36.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:46:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:46:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:46:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:46:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:46:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:46:36.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:46:36.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:46:36.277 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:46:36.277 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:46:36.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:46:36.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:46:36.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:46:36.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T07:46:36.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T07:46:36.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T07:46:36.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:46:36.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:46:36.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672973 2026-02-23T07:46:36.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672973 2026-02-23T07:46:36.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973' 2026-02-23T07:46:36.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:46:36.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:46:36.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-23T07:46:36.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-23T07:46:36.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-60129542154' 2026-02-23T07:46:36.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:46:36.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T07:46:36.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:46:36.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:46:36.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T07:46:36.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:46:36.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T07:46:36.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T07:46:36.505 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836495 2026-02-23T07:46:36.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:46:36.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:46:36.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:46:37.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:46:37.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:46:37.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T07:46:37.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:46:38.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:46:38.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:46:39.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T07:46:39.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:46:39.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672973 2026-02-23T07:46:39.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:46:39.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:46:39.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672973 2026-02-23T07:46:39.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:46:39.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672973 2026-02-23T07:46:39.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2026-02-23T07:46:39.013 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672973 2026-02-23T07:46:39.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:46:39.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672975 -lt 42949672973 2026-02-23T07:46:39.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:46:39.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-23T07:46:39.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:46:39.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:46:39.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-23T07:46:39.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:46:39.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-23T07:46:39.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-23T07:46:39.183 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542154 2026-02-23T07:46:39.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:46:39.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542154 2026-02-23T07:46:39.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:46:39.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:46:39.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:46:39.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T07:46:39.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:46:39.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:46:39.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:46:39.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:46:39.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:46:39.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:46:39.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:46:39.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T07:46:39.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:46:39.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:46:39.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:46:39.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T07:46:39.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:46:39.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:46:39.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:46:40.074 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:46:40.075 INFO:tasks.workunit.client.0.trial129.stdout: client io 31 KiB/s wr, 0 op/s rd, 31 op/s wr 2026-02-23T07:46:40.075 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:46:40.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:46:40.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:46:45.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:46:29.081445+0000 20'14 20:33 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-23T07:46:29.081806+0000 20'16 20:35 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-23T07:46:29.081095+0000 20'23 20:44 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:46:29.081622+0000 20'14 20:34 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:46:29.081527+0000 20'14 20:34 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-23T07:46:29.081286+0000 20'12 20:32 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:46:29.081073+0000 20'11 20:34 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.241 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-23T07:46:29.081608+0000 20'24 20:46 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:46:45.242 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:46:45.242 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:46:45.242 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:46:45.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:46:45.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:46:45.251 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:46:45.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:46:45.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:46:45.324 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:46:45.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:46:45.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:46:45.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:46:45.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:46:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:46:45.397688978' 2026-02-23T07:46:45.399 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:46:45.397688978 2026-02-23T07:46:45.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832805398811624 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 128 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:46:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:46:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=128 2026-02-23T07:46:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:46:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:46:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:46:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:46:45.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:46:47.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:46:47.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832807427636788 2026-02-23T07:46:47.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:46:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:46:47.428734286 (2028 ms)' 2026-02-23T07:46:47.429 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:46:47.428734286 (2028 ms) 2026-02-23T07:46:47.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=48 2026-02-23T07:46:47.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:46:47.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj97 obj96 obj95 obj94 obj93 obj92 obj91 obj90 obj99 obj98 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj118 obj119 obj112 obj113 obj110 obj111 obj116 obj117 obj114 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj109 obj108 obj105 obj104 obj107 obj106 obj101 obj100 obj103 obj102 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj84 obj85 obj86 obj87 obj80 obj81 obj82 obj83 obj88 obj89 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj127 obj126 obj125 obj124 obj123 obj122 obj121 obj120 obj128 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:46:47.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 48 2026-02-23T07:46:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 48' 2026-02-23T07:46:47.431 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 48 2026-02-23T07:46:47.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.432 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj73 2026-02-23T07:46:47.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj73' 2026-02-23T07:46:47.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.433 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 128 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 128' 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.434 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj73 2026-02-23T07:46:47.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj73' 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj73 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj73 ' 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.436 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj72 2026-02-23T07:46:47.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj72' 2026-02-23T07:46:47.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj72 2026-02-23T07:46:47.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:46:47.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj72 ' 2026-02-23T07:46:47.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.438 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj59 2026-02-23T07:46:47.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj59' 2026-02-23T07:46:47.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj59 2026-02-23T07:46:47.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj59 ' 2026-02-23T07:46:47.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.440 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj44 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj44' 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj44 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj44 ' 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.442 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj77 2026-02-23T07:46:47.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj77' 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj77 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj77 ' 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.443 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj47 2026-02-23T07:46:47.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj47' 2026-02-23T07:46:47.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj47 2026-02-23T07:46:47.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj47 ' 2026-02-23T07:46:47.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.445 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj97 2026-02-23T07:46:47.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj97' 2026-02-23T07:46:47.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj97 2026-02-23T07:46:47.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj97 ' 2026-02-23T07:46:47.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.447 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj124 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj124' 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj124 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj124 ' 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.449 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj13 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj13' 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj13 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj13 ' 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.451 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj42 2026-02-23T07:46:47.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj42' 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj42 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj42 ' 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.452 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj83 2026-02-23T07:46:47.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj83' 2026-02-23T07:46:47.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj83 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj83 ' 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj6' 2026-02-23T07:46:47.454 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj6 2026-02-23T07:46:47.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj6 2026-02-23T07:46:47.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj6 ' 2026-02-23T07:46:47.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.456 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj84 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj84' 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj84 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj84 ' 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.458 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj2 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj2' 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj2 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj2 ' 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.459 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj60 2026-02-23T07:46:47.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj60' 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj60 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj60 ' 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.461 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj86 2026-02-23T07:46:47.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj86' 2026-02-23T07:46:47.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj86 2026-02-23T07:46:47.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:46:47.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj86 ' 2026-02-23T07:46:47.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj115' 2026-02-23T07:46:47.463 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj115 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj115 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj115 ' 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.464 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj80 2026-02-23T07:46:47.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj80' 2026-02-23T07:46:47.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj80 2026-02-23T07:46:47.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj80 ' 2026-02-23T07:46:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.466 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj15 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj15' 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj15 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj15 ' 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.468 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj94 2026-02-23T07:46:47.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj94' 2026-02-23T07:46:47.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj94 2026-02-23T07:46:47.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj94 ' 2026-02-23T07:46:47.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.469 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj67 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj67' 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj67 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj67 ' 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj65' 2026-02-23T07:46:47.471 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj65 2026-02-23T07:46:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj65 2026-02-23T07:46:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:46:47.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj65 ' 2026-02-23T07:46:47.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.472 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj103 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj103' 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj103 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj103 ' 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.473 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj125 2026-02-23T07:46:47.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj125' 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj125 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj125 ' 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 24 )) 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=24 )) 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj116 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj116: acting: 1 0 2' 2026-02-23T07:46:47.475 INFO:tasks.workunit.client.0.trial129.stdout:Object obj116: acting: 1 0 2 2026-02-23T07:46:47.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.476 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.477 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj116 (24) 0 2 1 2026-02-23T07:46:47.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj116 (24) 0 2 1' 2026-02-23T07:46:47.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj116' 2026-02-23T07:46:47.478 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj116 2026-02-23T07:46:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj116 ' 2026-02-23T07:46:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj89 2026-02-23T07:46:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.479 INFO:tasks.workunit.client.0.trial129.stdout:Object obj89: acting: 1 2 0 2026-02-23T07:46:47.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj89: acting: 1 2 0' 2026-02-23T07:46:47.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.480 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.481 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj89 (25) 2 0 1 2026-02-23T07:46:47.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj89 (25) 2 0 1' 2026-02-23T07:46:47.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.482 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj89 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj89' 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj89 ' 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj20 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.483 INFO:tasks.workunit.client.0.trial129.stdout:Object obj20: acting: 1 0 2 2026-02-23T07:46:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj20: acting: 1 0 2' 2026-02-23T07:46:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.484 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj20 (26) 0 2 1' 2026-02-23T07:46:47.485 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj20 (26) 0 2 1 2026-02-23T07:46:47.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj20' 2026-02-23T07:46:47.486 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj20 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj20 ' 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj110 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj110: acting: 1 0 2' 2026-02-23T07:46:47.487 INFO:tasks.workunit.client.0.trial129.stdout:Object obj110: acting: 1 0 2 2026-02-23T07:46:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.488 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj110 (27) 0 2 1' 2026-02-23T07:46:47.489 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj110 (27) 0 2 1 2026-02-23T07:46:47.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.490 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj110 2026-02-23T07:46:47.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj110' 2026-02-23T07:46:47.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj110 ' 2026-02-23T07:46:47.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1 2026-02-23T07:46:47.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1: acting: 1 2 0' 2026-02-23T07:46:47.491 INFO:tasks.workunit.client.0.trial129.stdout:Object obj1: acting: 1 2 0 2026-02-23T07:46:47.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.492 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.492 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj1 (28) 2 0 1 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1 (28) 2 0 1' 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj1 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj1' 2026-02-23T07:46:47.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1 ' 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj28 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stdout:Object obj28: acting: 2 0 1 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj28: acting: 2 0 1' 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:46:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.495 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:46:47.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj28 (29) 0 1 2' 2026-02-23T07:46:47.495 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj28 (29) 0 1 2 2026-02-23T07:46:47.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:46:47.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.496 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj28 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj28' 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj28 ' 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj101 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.497 INFO:tasks.workunit.client.0.trial129.stdout:Object obj101: acting: 1 0 2 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj101: acting: 1 0 2' 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.498 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj101 (30) 0 2 1 2026-02-23T07:46:47.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj101 (30) 0 2 1' 2026-02-23T07:46:47.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj101' 2026-02-23T07:46:47.499 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj101 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj101 ' 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj21 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stdout:Object obj21: acting: 1 0 2 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj21: acting: 1 0 2' 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.501 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.501 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj21 (31) 0 2 1 2026-02-23T07:46:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj21 (31) 0 2 1' 2026-02-23T07:46:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj21' 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj21 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj21 ' 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj33 2026-02-23T07:46:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stdout:Object obj33: acting: 0 1 2 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj33: acting: 0 1 2' 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.504 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj33 (32) 1 2 0 2026-02-23T07:46:47.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj33 (32) 1 2 0' 2026-02-23T07:46:47.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-23T07:46:47.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.504 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj33 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj33' 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj33 ' 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj93 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stdout:Object obj93: acting: 1 0 2 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj93: acting: 1 0 2' 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj93 (33) 0 2 1' 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj93 (33) 0 2 1 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj93 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj93' 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj93 ' 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj64 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.507 INFO:tasks.workunit.client.0.trial129.stdout:Object obj64: acting: 0 1 2 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj64: acting: 0 1 2' 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj64 (34) 1 2 0' 2026-02-23T07:46:47.508 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj64 (34) 1 2 0 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj64 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj64' 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj64 ' 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj32 2026-02-23T07:46:47.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stdout:Object obj32: acting: 1 2 0 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj32: acting: 1 2 0' 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj32 (35) 2 0 1' 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj32 (35) 2 0 1 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj32 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj32' 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj32 ' 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj113 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stdout:Object obj113: acting: 1 2 0 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj113: acting: 1 2 0' 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.513 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj113 (36) 2 0 1 2026-02-23T07:46:47.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj113 (36) 2 0 1' 2026-02-23T07:46:47.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.513 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj113 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj113' 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj113 ' 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj45 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj45: acting: 1 2 0' 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stdout:Object obj45: acting: 1 2 0 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.514 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj45 (37) 2 0 1 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj45 (37) 2 0 1' 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.515 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj45 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj45' 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj45 ' 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj106 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stdout:Object obj106: acting: 1 2 0 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj106: acting: 1 2 0' 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.516 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj106 (38) 2 0 1 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj106 (38) 2 0 1' 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj106' 2026-02-23T07:46:47.517 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj106 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj106 ' 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj46 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stdout:Object obj46: acting: 1 0 2 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj46: acting: 1 0 2' 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj46 (39) 0 2 1 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj46 (39) 0 2 1' 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj46 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj46' 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj46 ' 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj36 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stdout:Object obj36: acting: 2 0 1 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj36: acting: 2 0 1' 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.520 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj36 (40) 0 1 2 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj36 (40) 0 1 2' 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj36 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj36' 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj36 ' 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj108 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.521 INFO:tasks.workunit.client.0.trial129.stdout:Object obj108: acting: 0 1 2 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj108: acting: 0 1 2' 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj108 (41) 1 2 0 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj108 (41) 1 2 0' 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj108 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj108' 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj108 ' 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj95 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stdout:Object obj95: acting: 1 2 0 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj95: acting: 1 2 0' 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj95 (42) 2 0 1 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj95 (42) 2 0 1' 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.524 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj95 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj95' 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj95 ' 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj127 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj127: acting: 1 2 0' 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stdout:Object obj127: acting: 1 2 0 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj127 (43) 2 0 1 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj127 (43) 2 0 1' 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj127 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj127' 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj127 ' 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj62 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.526 INFO:tasks.workunit.client.0.trial129.stdout:Object obj62: acting: 1 0 2 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj62: acting: 1 0 2' 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj62 (44) 0 2 1 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj62 (44) 0 2 1' 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj62' 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj62 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj62 ' 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj90 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stdout:Object obj90: acting: 2 0 1 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj90: acting: 2 0 1' 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.528 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj90 (45) 0 1 2 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj90 (45) 0 1 2' 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj90 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj90' 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj90 ' 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj98 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stdout:Object obj98: acting: 1 0 2 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj98: acting: 1 0 2' 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj98 (46) 0 2 1 2026-02-23T07:46:47.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj98 (46) 0 2 1' 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj98' 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj98 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj98 ' 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj118 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stdout:Object obj118: acting: 1 0 2 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj118: acting: 1 0 2' 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:46:47.531 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj118 (47) 0 2 1 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj118 (47) 0 2 1' 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj118 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj118' 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj118 ' 2026-02-23T07:46:47.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:46:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 48 )) 2026-02-23T07:46:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:46:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:46:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:46:47.534 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:46:47.534 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:46:47.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:47.541 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:46:47.541 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:46:47.541 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:47.548 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:46:47.549 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:46:47.549 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:46:47.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:46:47.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:46:47.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:46:47.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:46:47.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:46:47.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:46:47.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:46:47.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:46:48.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:46:48.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:46:48.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj72 obj44 obj86 ' 2026-02-23T07:46:48.866 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj72 obj44 obj86 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:48.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj72 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj72 2026-02-23T07:46:48.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj72 rm-attr _ 2026-02-23T07:46:49.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:49.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:49.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:49.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:46:49.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:46:49.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:49.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:49.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:49.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:49.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj44 2026-02-23T07:46:49.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:49.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj44 2026-02-23T07:46:49.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj44 rm-attr _ 2026-02-23T07:46:49.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:49.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj86 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj86 2026-02-23T07:46:49.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj86 rm-attr _ 2026-02-23T07:46:49.346 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:49.346 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj116 obj89 obj20 obj101 obj32 obj45 obj36 obj127 obj62 obj98 ' obj_to_pgid delete_oi 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj116 obj89 obj20 obj101 obj32 obj45 obj36 obj127 obj62 obj98 ' 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj116 obj89 obj20 obj101 obj32 obj45 obj36 obj127 obj62 obj98 ]] 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:46:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj116 obj89 obj20 obj101 obj32 obj45 obj36 obj127 obj62 obj98 ' 2026-02-23T07:46:49.402 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj116 obj89 obj20 obj101 obj32 obj45 obj36 obj127 obj62 obj98 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj116 2026-02-23T07:46:49.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:49.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj116 2026-02-23T07:46:49.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj116 rm-attr _ 2026-02-23T07:46:49.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:49.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:49.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:49.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj89 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj89 2026-02-23T07:46:49.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj89 rm-attr _ 2026-02-23T07:46:49.678 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:49.679 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:49.679 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:49.679 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:49.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:49.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:49.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:49.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:46:49.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:46:49.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:49.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:49.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj20 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj20 2026-02-23T07:46:49.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj20 rm-attr _ 2026-02-23T07:46:49.849 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:49.849 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:49.849 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:49.849 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:49.849 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:49.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:49.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:49.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:49.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:49.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:49.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj101 2026-02-23T07:46:49.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:49.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:49.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj101 2026-02-23T07:46:49.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj101 rm-attr _ 2026-02-23T07:46:49.997 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:49.997 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:49.997 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:49.997 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:49.997 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:49.998 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:50.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj32 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj32 2026-02-23T07:46:50.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj32 rm-attr _ 2026-02-23T07:46:50.157 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:50.157 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:50.157 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:50.158 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:50.158 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:50.158 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.158 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:46:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:46:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:46:50.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:50.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj45 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj45 2026-02-23T07:46:50.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj45 rm-attr _ 2026-02-23T07:46:50.323 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:50.323 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:46:50.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:50.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:50.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:50.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:50.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:50.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:50.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:50.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:50.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj36 2026-02-23T07:46:50.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:50.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:50.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj36 2026-02-23T07:46:50.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj36 rm-attr _ 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.495 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:46:50.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:50.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj127 2026-02-23T07:46:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj127 2026-02-23T07:46:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj127 rm-attr _ 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:46:50.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:50.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj62 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj62 2026-02-23T07:46:50.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj62 rm-attr _ 2026-02-23T07:46:50.771 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:50.771 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:50.772 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:50.773 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.773 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:46:50.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:50.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:50.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:50.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:46:50.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:46:50.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:50.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:50.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj98 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj98 2026-02-23T07:46:50.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj98 rm-attr _ 2026-02-23T07:46:50.952 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7c121b42:::obj116:head#, (61) No data available 2026-02-23T07:46:50.952 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b33086a8:::obj36:head#, (61) No data available 2026-02-23T07:46:50.952 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c275c16a:::obj32:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cc461e5d:::obj45:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e46d208d:::obj89:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4851a45a:::obj44:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:492a75ed:::obj72:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b1d3252:::obj86:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:02817247:::obj101:head#, (61) No data available 2026-02-23T07:46:50.953 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:46:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:46:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:46:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:46:51.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj73 obj47 obj83 obj6 obj84 obj2 obj60 obj115 obj80 obj94 obj67 obj103 obj125 ' 2026-02-23T07:46:51.013 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj73 obj47 obj83 obj6 obj84 obj2 obj60 obj115 obj80 obj94 obj67 obj103 obj125 2026-02-23T07:46:51.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:46:51.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj73 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj73 2026-02-23T07:46:51.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj73 rm-attr _ 2026-02-23T07:46:51.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:51.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:51.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:51.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:51.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj47 2026-02-23T07:46:51.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:51.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:51.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj47 2026-02-23T07:46:51.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj47 rm-attr _ 2026-02-23T07:46:51.300 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:51.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj83 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj83 2026-02-23T07:46:51.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj83 rm-attr _ 2026-02-23T07:46:51.472 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:51.473 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:51.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:46:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:46:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:51.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:51.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:51.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj6 2026-02-23T07:46:51.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:51.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:51.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj6 2026-02-23T07:46:51.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj6 rm-attr _ 2026-02-23T07:46:51.639 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:51.639 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:51.639 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:51.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:51.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:51.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:51.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:46:51.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:46:51.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:51.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:51.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:51.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:51.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj84 2026-02-23T07:46:51.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:51.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:51.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj84 2026-02-23T07:46:51.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj84 rm-attr _ 2026-02-23T07:46:51.823 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:51.823 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:51.823 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:51.823 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:51.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:51.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj2 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2 2026-02-23T07:46:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj2 rm-attr _ 2026-02-23T07:46:52.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:52.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:52.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:52.007 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:52.008 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:52.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:52.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:52.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:52.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:52.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:52.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:52.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj60 2026-02-23T07:46:52.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:52.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:52.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj60 2026-02-23T07:46:52.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj60 rm-attr _ 2026-02-23T07:46:52.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:52.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:52.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:52.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:52.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:52.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:52.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj115 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj115 2026-02-23T07:46:52.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj115 rm-attr _ 2026-02-23T07:46:52.334 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:52.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:52.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:52.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:52.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:52.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:52.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:52.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:52.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:52.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:52.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:46:52.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:46:52.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:52.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:52.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:52.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:52.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj80 2026-02-23T07:46:52.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:52.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:52.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj80 2026-02-23T07:46:52.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj80 rm-attr _ 2026-02-23T07:46:52.548 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:52.548 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:52.548 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:52.548 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:52.548 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:52.549 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:52.549 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:52.549 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:52.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:52.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:52.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:52.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:46:52.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:46:52.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:52.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj94 2026-02-23T07:46:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:52.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj94 2026-02-23T07:46:52.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj94 rm-attr _ 2026-02-23T07:46:52.712 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:52.713 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:52.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:52.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:52.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:52.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:46:52.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:46:52.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:52.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:52.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:52.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:52.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj67 2026-02-23T07:46:52.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:52.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:52.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj67 2026-02-23T07:46:52.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj67 rm-attr _ 2026-02-23T07:46:52.876 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:52.876 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:52.876 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:52.876 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:52.876 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:52.876 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:52.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:52.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:52.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:52.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:52.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj103 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj103 2026-02-23T07:46:52.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj103 rm-attr _ 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:53.035 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:53.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj125 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj125 2026-02-23T07:46:53.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj125 rm-attr _ 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:53.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:53.206 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:53.206 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:53.206 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-23T07:46:53.206 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj28 obj33 obj64 obj90 ' obj_to_pgid delete_oi 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj28 obj33 obj64 obj90 ' 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:46:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj28 obj33 obj64 obj90 ]] 2026-02-23T07:46:53.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:46:53.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj28 obj33 obj64 obj90 ' 2026-02-23T07:46:53.261 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj28 obj33 obj64 obj90 2026-02-23T07:46:53.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:46:53.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:53.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:46:53.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:46:53.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj28 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj28 2026-02-23T07:46:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj28 rm-attr _ 2026-02-23T07:46:53.355 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:53.356 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:53.357 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:53.357 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-23T07:46:53.357 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:46:53.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:53.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:53.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj33 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj33 2026-02-23T07:46:53.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj33 rm-attr _ 2026-02-23T07:46:53.526 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:53.526 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:53.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-23T07:46:53.528 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:53.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:53.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:53.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj64 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj64 2026-02-23T07:46:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj64 rm-attr _ 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:46:53.684 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-23T07:46:53.685 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:53.685 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:53.685 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:53.685 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-23T07:46:53.685 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:53.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:53.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:53.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:53.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:46:53.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:46:53.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:53.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:53.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:53.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:53.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj90 2026-02-23T07:46:53.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:46:53.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj90 2026-02-23T07:46:53.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj90 rm-attr _ 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:64c1dddc:::obj83:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:73627f05:::obj80:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1c8135f:::obj67:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ecbe4ab7:::obj125:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f2bc7f0e:::obj94:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:233a42c1:::obj6:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:27794e2d:::obj115:head#, (61) No data available 2026-02-23T07:46:53.843 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3efbd745:::obj84:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:541e28f4:::obj33:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:5880e7a7:::obj64:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:81617860:::obj28:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:04510f17:::obj73:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a1150ce:::obj60:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1a20990d:::obj103:head#, (61) No data available 2026-02-23T07:46:53.844 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1dafe4f0:::obj47:head#, (61) No data available 2026-02-23T07:46:53.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:53.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:53.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:46:53.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:46:53.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:46:53.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj59 obj77 obj97 obj124 obj13 obj42 obj15 obj65 ' 2026-02-23T07:46:53.901 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj59 obj77 obj97 obj124 obj13 obj42 obj15 obj65 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:53.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj59 2026-02-23T07:46:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj59 2026-02-23T07:46:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj59 rm-attr _ 2026-02-23T07:46:54.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:54.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:54.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:54.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:46:54.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:46:54.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:54.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj77 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj77 2026-02-23T07:46:54.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj77 rm-attr _ 2026-02-23T07:46:54.175 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:46:54.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:54.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj97 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj97 2026-02-23T07:46:54.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj97 rm-attr _ 2026-02-23T07:46:54.345 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:54.345 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:54.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:54.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:54.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:46:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:46:54.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:54.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:54.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:54.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:54.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj124 2026-02-23T07:46:54.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:54.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:54.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj124 2026-02-23T07:46:54.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj124 rm-attr _ 2026-02-23T07:46:54.507 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:54.507 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:54.507 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:54.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:54.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:54.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:54.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:46:54.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:46:54.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:54.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:54.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:54.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:54.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj13 2026-02-23T07:46:54.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:54.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:54.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj13 2026-02-23T07:46:54.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj13 rm-attr _ 2026-02-23T07:46:54.687 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:54.687 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:54.687 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:54.688 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:54.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj42 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj42 2026-02-23T07:46:54.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj42 rm-attr _ 2026-02-23T07:46:54.839 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:54.839 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:54.839 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:54.839 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:54.839 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:46:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:46:54.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:54.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj15 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-23T07:46:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj15 rm-attr _ 2026-02-23T07:46:54.983 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:54.983 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:54.983 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:54.983 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:54.983 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:54.983 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:46:55.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:55.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj65 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj65 2026-02-23T07:46:55.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj65 rm-attr _ 2026-02-23T07:46:55.150 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:55.150 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:55.150 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:55.151 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:55.151 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:55.151 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:55.151 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj110 obj1 obj21 obj93 obj113 obj106 obj46 obj108 obj95 obj118 ' obj_to_pgid delete_oi 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj110 obj1 obj21 obj93 obj113 obj106 obj46 obj108 obj95 obj118 ' 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:46:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:46:55.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:46:55.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj110 obj1 obj21 obj93 obj113 obj106 obj46 obj108 obj95 obj118 ]] 2026-02-23T07:46:55.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:46:55.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj110 obj1 obj21 obj93 obj113 obj106 obj46 obj108 obj95 obj118 ' 2026-02-23T07:46:55.205 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj110 obj1 obj21 obj93 obj113 obj106 obj46 obj108 obj95 obj118 2026-02-23T07:46:55.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:46:55.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:55.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj110 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj110 2026-02-23T07:46:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj110 rm-attr _ 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:55.301 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:55.302 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:55.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1 2026-02-23T07:46:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1 rm-attr _ 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:55.461 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:55.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:55.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:55.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:55.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:55.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:55.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj21 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj21 2026-02-23T07:46:55.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj21 rm-attr _ 2026-02-23T07:46:55.614 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:55.615 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:55.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj93 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj93 2026-02-23T07:46:55.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj93 rm-attr _ 2026-02-23T07:46:55.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:55.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:55.793 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.793 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:55.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:55.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:55.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:55.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:46:55.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:46:55.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:55.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:55.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:55.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:55.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:55.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj113 2026-02-23T07:46:55.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:55.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:55.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj113 2026-02-23T07:46:55.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj113 rm-attr _ 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:55.961 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:55.962 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-23T07:46:55.962 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:55.962 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:55.962 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:55.962 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:56.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj106 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj106 2026-02-23T07:46:56.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj106 rm-attr _ 2026-02-23T07:46:56.117 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:56.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:56.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:56.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:56.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:56.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:56.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:46:56.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:56.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-23T07:46:56.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:56.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:56.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:56.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:56.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:56.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:46:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:46:56.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:56.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj46 2026-02-23T07:46:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj46 2026-02-23T07:46:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj46 rm-attr _ 2026-02-23T07:46:56.277 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:56.277 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:56.277 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:56.278 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:56.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:56.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:56.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:56.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj108 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj108 2026-02-23T07:46:56.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj108 rm-attr _ 2026-02-23T07:46:56.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:56.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:56.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:56.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:56.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:56.460 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:56.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:56.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:56.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:56.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:56.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj95 2026-02-23T07:46:56.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:56.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:56.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj95 2026-02-23T07:46:56.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj95 rm-attr _ 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:46:56.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:56.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:56.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:56.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:56.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:46:56.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:46:56.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:46:56.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:46:56.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:46:56.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:46:56.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:46:56.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:46:56.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj118 2026-02-23T07:46:56.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:46:56.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:46:56.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj118 2026-02-23T07:46:56.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj118 rm-attr _ 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:76f9746b:::obj110:head#, (61) No data available 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a61ad63e:::obj13:head#, (61) No data available 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ab946124:::obj15:head#, (61) No data available 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b70eecc2:::obj59:head#, (61) No data available 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:bec6553a:::obj65:head#, (61) No data available 2026-02-23T07:46:56.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d4c3bba7:::obj106:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:339fd60b:::obj93:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3fe0a5f5:::obj46:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4911cfa9:::obj108:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8250b831:::obj124:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:84c1344d:::obj97:head#, (61) No data available 2026-02-23T07:46:56.791 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8cdc434f:::obj77:head#, (61) No data available 2026-02-23T07:46:56.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1243fe1a:::obj21:head#, (61) No data available 2026-02-23T07:46:56.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:46:56.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:46:56.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:46:56.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:46:56.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:47:07.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:47:12.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:47:13.127 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686500+0000 20'14 32:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-23T07:47:00.686727+0000 20'16 32:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-23T07:47:00.686277+0000 20'23 32:60 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686669+0000 20'14 32:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686896+0000 20'14 32:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-23T07:47:00.686340+0000 20'12 32:69 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:47:00.686246+0000 20'11 32:52 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.128 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-23T07:47:00.686684+0000 20'24 32:74 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:13.129 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:47:13.129 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:47:13.129 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:47:13.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:13.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:47:13.139 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:47:13.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:47:13.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:47:13.214 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:47:13.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:47:13.278 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:47:13.279 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:47:13.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:13.286 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:47:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:47:13.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:13.293 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:47:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:47:13.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:13.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:47:14.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:47:14.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832834304742981 2026-02-23T07:47:14.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:47:14.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:47:14.306271768' 2026-02-23T07:47:14.307 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:47:14.306271768 2026-02-23T07:47:14.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:47:14.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:47:14.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:47:14.458 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:47:14.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:47:14.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832834472654715 2026-02-23T07:47:14.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:47:14.474 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:47:14.473816424 (167 ms) 2026-02-23T07:47:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:47:14.473816424 (167 ms)' 2026-02-23T07:47:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:47:14.475 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:47:14.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-23T07:47:14.476 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-23T07:47:14.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.477 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-23T07:47:14.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-23T07:47:14.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.478 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-23T07:47:14.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-23T07:47:14.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.479 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-23T07:47:14.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-23T07:47:14.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.481 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:47:14.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:47:14.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.482 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:47:14.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:47:14.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.483 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:47:14.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:47:14.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:47:14.484 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:47:14.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:47:14.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:47:14.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:47:14.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686500+0000 20'14 32:57 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-23T07:47:00.686727+0000 20'16 32:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-23T07:47:00.686277+0000 20'23 32:60 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686669+0000 20'14 32:59 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686896+0000 20'14 32:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-23T07:47:00.686340+0000 20'12 32:69 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:47:00.686246+0000 20'11 32:53 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-23T07:47:00.686684+0000 20'24 32:75 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:47:14.793 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:47:14.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:47:14.870 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:47:14.870 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:14.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:14.876 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:47:14.876 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:14.876 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:14.883 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:47:14.883 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:14.883 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:14.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:47:14.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832834892831374 2026-02-23T07:47:14.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:14.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:47:14.893 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:47:14.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:47:14.958 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:14.958 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:14.958 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:14.959 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:14.959 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:14.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:14.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:14.967 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:47:14.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:47:14.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:47:15.031 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.031 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.031 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.031 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.031 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:15.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:15.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:47:15.039 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:47:15.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:47:15.102 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.102 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.102 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.102 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.102 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:15.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:15.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:47:15.110 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:47:15.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:47:15.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.173 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.173 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.173 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:15.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:15.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:47:15.181 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:47:15.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:47:15.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.244 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.244 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.244 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.244 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:15.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:15.252 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:47:15.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:47:15.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:47:15.316 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.316 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.316 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.316 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.316 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:15.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:15.325 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:47:15.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:47:15.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:47:15.389 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.389 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.389 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.389 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.389 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:15.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:15.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:47:15.397 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:47:15.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:47:15.459 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:15.460 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:47:15.460 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:47:15.460 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:47:15.460 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:47:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:47:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:47:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:47:15.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:47:15.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:47:15.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:47:15.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:47:15.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:47:15.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832835631026351 2026-02-23T07:47:15.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=738 2026-02-23T07:47:15.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:47:15.695 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:47:15.695 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:15.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.701 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:47:15.702 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:15.702 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.708 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:47:15.708 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:15.709 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:15.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:47:17.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686500+0000 20'14 32:58 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-23T07:47:00.686727+0000 20'16 32:60 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean+inconsistent 2026-02-23T07:47:15.314847+0000 20'23 32:73 [2,0,1] 2 [2,0,1] 2 20'23 2026-02-23T07:47:15.314824+0000 20'23 2026-02-23T07:47:15.314824+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:15.314824+0000 23 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean+inconsistent 2026-02-23T07:47:15.733344+0000 20'14 32:69 [1,0,2] 1 [1,0,2] 1 20'14 2026-02-23T07:47:15.733305+0000 20'14 2026-02-23T07:47:15.733305+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:15.733305+0000 14 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:00.686896+0000 20'14 32:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-23T07:47:00.686340+0000 20'12 32:70 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:47:00.686246+0000 20'11 32:53 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:17.870 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-23T07:47:00.686684+0000 20'24 32:76 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:46:28.972981+0000 0'0 2026-02-23T07:46:28.972981+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:46:28.972981+0000 0 0 2026-02-23T07:47:17.871 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:47:17.871 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:47:17.871 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:47:17.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_1 3 8 16 24 24 256 4194304 0 738 2026-02-23T07:47:17.880 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_1@ NAUT 3 8 16 24/ 24 256 4194304/ 0 738 2026-02-23T07:47:17.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.881 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:47:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:47:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:47:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.895 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:47:17.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.896 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:47:17.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:47:17.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:47:17.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.910 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:47:17.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:47:17.911 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:47:17.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:47:17.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.925 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:47:17.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:47:17.926 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:47:17.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:47:17.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.940 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:47:17.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:47:17.941 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:47:17.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:47:17.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.953 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.0 2026-02-23T07:47:17.953 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:47:17.955 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:47:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:47:17.955 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:47:17.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:47:17.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.970 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:47:17.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:47:17.970 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:47:17.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:47:17.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.985 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:47:17.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:17.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:47:17.986 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:47:17.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:47:17.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:47:17.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:47:17.998 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:47:17.998 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:47:17.999 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:47:18.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:47:18.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:47:23.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:47:23.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:47:23.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:47:23.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:47:23.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:47:23.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:47:23.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:47:23.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:47:23.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:47:23.725 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:47:23.726 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:23.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:23.733 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:47:23.733 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:23.733 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:23.740 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:47:23.740 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:23.740 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:23.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:47:23.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832843750517753 2026-02-23T07:47:23.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:23.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:47:23.901 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-23T07:47:23.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:23.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:47:24.064 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:47:24.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:24.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:47:24.225 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-23T07:47:24.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:24.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:47:24.386 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:47:24.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:24.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:47:24.548 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:47:24.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:24.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:47:24.710 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:47:24.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:24.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:47:24.871 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:47:24.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:47:24.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:47:25.032 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:47:25.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:47:25.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:47:25.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:47:25.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832845209385976 2026-02-23T07:47:25.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1458 2026-02-23T07:47:25.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:47:25.276 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:47:25.276 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:25.276 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:25.283 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:47:25.283 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:25.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:25.290 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:47:25.290 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:47:25.290 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:25.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:47:30.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:47:30.456 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:47:30.456 INFO:tasks.workunit.client.0.trial129.stdout:1.7 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:26.663417+0000 20'14 32:94 [1,2,0] 1 [1,2,0] 1 20'14 2026-02-23T07:47:26.659796+0000 20'14 2026-02-23T07:47:26.659796+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:26.659796+0000 14 0 2026-02-23T07:47:30.456 INFO:tasks.workunit.client.0.trial129.stdout:1.6 16 0 0 0 0 4096 0 0 16 0 16 active+clean 2026-02-23T07:47:25.624006+0000 20'16 32:99 [1,0,2] 1 [1,0,2] 1 20'16 2026-02-23T07:47:25.620601+0000 20'16 2026-02-23T07:47:25.620601+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:25.620601+0000 16 0 2026-02-23T07:47:30.456 INFO:tasks.workunit.client.0.trial129.stdout:1.5 23 0 0 0 0 5888 0 0 23 0 23 active+clean 2026-02-23T07:47:24.326638+0000 20'23 32:104 [2,0,1] 2 [2,0,1] 2 20'23 2026-02-23T07:47:24.323537+0000 20'23 2026-02-23T07:47:24.323537+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:24.323537+0000 23 0 2026-02-23T07:47:30.456 INFO:tasks.workunit.client.0.trial129.stdout:1.4 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:24.623713+0000 20'14 32:99 [1,0,2] 1 [1,0,2] 1 20'14 2026-02-23T07:47:24.620378+0000 20'14 2026-02-23T07:47:24.620378+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:24.620378+0000 14 0 2026-02-23T07:47:30.456 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:28.651508+0000 20'14 32:101 [1,2,0] 1 [1,2,0] 1 20'14 2026-02-23T07:47:28.647287+0000 20'14 2026-02-23T07:47:28.647287+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:28.647287+0000 14 0 2026-02-23T07:47:30.457 INFO:tasks.workunit.client.0.trial129.stdout:1.2 12 0 0 0 0 3072 0 0 12 0 12 active+clean 2026-02-23T07:47:25.496413+0000 20'12 32:111 [0,1,2] 0 [0,1,2] 0 20'12 2026-02-23T07:47:25.492613+0000 20'12 2026-02-23T07:47:25.492613+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:25.492613+0000 12 0 2026-02-23T07:47:30.457 INFO:tasks.workunit.client.0.trial129.stdout:1.1 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:47:25.307725+0000 20'11 32:94 [2,0,1] 2 [2,0,1] 2 20'11 2026-02-23T07:47:25.304338+0000 20'11 2026-02-23T07:47:25.304338+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:25.304338+0000 11 0 2026-02-23T07:47:30.457 INFO:tasks.workunit.client.0.trial129.stdout:1.0 24 0 0 0 0 6144 0 0 24 0 24 active+clean 2026-02-23T07:47:27.660285+0000 20'24 32:131 [1,0,2] 1 [1,0,2] 1 20'24 2026-02-23T07:47:27.654414+0000 20'24 2026-02-23T07:47:27.654414+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:47:27.654414+0000 24 0 2026-02-23T07:47:30.457 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:47:30.457 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:47:30.457 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:47:30.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_1 3 8 16 24 24 256 4194304 0 1458 2026-02-23T07:47:30.466 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_1@ REPR 3 8 16 24/ 24 256 4194304/ 0 1458 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0747 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:47:30.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:30.557 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.558 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.559 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.560 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 65536 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.561 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.005999972, 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002999986 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.562 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.563 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.564 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.565 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.566 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:30.567 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.568 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.569 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout: "value": 65536 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.570 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.005999972, 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002999986 2026-02-23T07:47:30.571 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.572 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.573 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.574 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.575 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:47:30.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:30.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:47:30.632 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:30.632 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.632 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 36, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.633 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:30.634 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:47:30.635 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.636 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "value": 65536 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:30.637 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.638 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.044999788, 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.004499978 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.639 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.640 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.641 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.642 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.643 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.644 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.645 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.646 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.647 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.648 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.649 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.650 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.651 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 36, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.652 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.653 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.654 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 65536 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.655 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.044999788, 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.004499978 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.656 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.657 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.658 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.659 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.660 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:47:30.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.706 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 16, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.707 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.708 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 256 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 65536 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.709 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.015999926, 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003999981 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:30.710 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.711 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.712 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.713 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:30.714 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.715 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 16, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.716 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:30.717 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 256 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 65536 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.718 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.015999926, 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003999981 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.719 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:30.720 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.721 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.722 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:47:30.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:39.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:47:39.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:39.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:47:39.100 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:39.100 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.101 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.102 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 9, 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.103 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.104 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.105 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.106 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.107 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "value": 98304 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.108 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.109 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.009999954, 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003333318 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.110 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.111 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.112 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.113 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:47:39.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:39.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.118 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.120 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.120 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.120 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:47:39.120 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.121 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:39.122 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 9, 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.123 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:39.124 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.126 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 98304 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:39.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.009999954, 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003333318 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.130 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.131 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.132 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.133 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.134 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.135 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.136 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:47:39.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:39.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:47:39.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:39.165 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.166 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 54, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.168 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 98304 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.169 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:39.170 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 15, 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.066999683, 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.004466645 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.171 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.172 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.173 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.174 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.175 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.176 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:39.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 54, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.178 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 98304 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:39.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 15, 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.066999683, 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.004466645 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:39.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:47:39.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.184 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.185 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.186 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:47:39.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.238 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 24, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:47:39.239 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 384 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 98304 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.240 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.024999884, 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.004166647 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.241 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.245 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 24, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:47:39.246 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout: "value": 384 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.247 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 98304 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.024999884, 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.004166647 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.249 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:47:39.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:47:52.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:47:52.401 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:47:52.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:47:52.601 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:47:52.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:47:52.806 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 64 256 4 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=64 2026-02-23T07:47:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-23T07:47:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:47:52.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:47:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832872820587510 2026-02-23T07:47:52.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-23T07:47:52.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-23T07:47:52.821 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:47:52.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.yYmdBK8TQl bs=256 count=1 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.8212e-05 s, 6.7 MB/s 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:47:52.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:52.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:53.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:53.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:53.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:53.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:53.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:47:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:47:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:47:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:47:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.yYmdBK8TQl 2026-02-23T07:47:53.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:47:53.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832873112041379 2026-02-23T07:47:53.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=291 2026-02-23T07:47:53.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 64 objects in pool test in 291 ms' 2026-02-23T07:47:53.113 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 64 objects in pool test in 291 ms 2026-02-23T07:47:53.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:47:53.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:47:53.113263080' 2026-02-23T07:47:53.114 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:47:53.113263080 2026-02-23T07:47:53.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:47:53.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:47:53.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:47:53.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:47:53.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:47:53.116 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:47:53.116 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:47:53.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:47:53.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:47:53.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:47:53.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:47:53.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:47:53.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:47:53.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:47:53.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:47:53.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:47:53.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:47:53.367 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:47:53.367 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:47:53.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:47:53.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:47:53.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:47:53.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T07:47:53.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T07:47:53.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T07:47:53.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:47:53.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:47:53.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-23T07:47:53.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-23T07:47:53.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676' 2026-02-23T07:47:53.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:47:53.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:47:53.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-23T07:47:53.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-23T07:47:53.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676 2-60129542154' 2026-02-23T07:47:53.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:47:53.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T07:47:53.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:47:53.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:47:53.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T07:47:53.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:47:53.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T07:47:53.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T07:47:53.592 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836494 2026-02-23T07:47:53.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:47:53.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T07:47:53.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:47:53.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-23T07:47:53.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:47:53.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:47:53.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-23T07:47:53.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:47:53.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-23T07:47:53.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-23T07:47:53.767 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705676 2026-02-23T07:47:53.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:47:53.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-23T07:47:53.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:47:53.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-23T07:47:53.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:47:53.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:47:53.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-23T07:47:53.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:47:53.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-23T07:47:53.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-23T07:47:53.934 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542154 2026-02-23T07:47:53.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:47:54.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-23T07:47:54.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:47:54.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:47:54.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:47:54.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:47:54.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:47:54.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:47:54.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:47:54.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:47:54.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:47:54.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:47:54.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:47:54.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:47:54.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:47:54.823 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:47:54.823 INFO:tasks.workunit.client.0.trial129.stdout: nothing is going on 2026-02-23T07:47:54.823 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:47:54.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:47:54.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:47:59.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:46.452780+0000 20'14 20:34 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:47:46.452564+0000 20'14 20:34 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:47:46.452644+0000 20'19 20:42 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:47:46.452781+0000 20'17 20:38 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:47:59.989 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:47:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:47:59.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:48:00.000 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:48:00.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:48:00.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:48:00.071 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:48:00.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:48:00.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:48:00.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:48:00.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:48:00.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:48:00.144847518' 2026-02-23T07:48:00.145 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:48:00.144847518 2026-02-23T07:48:00.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:48:00.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832880146074840 2026-02-23T07:48:00.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:48:00.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 64 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=64 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:48:00.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:48:01.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:48:01.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832881190911953 2026-02-23T07:48:01.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:48:01.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:48:01.192176284 (1044 ms)' 2026-02-23T07:48:01.192 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:48:01.192176284 (1044 ms) 2026-02-23T07:48:01.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=10 2026-02-23T07:48:01.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:48:01.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 10 2026-02-23T07:48:01.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj64 obj62 obj63 obj60 obj61 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 10' 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 10 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj42 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj42' 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.194 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 64 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 64' 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj42 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj42' 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj42 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:48:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj42 ' 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj54 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj54' 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj54 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj54 ' 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.196 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj7 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj7' 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj7 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj7 ' 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.197 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj62 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj62' 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj62 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj62 ' 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj23 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj23' 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj23 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj23 ' 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj57 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj57' 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj57 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj57 ' 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.199 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj39 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj39' 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj39 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj39 ' 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj29 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj29' 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj29 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:48:01.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj29 ' 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj10' 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj10 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj10 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj10 ' 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:01.202 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj6 2026-02-23T07:48:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj6' 2026-02-23T07:48:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj6 2026-02-23T07:48:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:48:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj6 ' 2026-02-23T07:48:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:48:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=10 )) 2026-02-23T07:48:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:48:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:48:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:48:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:48:01.259 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:48:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:48:01.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:01.266 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:48:01.266 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:48:01.266 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:01.273 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:48:01.273 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:48:01.273 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:01.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:48:01.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:48:01.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:48:01.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:48:01.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:48:01.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:48:01.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:48:01.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:48:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:48:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:48:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj57 obj39 ' 2026-02-23T07:48:02.590 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj57 obj39 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:02.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj57 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj57 2026-02-23T07:48:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj57 rm-attr _ 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:02.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:02.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:02.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:02.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:02.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj39 2026-02-23T07:48:02.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:02.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:48:02.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj39 2026-02-23T07:48:02.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj39 rm-attr _ 2026-02-23T07:48:02.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:7135fd38:::obj57:head#, (61) No data available 2026-02-23T07:48:02.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:02.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 '' obj_to_pgid delete_oi 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-23T07:48:02.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:48:02.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:48:02.940 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj62 obj23 obj29 obj10 obj6 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj62 obj23 obj29 obj10 obj6 ' 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:02.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:02.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj62 2026-02-23T07:48:02.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:02.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:48:02.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj62 2026-02-23T07:48:02.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj62 rm-attr _ 2026-02-23T07:48:03.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:03.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:03.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:03.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:48:03.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:48:03.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:03.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj23 2026-02-23T07:48:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:48:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj23 2026-02-23T07:48:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj23 rm-attr _ 2026-02-23T07:48:03.218 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:48:03.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:03.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:03.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj29 2026-02-23T07:48:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:48:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj29 2026-02-23T07:48:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj29 rm-attr _ 2026-02-23T07:48:03.380 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:48:03.380 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:48:03.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:03.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:03.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:03.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:48:03.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:48:03.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:03.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:03.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:03.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:03.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj10 2026-02-23T07:48:03.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:48:03.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj10 2026-02-23T07:48:03.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj10 rm-attr _ 2026-02-23T07:48:03.539 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-23T07:48:03.539 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:48:03.539 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:48:03.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:48:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:48:03.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:03.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:03.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj6 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj6 2026-02-23T07:48:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj6 rm-attr _ 2026-02-23T07:48:03.736 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c3ba172d:::obj29:head#, (61) No data available 2026-02-23T07:48:03.737 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:d1337354:::obj10:head#, (61) No data available 2026-02-23T07:48:03.737 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:48:03.737 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:242c40e0:::obj23:head#, (61) No data available 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 '' obj_to_pgid delete_oi 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:48:03.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:48:03.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:48:03.801 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj42 obj54 obj7 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj42 obj54 obj7 ' 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:48:03.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj42 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj42 2026-02-23T07:48:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj42 rm-attr _ 2026-02-23T07:48:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:03.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:03.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:48:03.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:48:03.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:03.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj54 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj54 2026-02-23T07:48:03.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj54 rm-attr _ 2026-02-23T07:48:04.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:48:04.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:48:04.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:48:04.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj7 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-23T07:48:04.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj7 rm-attr _ 2026-02-23T07:48:04.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:a25cd2bd:::obj42:head#, (61) No data available 2026-02-23T07:48:04.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:bb038e88:::obj54:head#, (61) No data available 2026-02-23T07:48:04.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:48:04.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:48:04.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 '' obj_to_pgid delete_oi 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local objects_to_modify= 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z '' ]] 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:151: modify_obs_of_an_osd: return 0 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:48:04.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:48:15.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:48:20.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:48:20.557 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:48:20.557 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:08.279222+0000 20'14 34:59 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:20.557 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:08.279168+0000 20'14 34:68 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:20.557 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:48:08.181983+0000 20'19 34:61 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:20.558 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:48:08.279362+0000 20'17 34:67 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:20.558 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:48:20.558 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:48:20.558 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:48:20.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:48:20.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:48:20.568 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:48:20.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:48:20.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:48:20.641 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:48:20.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:48:20.706 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:48:20.706 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:48:20.706 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:20.713 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:48:20.713 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:48:20.713 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:20.720 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:48:20.720 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:48:20.720 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:20.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:48:21.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:48:21.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832901730696275 2026-02-23T07:48:21.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:48:21.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:48:21.732401312' 2026-02-23T07:48:21.732 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:48:21.732401312 2026-02-23T07:48:21.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:48:21.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:48:21.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:48:21.884 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:48:21.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:48:21.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832901898077451 2026-02-23T07:48:21.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:48:21.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:48:21.899414358 (167 ms)' 2026-02-23T07:48:21.899 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:48:21.899414358 (167 ms) 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:48:21.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:48:21.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:48:21.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:48:22.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:48:22.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:48:22.220 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:48:22.220 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:08.279222+0000 20'14 34:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:22.220 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:08.279168+0000 20'14 34:68 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:22.221 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:48:08.181983+0000 20'19 34:62 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:22.221 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:48:08.279362+0000 20'17 34:68 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:22.221 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:48:22.221 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:48:22.221 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:48:22.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:48:22.295 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:48:22.295 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:22.295 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.302 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:48:22.302 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:22.302 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.310 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:48:22.310 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:22.310 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:48:22.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832902320132404 2026-02-23T07:48:22.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:22.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:48:22.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:48:22.320 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:48:22.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:48:22.385 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:22.385 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:48:22.385 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:48:22.385 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:48:22.385 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:22.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:48:22.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:48:22.394 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:48:22.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:48:22.457 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:22.457 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:48:22.457 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:48:22.457 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:48:22.457 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:22.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:48:22.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:48:22.468 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:48:22.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:48:22.533 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:22.534 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:48:22.534 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:48:22.534 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:48:22.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:22.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:48:22.542 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:48:22.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:48:22.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:48:22.604 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:22.604 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:48:22.604 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:48:22.604 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:48:22.605 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:48:22.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:48:22.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:48:22.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:48:22.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832902783078257 2026-02-23T07:48:22.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=462 2026-02-23T07:48:22.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:48:22.847 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:48:22.848 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:22.848 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.854 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:48:22.854 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:22.854 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.861 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:48:22.861 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:22.861 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:22.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:48:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:08.279222+0000 20'14 34:60 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:47:46.347539+0000 0 0 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean+inconsistent 2026-02-23T07:48:22.875803+0000 20'14 34:79 [0,1,2] 0 [0,1,2] 0 20'14 2026-02-23T07:48:22.875770+0000 20'14 2026-02-23T07:48:22.875770+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:48:22.875770+0000 14 0 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:48:08.181983+0000 20'19 34:63 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:47:46.347539+0000 0'0 2026-02-23T07:47:46.347539+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean+inconsistent 2026-02-23T07:48:22.524624+0000 20'17 34:81 [1,0,2] 1 [1,0,2] 1 20'17 2026-02-23T07:48:22.524591+0000 20'17 2026-02-23T07:48:22.524591+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:48:22.524591+0000 17 0 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:48:25.026 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:48:25.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2 3 4 16 10 0 256 4194304 0 462 2026-02-23T07:48:25.036 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_2@ NAUT 3 4 16 10/ 0 256 4194304/ 0 462 2026-02-23T07:48:25.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:25.037 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:48:25.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:48:25.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:48:25.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:48:25.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:48:25.052 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:48:25.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:25.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:48:25.052 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:48:25.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:48:25.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:48:25.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:48:25.068 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:48:25.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:25.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:48:25.069 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:48:25.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:48:25.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:48:25.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:48:25.082 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:48:25.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:25.083 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:48:25.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:48:25.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:48:25.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:48:25.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:48:25.098 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:48:25.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:48:25.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:48:30.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:48:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:48:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:48:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:48:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:48:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:48:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:48:30.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:48:30.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:48:30.812 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:48:30.813 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:30.813 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:30.820 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:48:30.820 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:30.820 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:30.827 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:48:30.828 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:30.828 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:30.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:48:30.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771832910838339377 2026-02-23T07:48:30.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:30.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:48:30.992 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:48:31.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:31.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:48:31.156 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:48:31.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:31.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:48:31.319 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:48:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:48:31.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:48:31.480 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:48:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:48:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:48:31.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:48:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771832911656699197 2026-02-23T07:48:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=818 2026-02-23T07:48:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:48:31.721 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:48:31.721 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:31.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:31.728 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:48:31.728 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:31.728 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:31.735 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:48:31.735 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:48:31.735 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:31.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:48:36.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:48:36.899 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:48:36.899 INFO:tasks.workunit.client.0.trial129.stdout:1.3 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:32.596347+0000 20'14 34:92 [1,2,0] 1 [1,2,0] 1 20'14 2026-02-23T07:48:32.594497+0000 20'14 2026-02-23T07:48:32.594497+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:48:32.594497+0000 14 0 2026-02-23T07:48:36.899 INFO:tasks.workunit.client.0.trial129.stdout:1.2 14 0 0 0 0 3584 0 0 14 0 14 active+clean 2026-02-23T07:48:31.756577+0000 20'14 34:101 [0,1,2] 0 [0,1,2] 0 20'14 2026-02-23T07:48:31.754586+0000 20'14 2026-02-23T07:48:31.754586+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:48:31.754586+0000 14 0 2026-02-23T07:48:36.900 INFO:tasks.workunit.client.0.trial129.stdout:1.1 19 0 0 0 0 4864 0 0 19 0 19 active+clean 2026-02-23T07:48:31.985237+0000 20'19 34:101 [2,0,1] 2 [2,0,1] 2 20'19 2026-02-23T07:48:31.982906+0000 20'19 2026-02-23T07:48:31.982906+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:48:31.982906+0000 19 0 2026-02-23T07:48:36.900 INFO:tasks.workunit.client.0.trial129.stdout:1.0 17 0 0 0 0 4352 0 0 17 0 17 active+clean 2026-02-23T07:48:31.613979+0000 20'17 34:111 [1,0,2] 1 [1,0,2] 1 20'17 2026-02-23T07:48:31.611841+0000 20'17 2026-02-23T07:48:31.611841+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:48:31.611841+0000 17 0 2026-02-23T07:48:36.900 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:48:36.900 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:48:36.900 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:48:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2 3 4 16 10 0 256 4194304 0 818 2026-02-23T07:48:36.910 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_2@ REPR 3 4 16 10/ 0 256 4194304/ 0 818 2026-02-23T07:48:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:48:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:48:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:48:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:48:36.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:48:36.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:48:36.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0748 2026-02-23T07:48:36.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:48:36.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:48:36.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:37.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:48:37.012 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.013 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:37.014 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.015 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.016 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.017 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.018 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.019 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr: "value": 32768 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.021 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.022 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.007999963, 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003999981 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.023 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.024 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:37.025 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:37.026 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:48:37.027 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.028 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.029 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.030 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.031 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.032 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.033 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.033 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.033 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.033 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.033 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.033 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.034 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.035 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.036 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.037 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:37.038 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "value": 32768 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.039 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.040 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.007999963, 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003999981 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.041 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.042 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.043 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.044 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.045 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:37.046 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:48:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.073 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 14, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.074 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:37.075 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.076 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 32768 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.077 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.078 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.014999928, 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003749982 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.079 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:37.080 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.081 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.082 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.083 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.084 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.085 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 14, 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.086 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.087 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.088 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "value": 32768 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.089 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.014999928, 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003749982 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.090 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.091 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:48:37.092 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.093 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.094 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.095 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.096 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.096 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.096 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.096 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:48:37.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:37.146 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 8, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.147 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.148 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 128 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 32768 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.149 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.010999947, 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.005499973 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:48:37.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:37.152 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.153 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:37.155 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.156 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 8, 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.157 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:37.158 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 128 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout: "value": 32768 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.159 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:37.160 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.010999947, 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.005499973 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.161 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:37.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.163 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.164 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:37.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:37.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:48:37.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:45.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:48:45.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:45.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.000 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:46.001 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 9, 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.003 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.004 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.005 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.006 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.007 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr: "value": 49152 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.008 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.009 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:48:46.010 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.011999944, 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003999981 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.011 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.012 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.013 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.014 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.015 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.016 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.017 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.018 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:46.019 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.020 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.021 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.022 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 9, 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.023 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.024 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.025 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.026 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "value": 49152 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.027 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:46.028 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.011999944, 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003999981 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.029 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.030 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.031 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.032 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.034 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:48:46.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:46.062 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 21, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.063 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.064 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.065 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 49152 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:46.066 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.023999885, 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.003999980 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.067 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:46.068 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.069 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.070 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.071 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.072 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:46.073 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 21, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.074 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.075 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.076 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "value": 49152 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.077 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.078 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.023999885, 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.003999980 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:46.079 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.080 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.081 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:46.082 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.083 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.084 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:48:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.136 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 12, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.137 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.138 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 192 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 49152 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:46.139 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.015999923, 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.005333307 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.140 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.141 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.142 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.143 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:46.144 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.145 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 12, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.146 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:48:46.147 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.148 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 192 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 49152 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:48:46.149 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.015999923, 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.005333307 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.150 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.151 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.152 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.153 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.154 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:48:46.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:48:59.299 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:48:59.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:48:59.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:48:59.504 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:48:59.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:48:59.708 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 1024 256 4 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=1024 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:48:59.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:48:59.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771832939720849992 2026-02-23T07:48:59.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-23T07:48:59.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-23T07:48:59.721 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:48:59.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.W5OE8WdYgC bs=256 count=1 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 4.1147e-05 s, 6.2 MB/s 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:48:59.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:48:59.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj129 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj130 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj131 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj132 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj133 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj134 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj135 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj136 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj137 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj138 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj139 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj140 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj141 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj142 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj143 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj144 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj145 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj146 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj147 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj148 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj149 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj150 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj151 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj152 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj153 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj154 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj155 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj156 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj157 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj158 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj159 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj160 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj161 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj162 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj163 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj164 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj165 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj166 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj167 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj168 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj169 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj170 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj171 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj172 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj173 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj174 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj175 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj176 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj177 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj178 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj179 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj180 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj181 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj182 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj183 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj184 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj185 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj186 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj187 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj188 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj189 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj190 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj191 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj192 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj193 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj194 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj195 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj196 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj197 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj198 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj199 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj200 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj201 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj202 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj203 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj204 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj205 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj206 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj207 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj208 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj209 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj210 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj211 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj212 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj213 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj214 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj215 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj216 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj217 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj218 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj219 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj220 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj221 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj222 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj223 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj224 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj225 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj226 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj227 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj228 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj229 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj230 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj231 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj232 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj233 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj234 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj235 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj236 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj237 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj238 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj239 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj240 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj241 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj242 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj243 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj244 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj245 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj246 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj247 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj248 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj249 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj250 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj251 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj252 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj253 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj254 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj255 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj256 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj257 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj258 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj259 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj260 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj261 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj262 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj263 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj264 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj265 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj266 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj267 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj268 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj269 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj270 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj271 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj272 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj273 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj274 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj275 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj276 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj277 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj278 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj279 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj280 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj281 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj282 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj283 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:00.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj284 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj285 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj286 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj287 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj288 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj289 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj290 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj291 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj292 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj293 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj294 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj295 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj296 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj297 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj298 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj299 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj300 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj301 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj302 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj303 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj304 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj305 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj306 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj307 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj308 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj309 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj310 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj311 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj312 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj313 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj314 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj315 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj316 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj317 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj318 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj319 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj320 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj321 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj322 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj323 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj324 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj325 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj326 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj327 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj328 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj329 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj330 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj331 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj332 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj333 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj334 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj335 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj336 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj337 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj338 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj339 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj340 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj341 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj342 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj343 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj344 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj345 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj346 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj347 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj348 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj349 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj350 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj351 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj352 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj353 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj354 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj355 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj356 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj357 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj358 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj359 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj360 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj361 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj362 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj363 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj364 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj365 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj366 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj367 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj368 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj369 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj370 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj371 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj372 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj373 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj374 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj375 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj376 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj377 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj378 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj379 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj380 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj381 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj382 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj383 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj384 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj385 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj386 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj387 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj388 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj389 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj390 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj391 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj392 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj393 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj394 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj395 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj396 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj397 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj398 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj399 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj400 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj401 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj402 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj403 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj404 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj405 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj406 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj407 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj408 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj409 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj410 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj411 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj412 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj413 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj414 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj415 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj416 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj417 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj418 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj419 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj420 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj421 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj422 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj423 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj424 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj425 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj426 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj427 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj428 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj429 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj430 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj431 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj432 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj433 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj434 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj435 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj436 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj437 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj438 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj439 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj440 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj441 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj442 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj443 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj444 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj445 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj446 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj447 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj448 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj449 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj450 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj451 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj452 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj453 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj454 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj455 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj456 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj457 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj458 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj459 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj460 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj461 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj462 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj463 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj464 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj465 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj466 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj467 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj468 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj469 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj470 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj471 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj472 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj473 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj474 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj475 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj476 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj477 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj478 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj479 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj480 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj481 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj482 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj483 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj484 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj485 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj486 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj487 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj488 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj489 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj490 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj491 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj492 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj493 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj494 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj495 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj496 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj497 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj498 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj499 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj500 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj501 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj502 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj503 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj504 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj505 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj506 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj507 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj508 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj509 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj510 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj511 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj512 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj513 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj514 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj515 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj516 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj517 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj518 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj519 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj520 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj521 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj522 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj523 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj524 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj525 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj526 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj527 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj528 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj529 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj530 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj531 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj532 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj533 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj534 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj535 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj536 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj537 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj538 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj539 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj540 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj541 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj542 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj543 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj544 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj545 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj546 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj547 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj548 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj549 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj550 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj551 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj552 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj553 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj554 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj555 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj556 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj557 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj558 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj559 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj560 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj561 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj562 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj563 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj564 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj565 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj566 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj567 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj568 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj569 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj570 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj571 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj572 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj573 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj574 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj575 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj576 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj577 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj578 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj579 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj580 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj581 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj582 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj583 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj584 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj585 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj586 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj587 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj588 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj589 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj590 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj591 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj592 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj593 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj594 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj595 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj596 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj597 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj598 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj599 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj600 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj601 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj602 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj603 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj604 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj605 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj606 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj607 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj608 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj609 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj610 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj611 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj612 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj613 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj614 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj615 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj616 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj617 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj618 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj619 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj620 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj621 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj622 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj623 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj624 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj625 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj626 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj627 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj628 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj629 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj630 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj631 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj632 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj633 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj634 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj635 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj636 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj637 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj638 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj639 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj640 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj641 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj642 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj643 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj644 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj645 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj646 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj647 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj648 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj649 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj650 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj651 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj652 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj653 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj654 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj655 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj656 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj657 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj658 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj659 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj660 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj661 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj662 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj663 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj664 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj665 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj666 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj667 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj668 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj669 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj670 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj671 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj672 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj673 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj674 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj675 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj676 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj677 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj678 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj679 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj680 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj681 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj682 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj683 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj684 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj685 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj686 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj687 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj688 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj689 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj690 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj691 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj692 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj693 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj694 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj695 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj696 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj697 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj698 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj699 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj700 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj701 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj702 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj703 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj704 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj705 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj706 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj707 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj708 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj709 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj710 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj711 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj712 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj713 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj714 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj715 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj716 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj717 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj718 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj719 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj720 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj721 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj722 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj723 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj724 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj725 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj726 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj727 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:02.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj728 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj729 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj730 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj731 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj732 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj733 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj734 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj735 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj736 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj737 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj738 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj739 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj740 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj741 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj742 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj743 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj744 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj745 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj746 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj747 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj748 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj749 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj750 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj751 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj752 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj753 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj754 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj755 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj756 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj757 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj758 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj759 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj760 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj761 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj762 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj763 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj764 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj765 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj766 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj767 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj768 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj769 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj770 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj771 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj772 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj773 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj774 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj775 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj776 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj777 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj778 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj779 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj780 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj781 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj782 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj783 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj784 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj785 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj786 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj787 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj788 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj789 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj790 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj791 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj792 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj793 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj794 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj795 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj796 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj797 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj798 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj799 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj800 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj801 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj802 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj803 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj804 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj805 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj806 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj807 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj808 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj809 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj810 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj811 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj812 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj813 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj814 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj815 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj816 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj817 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj818 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj819 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj820 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj821 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj822 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj823 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj824 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj825 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj826 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj827 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj828 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj829 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj830 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj831 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj832 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj833 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj834 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj835 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj836 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj837 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj838 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj839 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj840 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj841 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj842 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj843 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj844 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj845 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj846 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj847 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj848 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj849 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj850 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj851 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj852 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj853 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj854 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj855 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj856 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj857 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj858 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj859 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj860 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj861 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj862 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj863 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj864 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj865 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj866 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj867 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj868 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj869 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj870 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj871 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj872 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj873 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj874 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj875 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj876 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj877 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj878 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj879 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj880 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj881 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj882 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj883 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj884 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj885 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj886 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj887 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj888 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj889 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj890 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj891 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj892 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj893 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj894 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj895 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj896 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj897 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj898 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj899 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj900 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj901 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj902 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj903 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj904 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj905 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj906 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj907 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj908 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj909 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj910 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj911 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj912 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj913 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj914 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj915 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj916 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj917 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj918 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj919 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj920 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj921 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj922 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj923 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj924 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj925 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj926 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj927 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj928 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj929 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj930 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj931 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj932 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj933 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj934 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj935 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj936 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj937 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj938 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj939 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj940 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj941 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj942 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj943 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj944 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj945 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj946 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj947 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj948 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj949 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj950 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj951 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:03.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj952 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj953 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj954 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj955 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj956 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj957 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj958 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj959 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj960 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj961 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj962 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj963 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj964 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj965 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj966 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj967 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj968 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj969 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj970 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj971 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj972 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj973 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj974 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj975 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj976 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj977 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj978 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj979 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj980 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj981 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj982 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj983 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj984 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj985 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj986 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj987 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj988 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj989 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj990 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj991 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj992 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj993 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj994 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj995 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj996 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj997 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj998 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj999 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1000 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1001 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1002 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1003 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1004 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1005 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1006 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1007 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1008 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1009 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1010 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1011 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1012 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1013 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1014 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1015 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1016 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1017 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1018 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1019 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1020 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1021 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1022 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1023 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:49:04.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:49:04.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1024 /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:49:04.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:49:04.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:49:04.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.W5OE8WdYgC 2026-02-23T07:49:04.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:49:04.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771832944325790339 2026-02-23T07:49:04.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=4604 2026-02-23T07:49:04.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 1024 objects in pool test in 4604 ms' 2026-02-23T07:49:04.326 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 1024 objects in pool test in 4604 ms 2026-02-23T07:49:04.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:49:04.327127285' 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:49:04.327127285 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:49:04.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:49:04.328 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:49:04.328 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:49:04.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:49:04.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:49:04.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:49:04.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:49:04.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:49:04.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:49:04.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:49:04.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:49:04.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:49:04.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:49:04.569 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:49:04.569 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:49:04.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:49:04.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:49:04.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:49:04.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-23T07:49:04.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-23T07:49:04.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499' 2026-02-23T07:49:04.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:49:04.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:49:04.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-23T07:49:04.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-23T07:49:04.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705680' 2026-02-23T07:49:04.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:49:04.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:49:04.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574862 2026-02-23T07:49:04.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574862 2026-02-23T07:49:04.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705680 2-55834574862' 2026-02-23T07:49:04.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:49:04.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836499 2026-02-23T07:49:04.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:49:04.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:49:04.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-23T07:49:04.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:49:04.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836499 2026-02-23T07:49:04.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-23T07:49:04.789 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836499 2026-02-23T07:49:04.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:49:04.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836499 2026-02-23T07:49:04.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:49:05.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:49:05.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:49:06.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836499 2026-02-23T07:49:06.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:49:07.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:49:07.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:49:07.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836499 2026-02-23T07:49:07.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:49:07.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705680 2026-02-23T07:49:07.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:49:07.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:49:07.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-23T07:49:07.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:49:07.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705680 2026-02-23T07:49:07.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-23T07:49:07.293 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705680 2026-02-23T07:49:07.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:49:07.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705682 -lt 38654705680 2026-02-23T07:49:07.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:49:07.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574862 2026-02-23T07:49:07.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:49:07.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:49:07.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574862 2026-02-23T07:49:07.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:49:07.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574862 2026-02-23T07:49:07.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574862' 2026-02-23T07:49:07.459 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574862 2026-02-23T07:49:07.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:49:07.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574864 -lt 55834574862 2026-02-23T07:49:07.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:49:07.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:49:07.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:49:07.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:49:07.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:49:07.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T07:49:07.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:49:07.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:49:07.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:49:08.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T07:49:08.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:49:08.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:49:08.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:49:08.349 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:49:08.349 INFO:tasks.workunit.client.0.trial129.stdout: client io 161 KiB/s wr, 0 op/s rd, 161 op/s wr 2026-02-23T07:49:08.349 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:49:08.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:49:08.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:49:13.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:49:13.514 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:49:13.514 INFO:tasks.workunit.client.0.trial129.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-23T07:48:53.336760+0000 18'116 18:135 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:48:53.336712+0000 18'137 18:157 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-23T07:48:53.335739+0000 18'145 18:167 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-23T07:48:53.336900+0000 18'118 18:138 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:48:53.336617+0000 18'122 18:143 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:48:53.335568+0000 18'119 18:140 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:48:53.335705+0000 18'129 18:153 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-23T07:48:53.335565+0000 18'138 18:161 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:13.515 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:49:13.516 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:49:13.516 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:49:13.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:13.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:49:13.525 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:49:13.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:49:13.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:49:13.597 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:49:13.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:49:13.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:49:13.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:49:13.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:49:13.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:49:13.672496877' 2026-02-23T07:49:13.673 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:49:13.672496877 2026-02-23T07:49:13.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:49:13.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771832953673696627 2026-02-23T07:49:13.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:49:13.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:49:13.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:49:13.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 1024 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=1024 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:49:13.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:49:29.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:49:29.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771832969390993857 2026-02-23T07:49:29.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:49:29.423 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:49:29.392212352 (15717 ms) 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:49:29.392212352 (15717 ms)' 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=50 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 50 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj475 obj291 obj474 obj290 obj477 obj293 obj476 obj292 obj769 obj471 obj295 obj768 obj470 obj294 obj598 obj473 obj297 obj599 obj472 obj296 obj765 obj596 obj299 obj764 obj597 obj298 obj767 obj594 obj766 obj595 obj761 obj592 obj479 obj760 obj593 obj478 obj763 obj590 obj762 obj591 obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj646 obj233 obj647 obj232 obj644 obj231 obj645 obj230 obj642 obj318 obj237 obj643 obj319 obj236 obj640 obj235 obj641 obj234 obj314 obj315 obj316 obj239 obj317 obj238 obj310 obj311 obj648 obj312 obj649 obj313 obj819 obj818 obj817 obj816 obj815 obj814 obj813 obj812 obj811 obj810 obj615 obj426 obj242 obj614 obj427 obj243 obj617 obj424 obj240 obj616 obj425 obj241 obj611 obj422 obj246 obj610 obj423 obj247 obj738 obj613 obj569 obj420 obj244 obj739 obj612 obj568 obj421 obj245 obj736 obj567 obj737 obj566 obj734 obj565 obj248 obj735 obj564 obj249 obj732 obj619 obj563 obj733 obj618 obj562 obj730 obj561 obj428 obj731 obj560 obj429 obj192 obj193 obj190 obj191 obj196 obj197 obj194 obj195 obj198 obj199 obj790 obj791 obj792 obj793 obj794 obj795 obj796 obj797 obj798 obj799 obj949 obj840 obj141 obj97 obj948 obj841 obj140 obj96 obj842 obj143 obj95 obj843 obj142 obj94 obj844 obj145 obj93 obj845 obj144 obj92 obj846 obj147 obj91 obj847 obj146 obj90 obj941 obj848 obj149 obj940 obj849 obj148 obj943 obj942 obj945 obj944 obj947 obj99 obj946 obj98 obj530 obj531 obj532 obj533 obj534 obj535 obj536 obj537 obj538 obj539 obj699 obj698 obj695 obj694 obj697 obj696 obj691 obj690 obj693 obj692 obj79 obj78 obj71 obj70 obj73 obj72 obj75 obj74 obj77 obj76 obj718 obj509 obj400 obj325 obj719 obj508 obj401 obj324 obj402 obj327 obj403 obj326 obj404 obj321 obj405 obj320 obj406 obj323 obj407 obj322 obj710 obj501 obj408 obj711 obj500 obj409 obj712 obj503 obj713 obj502 obj714 obj505 obj329 obj715 obj504 obj328 obj716 obj507 obj717 obj506 obj268 obj269 obj639 obj638 obj637 obj264 obj636 obj265 obj635 obj266 obj634 obj267 obj633 obj260 obj632 obj261 obj631 obj262 obj630 obj263 obj747 obj394 obj746 obj395 obj745 obj396 obj744 obj397 obj743 obj390 obj742 obj391 obj741 obj392 obj740 obj393 obj398 obj399 obj749 obj748 obj897 obj896 obj895 obj894 obj893 obj892 obj891 obj459 obj890 obj458 obj457 obj456 obj455 obj454 obj453 obj452 obj899 obj451 obj898 obj450 obj963 obj962 obj961 obj960 obj967 obj966 obj965 obj964 obj969 obj968 obj169 obj168 obj163 obj162 obj161 obj160 obj167 obj166 obj165 obj164 obj912 obj660 obj376 obj913 obj661 obj377 obj910 obj662 obj374 obj911 obj663 obj375 obj916 obj664 obj372 obj917 obj665 obj373 obj914 obj666 obj370 obj915 obj667 obj371 obj668 obj669 obj918 obj919 obj378 obj379 obj879 obj878 obj118 obj119 obj871 obj112 obj870 obj113 obj873 obj110 obj872 obj111 obj875 obj116 obj874 obj117 obj877 obj114 obj876 obj115 obj53 obj52 obj51 obj50 obj57 obj56 obj55 obj54 obj59 obj58 obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj1014 obj1015 obj1016 obj1017 obj1010 obj1011 obj1012 obj1013 obj1018 obj1019 obj721 obj552 obj720 obj553 obj723 obj550 obj722 obj551 obj725 obj556 obj724 obj557 obj727 obj554 obj726 obj555 obj729 obj728 obj558 obj559 obj439 obj255 obj438 obj254 obj998 obj257 obj999 obj256 obj251 obj250 obj253 obj252 obj992 obj431 obj993 obj430 obj990 obj433 obj991 obj432 obj996 obj435 obj259 obj997 obj434 obj258 obj994 obj437 obj995 obj436 obj581 obj580 obj583 obj582 obj585 obj584 obj587 obj586 obj589 obj588 obj488 obj489 obj480 obj481 obj482 obj483 obj484 obj485 obj486 obj487 obj783 obj350 obj782 obj351 obj781 obj352 obj780 obj353 obj787 obj354 obj786 obj355 obj785 obj356 obj784 obj357 obj358 obj1024 obj359 obj789 obj788 obj1021 obj1020 obj1023 obj1022 obj853 obj134 obj852 obj135 obj851 obj136 obj850 obj137 obj938 obj857 obj130 obj939 obj856 obj131 obj855 obj132 obj854 obj133 obj934 obj935 obj936 obj859 obj937 obj858 obj930 obj138 obj931 obj139 obj932 obj933 obj523 obj522 obj521 obj520 obj527 obj526 obj525 obj524 obj529 obj528 obj822 obj659 obj206 obj823 obj658 obj207 obj820 obj204 obj821 obj205 obj826 obj202 obj827 obj203 obj824 obj309 obj200 obj825 obj308 obj201 obj651 obj307 obj650 obj306 obj828 obj653 obj305 obj829 obj652 obj304 obj655 obj303 obj654 obj302 obj657 obj301 obj208 obj656 obj300 obj209 obj185 obj184 obj187 obj186 obj181 obj180 obj183 obj182 obj189 obj188 obj279 obj278 obj277 obj276 obj275 obj274 obj273 obj272 obj271 obj270 obj462 obj387 obj463 obj386 obj778 obj460 obj385 obj779 obj461 obj384 obj466 obj383 obj467 obj382 obj464 obj381 obj465 obj380 obj772 obj773 obj770 obj468 obj771 obj469 obj776 obj777 obj774 obj389 obj775 obj388 obj288 obj289 obj286 obj287 obj284 obj285 obj282 obj283 obj280 obj281 obj158 obj159 obj156 obj157 obj154 obj155 obj152 obj153 obj150 obj151 obj905 obj673 obj369 obj220 obj904 obj672 obj368 obj221 obj907 obj671 obj222 obj906 obj670 obj223 obj901 obj677 obj224 obj900 obj676 obj225 obj903 obj675 obj226 obj902 obj674 obj227 obj361 obj228 obj360 obj229 obj679 obj363 obj678 obj362 obj909 obj365 obj908 obj364 obj367 obj366 obj808 obj109 obj809 obj108 obj804 obj105 obj805 obj104 obj806 obj107 obj807 obj106 obj800 obj101 obj801 obj100 obj802 obj103 obj803 obj102 obj602 obj413 obj603 obj412 obj709 obj600 obj411 obj708 obj601 obj410 obj606 obj578 obj417 obj607 obj579 obj416 obj604 obj415 obj605 obj414 obj703 obj574 obj702 obj575 obj701 obj608 obj576 obj419 obj700 obj609 obj577 obj418 obj707 obj570 obj706 obj571 obj705 obj572 obj704 obj573 obj35 obj34 obj37 obj36 obj31 obj30 obj33 obj32 obj39 obj38 obj1007 obj1006 obj1005 obj1004 obj1003 obj1002 obj1001 obj1000 obj1009 obj1008 obj956 obj84 obj957 obj85 obj954 obj86 obj955 obj87 obj952 obj80 obj953 obj81 obj950 obj82 obj951 obj83 obj88 obj89 obj958 obj959 obj884 obj885 obj886 obj887 obj989 obj880 obj448 obj988 obj881 obj449 obj882 obj883 obj985 obj444 obj984 obj445 obj987 obj446 obj986 obj447 obj981 obj888 obj440 obj980 obj889 obj441 obj983 obj442 obj982 obj443 obj4 obj5 obj688 obj499 obj6 obj689 obj498 obj7 obj1 obj2 obj3 obj682 obj493 obj683 obj492 obj680 obj491 obj681 obj490 obj686 obj497 obj8 obj687 obj496 obj9 obj684 obj495 obj685 obj494 obj66 obj67 obj64 obj65 obj62 obj63 obj60 obj61 obj68 obj69 obj866 obj127 obj867 obj126 obj864 obj125 obj865 obj124 obj862 obj123 obj863 obj122 obj929 obj860 obj121 obj928 obj861 obj120 obj927 obj926 obj925 obj924 obj923 obj922 obj921 obj868 obj129 obj920 obj869 obj128 obj516 obj332 obj517 obj333 obj514 obj330 obj515 obj331 obj512 obj336 obj513 obj337 obj510 obj334 obj511 obj335 obj338 obj339 obj518 obj519 obj835 obj219 obj834 obj218 obj837 obj836 obj831 obj628 obj830 obj629 obj833 obj832 obj624 obj211 obj625 obj210 obj626 obj213 obj627 obj212 obj839 obj620 obj215 obj838 obj621 obj214 obj622 obj217 obj623 obj216 obj754 obj545 obj755 obj544 obj756 obj547 obj757 obj546 obj750 obj541 obj751 obj540 obj752 obj543 obj753 obj542 obj758 obj549 obj759 obj548 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 obj970 obj971 obj972 obj973 obj974 obj975 obj976 obj977 obj978 obj979 obj178 obj179 obj170 obj171 obj172 obj173 obj174 obj175 obj176 obj177 obj343 obj342 obj341 obj340 obj347 obj346 obj345 obj344 obj349 obj348 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 50 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 50' 2026-02-23T07:49:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.425 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj340 2026-02-23T07:49:29.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj340' 2026-02-23T07:49:29.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 1024' 2026-02-23T07:49:29.425 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 1024 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj340 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj340' 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj340 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj340 ' 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj917 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj917' 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj917 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj917 ' 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.427 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj489 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj489' 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj489 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj489 ' 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.428 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj648 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj648' 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj648 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj648 ' 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj286 2026-02-23T07:49:29.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj286' 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj286 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj286 ' 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1007' 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1007 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1007 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1007 ' 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj413 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj413' 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj413 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj413 ' 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.431 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj222 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj222' 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj222 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj222 ' 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.432 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj162 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj162' 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj162 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj162 ' 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj174 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj174' 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj174 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:49:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj174 ' 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj378 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj378' 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj378 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj378 ' 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj818' 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj818 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj818 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj818 ' 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.435 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj705 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj705' 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj705 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj705 ' 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj598' 2026-02-23T07:49:29.436 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj598 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj598 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj598 ' 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj210 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj210' 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj210 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj210 ' 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj495 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj495' 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj495 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj495 ' 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.438 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj970 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj970' 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj970 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj970 ' 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.439 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj235 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj235' 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj235 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj235 ' 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj113 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj113' 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj113 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj113 ' 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj435' 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj435 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj435 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj435 ' 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj26' 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj26 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj26 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj26 ' 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj316 2026-02-23T07:49:29.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj316' 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj316 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj316 ' 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj70' 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj70 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj70 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj70 ' 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj676 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj676' 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj676 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj676 ' 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj919 2026-02-23T07:49:29.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj919' 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj919 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj919 ' 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj613 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj613' 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj613 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj613 ' 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj551 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj551' 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj551 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj551 ' 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.446 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj61 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj61' 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj61 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj61 ' 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj952 2026-02-23T07:49:29.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj952' 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj952 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj952 ' 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj449 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj449' 2026-02-23T07:49:29.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj449 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj449 ' 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj932' 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj932 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj932 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj932 ' 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.449 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1001 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1001' 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1001 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1001 ' 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.450 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj922 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj922' 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj922 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj922 ' 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj949 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj949' 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj949 2026-02-23T07:49:29.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj949 ' 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj118 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj118' 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj118 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj118 ' 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj30 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj30' 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj30 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj30 ' 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.453 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj245 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj245' 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj245 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj245 ' 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.454 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj787 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj787' 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj787 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj787 ' 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj334 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj334' 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj334 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj334 ' 2026-02-23T07:49:29.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj63 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj63' 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj63 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:49:29.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj63 ' 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=40 )) 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj173 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stdout:Object obj173: acting: 1 0 2 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj173: acting: 1 0 2' 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.457 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj173 (40) 0 2 1' 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj173 (40) 0 2 1 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.458 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj173 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj173' 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj173 ' 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1020 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stdout:Object obj1020: acting: 2 0 1 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1020: acting: 2 0 1' 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj1020 (41) 0 1 2 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj1020 (41) 0 1 2' 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:49:29.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj1020 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj1020' 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1020 ' 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj455 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.461 INFO:tasks.workunit.client.0.trial129.stdout:Object obj455: acting: 2 0 1 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj455: acting: 2 0 1' 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.462 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj455 (42) 0 1 2 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj455 (42) 0 1 2' 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj455 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj455' 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj455 ' 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj127 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj127: acting: 1 2 0' 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stdout:Object obj127: acting: 1 2 0 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.464 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj127 (43) 2 0 1 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj127 (43) 2 0 1' 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj127 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj127' 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj127 ' 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj460 2026-02-23T07:49:29.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stdout:Object obj460: acting: 2 0 1 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj460: acting: 2 0 1' 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj460 (44) 0 1 2' 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj460 (44) 0 1 2 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj460 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj460' 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj460 ' 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj587 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stdout:Object obj587: acting: 2 0 1 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj587: acting: 2 0 1' 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj587 (45) 0 1 2 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj587 (45) 0 1 2' 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj587 2026-02-23T07:49:29.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj587' 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj587 ' 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj494 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj494: acting: 2 0 1' 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stdout:Object obj494: acting: 2 0 1 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.470 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj494 (46) 0 1 2 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj494 (46) 0 1 2' 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj494' 2026-02-23T07:49:29.471 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj494 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj494 ' 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj811 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stdout:Object obj811: acting: 2 0 1 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj811: acting: 2 0 1' 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.472 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj811 (47) 0 1 2' 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj811 (47) 0 1 2 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj811 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj811' 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj811 ' 2026-02-23T07:49:29.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj375 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stdout:Object obj375: acting: 2 0 1 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj375: acting: 2 0 1' 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.474 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj375 (48) 0 1 2 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj375 (48) 0 1 2' 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj375 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj375' 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj375 ' 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj201 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.475 INFO:tasks.workunit.client.0.trial129.stdout:Object obj201: acting: 1 0 2 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj201: acting: 1 0 2' 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj201 (49) 0 2 1 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj201 (49) 0 2 1' 2026-02-23T07:49:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj201 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj201' 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj201 ' 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:49:29.477 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:29.484 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:49:29.484 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:49:29.484 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:29.491 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:49:29.491 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:49:29.491 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:29.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:49:29.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:49:29.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:49:29.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:49:29.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:49:29.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:49:29.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:49:29.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:49:30.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:49:30.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj174 obj210 obj30 ' 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj174 obj210 obj30 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:30.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:30.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:30.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:30.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:30.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj174 2026-02-23T07:49:30.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:30.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:30.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj174 2026-02-23T07:49:30.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj174 rm-attr _ 2026-02-23T07:49:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:49:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:49:30.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:30.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj210 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj210 2026-02-23T07:49:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj210 rm-attr _ 2026-02-23T07:49:31.096 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:31.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:31.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:31.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:31.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj30 2026-02-23T07:49:31.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:31.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:31.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj30 2026-02-23T07:49:31.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj30 rm-attr _ 2026-02-23T07:49:31.249 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:31.250 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj173 obj455 obj127 obj460 obj494 obj375 ' obj_to_pgid delete_oi 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj173 obj455 obj127 obj460 obj494 obj375 ' 2026-02-23T07:49:31.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:49:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:49:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:49:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj173 obj455 obj127 obj460 obj494 obj375 ]] 2026-02-23T07:49:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:49:31.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj173 obj455 obj127 obj460 obj494 obj375 ' 2026-02-23T07:49:31.309 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj173 obj455 obj127 obj460 obj494 obj375 2026-02-23T07:49:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:49:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:31.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj173 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj173 2026-02-23T07:49:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj173 rm-attr _ 2026-02-23T07:49:31.429 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:31.429 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:49:31.429 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:31.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj455 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj455 2026-02-23T07:49:31.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj455 rm-attr _ 2026-02-23T07:49:31.605 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:31.605 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:49:31.605 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:31.606 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0698d46e:::obj173:head#, (61) No data available 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:31.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj127 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj127 2026-02-23T07:49:31.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj127 rm-attr _ 2026-02-23T07:49:31.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b5445b0d:::obj455:head#, (61) No data available 2026-02-23T07:49:31.758 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:31.758 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:49:31.758 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:31.758 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0698d46e:::obj173:head#, (61) No data available 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:49:31.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:31.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj460 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:31.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj460 2026-02-23T07:49:31.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj460 rm-attr _ 2026-02-23T07:49:31.942 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b5445b0d:::obj455:head#, (61) No data available 2026-02-23T07:49:31.943 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-23T07:49:31.944 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:31.944 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:49:31.944 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:31.945 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0698d46e:::obj173:head#, (61) No data available 2026-02-23T07:49:32.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:32.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:32.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:32.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:32.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj494 2026-02-23T07:49:32.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:32.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:32.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj494 2026-02-23T07:49:32.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj494 rm-attr _ 2026-02-23T07:49:32.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b5445b0d:::obj455:head#, (61) No data available 2026-02-23T07:49:32.124 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-23T07:49:32.124 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:32.124 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:49:32.125 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:32.125 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:881499a5:::obj460:head#, (61) No data available 2026-02-23T07:49:32.125 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0698d46e:::obj173:head#, (61) No data available 2026-02-23T07:49:32.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:32.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:32.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:32.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:32.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:32.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:32.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:32.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:32.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:32.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj375 2026-02-23T07:49:32.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:32.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:49:32.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj375 2026-02-23T07:49:32.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj375 rm-attr _ 2026-02-23T07:49:32.290 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b5445b0d:::obj455:head#, (61) No data available 2026-02-23T07:49:32.291 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:eff0a739:::obj127:head#, (61) No data available 2026-02-23T07:49:32.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:41ea52ba:::obj210:head#, (61) No data available 2026-02-23T07:49:32.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4eb30133:::obj30:head#, (61) No data available 2026-02-23T07:49:32.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:50fb58bc:::obj174:head#, (61) No data available 2026-02-23T07:49:32.292 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:881499a5:::obj460:head#, (61) No data available 2026-02-23T07:49:32.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9604ab91:::obj494:head#, (61) No data available 2026-02-23T07:49:32.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0698d46e:::obj173:head#, (61) No data available 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj917 obj489 obj648 obj286 obj413 obj162 obj378 obj705 obj598 obj235 obj113 obj26 obj316 obj70 obj676 obj919 obj613 obj551 obj61 obj449 obj932 obj1001 obj949 obj118 obj245 obj334 obj63 ' 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj917 obj489 obj648 obj286 obj413 obj162 obj378 obj705 obj598 obj235 obj113 obj26 obj316 obj70 obj676 obj919 obj613 obj551 obj61 obj449 obj932 obj1001 obj949 obj118 obj245 obj334 obj63 2026-02-23T07:49:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj917 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj917 2026-02-23T07:49:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj917 rm-attr _ 2026-02-23T07:49:32.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:32.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:32.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:32.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:32.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:32.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:32.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj489 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj489 2026-02-23T07:49:32.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj489 rm-attr _ 2026-02-23T07:49:32.646 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:32.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:32.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:32.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:32.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:32.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:32.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:32.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj648 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:32.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj648 2026-02-23T07:49:32.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj648 rm-attr _ 2026-02-23T07:49:32.826 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:32.826 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:32.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:32.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj286 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj286 2026-02-23T07:49:32.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj286 rm-attr _ 2026-02-23T07:49:32.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:32.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:32.991 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:33.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:33.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:33.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:33.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj413 2026-02-23T07:49:33.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:33.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:33.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj413 2026-02-23T07:49:33.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj413 rm-attr _ 2026-02-23T07:49:33.155 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:33.157 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:33.157 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:33.159 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:33.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:33.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:33.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:33.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:33.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:33.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:33.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:33.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:33.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:33.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj162 2026-02-23T07:49:33.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:33.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:33.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj162 2026-02-23T07:49:33.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj162 rm-attr _ 2026-02-23T07:49:33.342 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:33.344 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:33.344 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:33.345 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:33.346 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:33.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:33.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:33.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:33.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:49:33.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:49:33.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:33.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:33.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:33.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:33.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj378 2026-02-23T07:49:33.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:33.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:33.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj378 2026-02-23T07:49:33.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj378 rm-attr _ 2026-02-23T07:49:33.524 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:33.525 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:33.525 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:33.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:33.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:33.527 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:33.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:33.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:33.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:33.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:33.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:33.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:33.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:33.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:33.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:33.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj705 2026-02-23T07:49:33.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:33.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:33.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj705 2026-02-23T07:49:33.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj705 rm-attr _ 2026-02-23T07:49:33.676 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:33.678 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:33.679 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:33.679 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:33.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:33.681 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:33.681 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:33.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:33.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:33.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:33.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:33.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj598 2026-02-23T07:49:33.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:33.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:33.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj598 2026-02-23T07:49:33.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj598 rm-attr _ 2026-02-23T07:49:33.853 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:33.855 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:33.855 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:33.855 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:33.855 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:33.858 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:33.858 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:33.858 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:33.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:33.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj235 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj235 2026-02-23T07:49:33.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj235 rm-attr _ 2026-02-23T07:49:34.045 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:34.047 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:34.047 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:34.047 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:34.047 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:34.047 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:34.049 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:34.049 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:34.049 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:49:34.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:34.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj113 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj113 2026-02-23T07:49:34.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj113 rm-attr _ 2026-02-23T07:49:34.226 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:34.227 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:34.227 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:34.227 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:34.228 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:34.228 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:34.228 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:34.229 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:34.229 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:34.230 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:34.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:34.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:34.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:34.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:34.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:34.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:34.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj26 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-23T07:49:34.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj26 rm-attr _ 2026-02-23T07:49:34.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:34.401 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:34.402 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:34.402 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:34.402 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:34.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:34.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:34.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:34.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:34.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:34.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:34.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj316 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj316 2026-02-23T07:49:34.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj316 rm-attr _ 2026-02-23T07:49:34.571 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:34.574 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:34.574 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:34.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:34.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj70 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj70 2026-02-23T07:49:34.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj70 rm-attr _ 2026-02-23T07:49:34.738 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:34.742 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:34.742 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:34.743 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:34.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:34.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:34.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:34.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:34.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:34.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:34.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:34.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:34.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:34.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj676 2026-02-23T07:49:34.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:34.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:34.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj676 2026-02-23T07:49:34.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj676 rm-attr _ 2026-02-23T07:49:34.900 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:34.902 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:34.903 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:34.904 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:34.904 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:34.905 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:34.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:34.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:34.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:34.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:49:34.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:49:34.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:34.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj919 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj919 2026-02-23T07:49:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj919 rm-attr _ 2026-02-23T07:49:35.082 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:35.083 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:35.083 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:35.083 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:35.084 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:35.085 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:35.085 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:35.085 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:35.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj613 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj613 2026-02-23T07:49:35.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj613 rm-attr _ 2026-02-23T07:49:35.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:35.239 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:35.239 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:35.239 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:35.239 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:35.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:35.241 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:35.241 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:35.241 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:35.292 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:35.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj551 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj551 2026-02-23T07:49:35.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj551 rm-attr _ 2026-02-23T07:49:35.395 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:35.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:35.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:35.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:35.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:35.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:35.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:35.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:35.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:35.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:35.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:35.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:35.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:35.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:35.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:35.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:35.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj61 2026-02-23T07:49:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj61 2026-02-23T07:49:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj61 rm-attr _ 2026-02-23T07:49:35.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:35.550 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:35.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:35.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:35.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:35.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:35.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:35.555 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:35.556 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:35.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:35.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj449 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:35.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj449 2026-02-23T07:49:35.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj449 rm-attr _ 2026-02-23T07:49:35.705 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:35.705 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:35.710 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:35.711 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:35.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:35.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:35.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:35.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:35.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:35.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:35.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj932 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj932 2026-02-23T07:49:35.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj932 rm-attr _ 2026-02-23T07:49:35.862 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:35.862 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:35.862 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:35.862 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:35.863 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:35.863 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:35.863 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:35.864 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:35.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:35.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:35.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:35.865 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:35.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:35.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:35.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:35.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:35.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:35.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1001 2026-02-23T07:49:35.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:35.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:35.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1001 2026-02-23T07:49:35.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1001 rm-attr _ 2026-02-23T07:49:36.058 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:36.059 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:36.065 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:36.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:36.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:36.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:36.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:36.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:36.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj949 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:36.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj949 2026-02-23T07:49:36.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj949 rm-attr _ 2026-02-23T07:49:36.215 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:36.215 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:36.222 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:36.222 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:36.222 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:36.222 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:36.222 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:36.222 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:36.223 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:36.224 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:36.224 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:36.224 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:36.224 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:36.224 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:36.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:36.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:36.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:36.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:36.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:36.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:36.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj118 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj118 2026-02-23T07:49:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj118 rm-attr _ 2026-02-23T07:49:36.404 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:36.404 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:36.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:36.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:36.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:36.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:36.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:36.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:36.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:36.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:36.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:36.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:49:36.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:49:36.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:36.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:36.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj245 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj245 2026-02-23T07:49:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj245 rm-attr _ 2026-02-23T07:49:36.573 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:36.573 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:36.579 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:36.580 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1503467e:::obj118:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:36.581 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:49:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:49:36.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:36.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj334 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj334 2026-02-23T07:49:36.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj334 rm-attr _ 2026-02-23T07:49:36.759 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:36.760 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:36.760 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7a95c0e7:::obj245:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:36.764 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1503467e:::obj118:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:36.765 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:36.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:36.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:36.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:36.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj63 2026-02-23T07:49:36.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:36.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj63 2026-02-23T07:49:36.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj63 rm-attr _ 2026-02-23T07:49:36.945 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:36.945 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:36.945 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7a95c0e7:::obj245:head#, (61) No data available 2026-02-23T07:49:36.945 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:36.945 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ee44f25c:::obj334:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:36.946 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1503467e:::obj118:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:36.947 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj1020 obj587 obj811 ' obj_to_pgid delete_oi 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj1020 obj587 obj811 ' 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj1020 obj587 obj811 ]] 2026-02-23T07:49:36.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj1020 obj587 obj811 ' 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj1020 obj587 obj811 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:36.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1020 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1020 2026-02-23T07:49:36.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1020 rm-attr _ 2026-02-23T07:49:37.116 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:37.116 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:37.116 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7a95c0e7:::obj245:head#, (61) No data available 2026-02-23T07:49:37.117 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:37.117 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:37.118 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ee44f25c:::obj334:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:37.119 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:37.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:37.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:37.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1503467e:::obj118:head#, (61) No data available 2026-02-23T07:49:37.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:37.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:49:37.120 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:37.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj587 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj587 2026-02-23T07:49:37.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj587 rm-attr _ 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7a95c0e7:::obj245:head#, (61) No data available 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a1e7b969:::obj1020:head#, (61) No data available 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:37.303 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ee44f25c:::obj334:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:37.304 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1503467e:::obj118:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:49:37.305 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:37.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:37.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:37.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:37.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:37.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:37.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:37.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj811 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj811 2026-02-23T07:49:37.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj811 rm-attr _ 2026-02-23T07:49:37.478 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:49:37.478 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:66186cf6:::obj613:head#, (61) No data available 2026-02-23T07:49:37.478 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:7a95c0e7:::obj245:head#, (61) No data available 2026-02-23T07:49:37.478 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a1e7b969:::obj1020:head#, (61) No data available 2026-02-23T07:49:37.478 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:aa1e2680:::obj587:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:c68dea80:::obj235:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:ce6a8cce:::obj919:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc49c339:::obj378:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dc6ed3c7:::obj113:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e4a1406e:::obj917:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ee44f25c:::obj334:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f13c731e:::obj449:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f33597d0:::obj489:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:fc438b16:::obj705:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:ffd8ed3d:::obj316:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:225286f8:::obj676:head#, (61) No data available 2026-02-23T07:49:37.479 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:29bf15fc:::obj932:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2e69a8fc:::obj598:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3655ac21:::obj70:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:37177550:::obj1001:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3ad4943a:::obj949:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:3d88a4f9:::obj551:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:06d56074:::obj162:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bde2796:::obj413:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1503467e:::obj118:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:17172d3d:::obj648:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:18c50d58:::obj63:head#, (61) No data available 2026-02-23T07:49:37.480 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:1b6bffcc:::obj61:head#, (61) No data available 2026-02-23T07:49:37.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:37.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:37.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:49:37.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:49:37.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:49:37.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj340 obj1007 obj222 obj818 obj495 obj970 obj435 obj952 obj922 obj787 ' 2026-02-23T07:49:37.526 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj340 obj1007 obj222 obj818 obj495 obj970 obj435 obj952 obj922 obj787 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj340 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj340 2026-02-23T07:49:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj340 rm-attr _ 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:37.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:37.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1007 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1007 2026-02-23T07:49:37.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1007 rm-attr _ 2026-02-23T07:49:37.814 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:37.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:37.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:37.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj222 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj222 2026-02-23T07:49:37.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj222 rm-attr _ 2026-02-23T07:49:37.992 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:37.992 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:38.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:38.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj818 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj818 2026-02-23T07:49:38.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj818 rm-attr _ 2026-02-23T07:49:38.167 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:38.167 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:38.167 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:38.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:38.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:38.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:38.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:38.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:38.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:38.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj495 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj495 2026-02-23T07:49:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj495 rm-attr _ 2026-02-23T07:49:38.353 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:38.353 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:38.353 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:38.355 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:38.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:38.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:38.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:38.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:38.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:38.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:38.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:38.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:38.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:38.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj970 2026-02-23T07:49:38.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:38.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:38.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj970 2026-02-23T07:49:38.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj970 rm-attr _ 2026-02-23T07:49:38.524 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:38.524 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:38.524 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:38.524 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b75b9722:::obj495:head#, (61) No data available 2026-02-23T07:49:38.526 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:38.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:38.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:38.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:38.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:49:38.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:49:38.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:38.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:38.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:38.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:38.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj435 2026-02-23T07:49:38.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:38.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:38.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj435 2026-02-23T07:49:38.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj435 rm-attr _ 2026-02-23T07:49:38.703 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:38.703 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a4a6b848:::obj970:head#, (61) No data available 2026-02-23T07:49:38.703 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:38.703 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:38.703 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b75b9722:::obj495:head#, (61) No data available 2026-02-23T07:49:38.705 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:38.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:38.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:38.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:38.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:49:38.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:49:38.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:38.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:38.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:38.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:38.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj952 2026-02-23T07:49:38.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:38.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:38.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj952 2026-02-23T07:49:38.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj952 rm-attr _ 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a42b336e:::obj435:head#, (61) No data available 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a4a6b848:::obj970:head#, (61) No data available 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b75b9722:::obj495:head#, (61) No data available 2026-02-23T07:49:38.877 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:38.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:38.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:38.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:38.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:49:38.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:49:38.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:38.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:38.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:38.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:38.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:38.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj922 2026-02-23T07:49:38.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:38.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:38.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj922 2026-02-23T07:49:38.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj922 rm-attr _ 2026-02-23T07:49:39.064 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:39.064 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a42b336e:::obj435:head#, (61) No data available 2026-02-23T07:49:39.064 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a4a6b848:::obj970:head#, (61) No data available 2026-02-23T07:49:39.064 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:39.064 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:39.064 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b75b9722:::obj495:head#, (61) No data available 2026-02-23T07:49:39.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9850b3a5:::obj952:head#, (61) No data available 2026-02-23T07:49:39.066 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:39.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:39.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:39.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:39.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:39.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:49:39.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:49:39.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:39.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj787 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj787 2026-02-23T07:49:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj787 rm-attr _ 2026-02-23T07:49:39.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:39.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a42b336e:::obj435:head#, (61) No data available 2026-02-23T07:49:39.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a4a6b848:::obj970:head#, (61) No data available 2026-02-23T07:49:39.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:39.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:39.238 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b75b9722:::obj495:head#, (61) No data available 2026-02-23T07:49:39.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:959901d6:::obj922:head#, (61) No data available 2026-02-23T07:49:39.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9850b3a5:::obj952:head#, (61) No data available 2026-02-23T07:49:39.240 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj201 ' obj_to_pgid delete_oi 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj201 ' 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj201 ]] 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj201 ' 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj201 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:49:39.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj201 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj201 2026-02-23T07:49:39.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj201 rm-attr _ 2026-02-23T07:49:39.424 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a10cad2d:::obj340:head#, (61) No data available 2026-02-23T07:49:39.424 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a42b336e:::obj435:head#, (61) No data available 2026-02-23T07:49:39.424 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a4a6b848:::obj970:head#, (61) No data available 2026-02-23T07:49:39.424 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:afc5cda1:::obj1007:head#, (61) No data available 2026-02-23T07:49:39.425 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b133d16d:::obj222:head#, (61) No data available 2026-02-23T07:49:39.425 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:b75b9722:::obj495:head#, (61) No data available 2026-02-23T07:49:39.426 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:956591fe:::obj787:head#, (61) No data available 2026-02-23T07:49:39.426 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:959901d6:::obj922:head#, (61) No data available 2026-02-23T07:49:39.426 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9850b3a5:::obj952:head#, (61) No data available 2026-02-23T07:49:39.426 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9ce94e01:::obj818:head#, (61) No data available 2026-02-23T07:49:39.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:49:39.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:49:39.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:49:39.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:49:39.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:49:50.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:49:55.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:49:55.750 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-23T07:49:43.342970+0000 18'116 32:164 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:49:43.343005+0000 18'137 32:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-23T07:49:43.342757+0000 18'145 32:186 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-23T07:49:43.343557+0000 18'118 32:168 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:49:43.343285+0000 18'122 32:173 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:49:43.342578+0000 18'119 32:176 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:49:43.342940+0000 18'129 32:176 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.751 INFO:tasks.workunit.client.0.trial129.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-23T07:49:43.342977+0000 18'138 32:197 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:55.752 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:49:55.752 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:49:55.752 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:49:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:49:55.761 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:49:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:49:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:49:55.834 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:49:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:49:55.899 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:49:55.899 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:49:55.899 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:55.905 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:49:55.906 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:49:55.906 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:55.913 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:49:55.913 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:49:55.913 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:55.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:49:56.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:49:56.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771832996926331849 2026-02-23T07:49:56.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:49:56.927822133' 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:49:56.927822133 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:49:56.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:49:57.085 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:49:57.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:49:57.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771832997100966936 2026-02-23T07:49:57.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:49:57.102038886 (174 ms)' 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:49:57.102038886 (174 ms) 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.102 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 1 ( 1 0 2 ) 1 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 1 ( 1 0 2 ) 1' 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 0 1 ) 1 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 0 1 ) 1' 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 1 ( 1 0 2 ) 1 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 1 ( 1 0 2 ) 1' 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.103 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 2 0 ) 1 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 2 0 ) 1' 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.104 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:49:57.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:49:57.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:49:57.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:49:57.426 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-23T07:49:43.342970+0000 18'116 32:164 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:49:43.343005+0000 18'137 32:185 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-23T07:49:43.342757+0000 18'145 32:186 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-23T07:49:43.343557+0000 18'118 32:169 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:49:43.343285+0000 18'122 32:173 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:49:43.342578+0000 18'119 32:176 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:49:43.342940+0000 18'129 32:177 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-23T07:49:43.342977+0000 18'138 32:198 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:49:57.427 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:49:57.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:49:57.503 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:49:57.503 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:49:57.503 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.510 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:49:57.510 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:49:57.510 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.517 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:49:57.517 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:49:57.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:49:57.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771832997528502020 2026-02-23T07:49:57.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.529 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:49:57.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:49:57.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:49:57.594 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:57.595 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:57.595 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:57.595 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:57.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:49:57.604 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:49:57.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:49:57.668 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:57.668 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:57.668 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:57.668 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:57.668 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:49:57.677 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:49:57.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:49:57.743 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:57.743 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:57.743 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:57.743 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:57.743 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:49:57.752 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:49:57.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:49:57.818 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:57.818 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:57.818 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:57.818 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:57.818 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:49:57.828 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:49:57.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:49:57.892 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:57.892 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:57.892 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:57.893 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:57.893 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:49:57.901 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:49:57.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:49:57.964 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:57.965 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:57.965 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:57.965 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:57.965 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:57.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:57.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:57.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:49:57.973 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:49:57.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:49:58.038 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:58.038 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:58.038 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:58.038 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:58.038 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:58.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:49:58.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:49:58.048 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:49:58.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:49:58.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:49:58.114 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:49:58.114 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:49:58.115 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:49:58.115 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:49:58.115 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:49:58.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:49:58.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:49:58.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:49:58.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771832998289161427 2026-02-23T07:49:58.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=760 2026-02-23T07:49:58.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:49:58.354 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:49:58.354 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:49:58.354 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:58.361 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:49:58.361 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:49:58.361 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:58.368 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:49:58.368 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:49:58.368 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:49:58.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:50:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-23T07:49:43.342970+0000 18'116 32:165 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean+inconsistent 2026-02-23T07:49:58.763775+0000 18'137 32:221 [1,0,2] 1 [1,0,2] 1 18'137 2026-02-23T07:49:58.763743+0000 18'137 2026-02-23T07:49:58.763743+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:49:58.763743+0000 137 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean+inconsistent 2026-02-23T07:49:58.173176+0000 18'145 32:223 [2,0,1] 2 [2,0,1] 2 18'145 2026-02-23T07:49:58.173147+0000 18'145 2026-02-23T07:49:58.173147+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:49:58.173147+0000 145 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean+inconsistent 2026-02-23T07:49:57.734141+0000 18'118 32:201 [1,0,2] 1 [1,0,2] 1 18'118 2026-02-23T07:49:57.734108+0000 18'118 2026-02-23T07:49:57.734108+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:49:57.734108+0000 118 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:49:43.343285+0000 18'122 32:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:48:53.227858+0000 0 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean+inconsistent 2026-02-23T07:49:58.097564+0000 18'119 32:208 [0,1,2] 0 [0,1,2] 0 18'119 2026-02-23T07:49:58.097528+0000 18'119 2026-02-23T07:49:58.097528+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:49:58.097528+0000 119 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean+inconsistent 2026-02-23T07:49:59.151936+0000 18'129 32:212 [2,0,1] 2 [2,0,1] 2 18'129 2026-02-23T07:49:59.151908+0000 18'129 2026-02-23T07:49:59.151908+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:49:59.151908+0000 129 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-23T07:49:43.342977+0000 18'138 32:200 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:48:53.227858+0000 0'0 2026-02-23T07:48:53.227858+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:50:00.534 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:50:00.535 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2b 3 8 128 40 10 256 4194304 0 760 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_2b@ NAUT 3 8 128 40/ 10 256 4194304/ 0 760 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:50:00.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.560 INFO:tasks.workunit.client.0.trial129.stdout:1173 2026-02-23T07:50:00.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:50:00.561 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:50:00.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:50:00.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.576 INFO:tasks.workunit.client.0.trial129.stdout:1611 2026-02-23T07:50:00.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:50:00.577 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:50:00.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:50:00.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.592 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:50:00.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:50:00.593 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:50:00.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:50:00.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.608 INFO:tasks.workunit.client.0.trial129.stdout:1173 2026-02-23T07:50:00.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.608 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:50:00.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:50:00.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:50:00.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.622 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.0 2026-02-23T07:50:00.622 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:50:00.624 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:50:00.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:50:00.624 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:50:00.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:50:00.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.639 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:50:00.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.639 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:50:00.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:50:00.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:50:00.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:50:00.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:50:00.669 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:50:00.669 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:50:00.670 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:50:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:50:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:50:06.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:50:06.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:50:06.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:50:06.394 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:50:06.394 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:50:06.394 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:06.401 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:50:06.401 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:50:06.401 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:06.408 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:50:06.408 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:50:06.408 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:06.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:50:06.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771833006418291927 2026-02-23T07:50:06.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:06.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:50:06.572 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.1 to repair 2026-02-23T07:50:06.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:06.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:50:06.740 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:50:06.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:06.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:50:06.903 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.1 to repair 2026-02-23T07:50:06.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:06.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:50:07.065 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:50:07.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:07.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:50:07.230 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:50:07.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:07.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:50:07.394 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:50:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:50:07.558 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:50:07.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:50:07.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:50:07.720 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:50:07.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:50:07.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:50:07.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:50:07.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:50:07.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:50:07.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:50:07.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:50:07.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:50:07.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:50:07.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771833007897702826 2026-02-23T07:50:07.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=1479 2026-02-23T07:50:07.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:50:07.962 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:50:07.962 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:50:07.962 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:07.969 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:50:07.969 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:50:07.969 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:07.976 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:50:07.976 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:50:07.976 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:07.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:50:12.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:50:13.141 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:50:13.141 INFO:tasks.workunit.client.0.trial129.stdout:1.7 116 0 0 0 0 29696 0 0 116 0 116 active+clean 2026-02-23T07:50:08.844077+0000 18'116 32:249 [1,2,0] 1 [1,2,0] 1 18'116 2026-02-23T07:50:08.839402+0000 18'116 2026-02-23T07:50:08.839402+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:08.839402+0000 116 0 2026-02-23T07:50:13.141 INFO:tasks.workunit.client.0.trial129.stdout:1.6 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:50:07.831978+0000 18'137 32:269 [1,0,2] 1 [1,0,2] 1 18'137 2026-02-23T07:50:07.830150+0000 18'137 2026-02-23T07:50:07.830150+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:07.830150+0000 137 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:1.5 145 0 0 0 0 37120 0 0 145 0 145 active+clean 2026-02-23T07:50:07.245575+0000 18'145 32:288 [2,0,1] 2 [2,0,1] 2 18'145 2026-02-23T07:50:07.240086+0000 18'145 2026-02-23T07:50:07.240086+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:07.240086+0000 145 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:1.4 118 0 0 0 0 30208 0 0 118 0 118 active+clean 2026-02-23T07:50:06.805474+0000 18'118 32:255 [1,0,2] 1 [1,0,2] 1 18'118 2026-02-23T07:50:06.801356+0000 18'118 2026-02-23T07:50:06.801356+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:06.801356+0000 118 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:1.3 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:50:10.830734+0000 18'122 32:254 [1,2,0] 1 [1,2,0] 1 18'122 2026-02-23T07:50:10.828177+0000 18'122 2026-02-23T07:50:10.828177+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:10.828177+0000 122 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:1.2 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:50:08.092940+0000 18'119 32:254 [0,1,2] 0 [0,1,2] 0 18'119 2026-02-23T07:50:08.090602+0000 18'119 2026-02-23T07:50:08.090602+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:08.090602+0000 119 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:1.1 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:50:08.288478+0000 18'129 32:267 [2,0,1] 2 [2,0,1] 2 18'129 2026-02-23T07:50:08.284778+0000 18'129 2026-02-23T07:50:08.284778+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:08.284778+0000 129 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:1.0 138 0 0 0 0 35328 0 0 138 0 138 active+clean 2026-02-23T07:50:09.822355+0000 18'138 32:297 [1,0,2] 1 [1,0,2] 1 18'138 2026-02-23T07:50:09.818241+0000 18'138 2026-02-23T07:50:09.818241+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:50:09.818241+0000 138 0 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:50:13.142 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:50:13.143 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:50:13.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2b 3 8 128 40 10 256 4194304 0 1479 2026-02-23T07:50:13.152 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_2b@ REPR 3 8 128 40/ 10 256 4194304/ 0 1479 2026-02-23T07:50:13.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:50:13.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:50:13.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:50:13.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:50:13.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:50:13.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:50:13.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0750 2026-02-23T07:50:13.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:50:13.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:50:13.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:13.260 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.261 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 48, 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.262 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.263 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.264 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.265 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.266 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.267 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "value": 524288 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.268 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:13.269 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.045999764, 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.022999882 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.270 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.271 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.272 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.273 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.274 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.275 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.276 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.277 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.278 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.279 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.280 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.280 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.280 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.280 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.281 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 48, 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.282 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.283 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.284 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.285 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "value": 524288 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.286 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.287 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.045999764, 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.022999882 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.288 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:13.289 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.290 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:13.291 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.292 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.294 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:50:13.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.316 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 258, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.318 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 524288 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.258998675, 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.025899867 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.324 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.325 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.326 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.327 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 258, 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.328 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.329 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.330 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 524288 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.258998675, 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.025899867 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.333 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.334 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.335 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.336 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:13.337 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.338 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:50:13.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 110, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:13.388 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.389 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2048 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 524288 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.390 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.107999448, 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.026999862 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:13.391 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:13.392 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.393 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:13.394 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 110, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.395 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.396 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2048 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 524288 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:50:13.397 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.107999448, 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.026999862 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.398 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.399 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:13.400 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:50:13.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:20.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:50:20.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 72, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.601 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.602 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.603 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 755200 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.604 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.071999630, 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.023999876 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.605 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:20.606 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.607 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.608 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.609 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 72, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.610 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.611 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 755200 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.612 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.071999630, 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.023999876 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.613 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:50:20.614 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.615 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.616 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:50:20.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.678 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 362, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.679 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.680 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:50:20.681 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2950 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 755200 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.682 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 14 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 14 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": 14 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 14, 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.366998123, 2026-02-23T07:50:20.683 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.026214151 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.684 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": 14 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.685 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.686 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:20.687 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:20.688 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.689 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.690 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 362, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.691 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.692 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2950 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout: "value": 755200 2026-02-23T07:50:20.693 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 14 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 14 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:50:20.694 INFO:tasks.workunit.client.0.trial129.stdout: "value": 14 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 14, 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.366998123, 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.026214151 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.695 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "value": 14 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.696 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.697 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.698 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.699 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.700 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.701 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:50:20.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.756 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 165, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.757 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.758 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3072 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3072 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3072 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3072 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3072 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:20.759 INFO:tasks.workunit.client.0.trial129.stderr: "value": 786432 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.760 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.164999158, 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.027499859 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:20.761 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.762 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.763 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.764 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:50:20.765 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.766 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 165, 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.767 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3072 2026-02-23T07:50:20.768 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3072 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3072 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3072 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3072 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "value": 786432 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.769 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:50:20.770 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.164999158, 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.027499859 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:50:20.771 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:50:20.772 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.773 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.774 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:50:20.775 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:20.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:50:20.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:50:34.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:50:34.031 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:50:34.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:50:34.234 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:50:34.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:50:34.438 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:50:34.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:50:34.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:50:34.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 32 256 4 2026-02-23T07:50:34.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:50:34.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:50:34.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=32 2026-02-23T07:50:34.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-23T07:50:34.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:50:34.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:50:34.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771833034452774128 2026-02-23T07:50:34.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-23T07:50:34.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-23T07:50:34.454 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:50:34.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.rUb8xyav2i bs=256 count=1 2026-02-23T07:50:34.457 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:50:34.457 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:50:34.457 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.7611e-05 s, 6.8 MB/s 2026-02-23T07:50:34.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:50:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:50:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:50:34.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:50:34.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:50:34.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.rUb8xyav2i 2026-02-23T07:50:34.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:50:34.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771833034600945256 2026-02-23T07:50:34.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=148 2026-02-23T07:50:34.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 32 objects in pool test in 148 ms' 2026-02-23T07:50:34.602 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 32 objects in pool test in 148 ms 2026-02-23T07:50:34.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:50:34.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:50:34.602358716' 2026-02-23T07:50:34.603 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:50:34.602358716 2026-02-23T07:50:34.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:50:34.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:50:34.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:50:34.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:50:34.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:50:34.605 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:50:34.605 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:50:34.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:50:34.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:50:34.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:50:34.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:50:34.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:50:34.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:50:34.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:50:34.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:50:34.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:50:34.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:50:34.845 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:50:34.845 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:50:34.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:50:34.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:50:34.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:50:34.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T07:50:34.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T07:50:34.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T07:50:34.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:50:34.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:50:34.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-23T07:50:34.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-23T07:50:34.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676' 2026-02-23T07:50:34.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:50:34.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:50:35.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-23T07:50:35.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-23T07:50:35.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676 2-55834574858' 2026-02-23T07:50:35.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:50:35.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T07:50:35.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:50:35.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:50:35.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T07:50:35.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:50:35.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T07:50:35.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T07:50:35.067 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836494 2026-02-23T07:50:35.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:50:35.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836494 2026-02-23T07:50:35.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:50:36.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:50:36.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:50:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T07:50:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:50:36.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-23T07:50:36.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:50:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:50:36.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-23T07:50:36.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:50:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-23T07:50:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-23T07:50:36.403 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705676 2026-02-23T07:50:36.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:50:36.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-23T07:50:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:50:36.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-23T07:50:36.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:50:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:50:36.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-23T07:50:36.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:50:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-23T07:50:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-23T07:50:36.568 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574858 2026-02-23T07:50:36.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:50:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-23T07:50:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:50:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:50:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:50:36.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:50:36.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:50:36.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:50:36.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:50:36.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:50:36.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:50:36.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:50:36.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:50:37.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:50:37.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:50:37.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:50:37.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:50:37.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:50:37.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:50:37.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:50:37.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:50:37.455 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:50:37.455 INFO:tasks.workunit.client.0.trial129.stdout: nothing is going on 2026-02-23T07:50:37.455 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:50:37.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:50:37.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:50:42.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:50:28.064109+0000 18'11 18:31 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-23T07:50:28.064340+0000 18'4 18:24 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-23T07:50:28.064112+0000 18'9 18:32 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-23T07:50:28.063927+0000 18'8 18:30 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:50:42.622 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:50:42.623 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:50:42.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:50:42.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:50:42.633 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:50:42.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:50:42.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:50:42.708 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:50:42.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:50:42.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:50:42.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:50:42.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:50:42.781 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:50:42.781288923 2026-02-23T07:50:42.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:50:42.781288923' 2026-02-23T07:50:42.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:50:42.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771833042782538085 2026-02-23T07:50:42.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:50:42.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:50:42.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:50:42.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 32 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=32 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:50:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:50:43.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:50:43.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771833043331538117 2026-02-23T07:50:43.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:50:43.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:50:43.332735291 (549 ms)' 2026-02-23T07:50:43.333 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:50:43.332735291 (549 ms) 2026-02-23T07:50:43.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=10 2026-02-23T07:50:43.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:50:43.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj22 obj23 obj20 obj21 obj26 obj27 obj24 obj25 obj28 obj29 obj31 obj30 obj32 obj4 obj5 obj6 obj7 obj1 obj2 obj3 obj8 obj9 obj19 obj18 obj17 obj16 obj15 obj14 obj13 obj12 obj11 obj10 2026-02-23T07:50:43.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 10 2026-02-23T07:50:43.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.335 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 10 2026-02-23T07:50:43.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 10' 2026-02-23T07:50:43.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.336 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj27 2026-02-23T07:50:43.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj27' 2026-02-23T07:50:43.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 32' 2026-02-23T07:50:43.337 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 32 2026-02-23T07:50:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:50:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:50:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:50:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 0 )) 2026-02-23T07:50:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=0 )) 2026-02-23T07:50:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj27 2026-02-23T07:50:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.339 INFO:tasks.workunit.client.0.trial129.stdout:Object obj27: acting: 1 2 0 2026-02-23T07:50:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj27: acting: 1 2 0' 2026-02-23T07:50:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:50:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.341 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:50:43.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.342 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj27 (0) 2 0 1 2026-02-23T07:50:43.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj27 (0) 2 0 1' 2026-02-23T07:50:43.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:50:43.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.343 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj27 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj27' 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj27 ' 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj19 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj19: acting: 1 0 2' 2026-02-23T07:50:43.345 INFO:tasks.workunit.client.0.trial129.stdout:Object obj19: acting: 1 0 2 2026-02-23T07:50:43.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:50:43.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.346 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:50:43.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.347 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj19 (1) 0 2 1 2026-02-23T07:50:43.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj19 (1) 0 2 1' 2026-02-23T07:50:43.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:50:43.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.348 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj19 2026-02-23T07:50:43.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj19' 2026-02-23T07:50:43.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj19 ' 2026-02-23T07:50:43.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj26 2026-02-23T07:50:43.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.350 INFO:tasks.workunit.client.0.trial129.stdout:Object obj26: acting: 1 2 0 2026-02-23T07:50:43.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj26: acting: 1 2 0' 2026-02-23T07:50:43.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:50:43.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.351 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:50:43.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.352 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj26 (2) 2 0 1 2026-02-23T07:50:43.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj26 (2) 2 0 1' 2026-02-23T07:50:43.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:50:43.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.354 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj26 2026-02-23T07:50:43.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj26' 2026-02-23T07:50:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj26 ' 2026-02-23T07:50:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj16 2026-02-23T07:50:43.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.355 INFO:tasks.workunit.client.0.trial129.stdout:Object obj16: acting: 0 1 2 2026-02-23T07:50:43.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj16: acting: 0 1 2' 2026-02-23T07:50:43.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:50:43.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.357 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:50:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.357 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj16 (3) 1 2 0 2026-02-23T07:50:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj16 (3) 1 2 0' 2026-02-23T07:50:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:50:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.359 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj16 2026-02-23T07:50:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj16' 2026-02-23T07:50:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj16 ' 2026-02-23T07:50:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj20 2026-02-23T07:50:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.361 INFO:tasks.workunit.client.0.trial129.stdout:Object obj20: acting: 1 0 2 2026-02-23T07:50:43.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj20: acting: 1 0 2' 2026-02-23T07:50:43.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:50:43.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.362 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:50:43.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.363 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj20 (4) 0 2 1 2026-02-23T07:50:43.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj20 (4) 0 2 1' 2026-02-23T07:50:43.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:50:43.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.364 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj20 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj20' 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj20 ' 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj30 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.365 INFO:tasks.workunit.client.0.trial129.stdout:Object obj30: acting: 0 1 2 2026-02-23T07:50:43.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj30: acting: 0 1 2' 2026-02-23T07:50:43.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 2' 2026-02-23T07:50:43.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.367 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:50:43.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.367 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj30 (5) 1 2 0 2026-02-23T07:50:43.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj30 (5) 1 2 0' 2026-02-23T07:50:43.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:50:43.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj30' 2026-02-23T07:50:43.369 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj30 2026-02-23T07:50:43.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj30 ' 2026-02-23T07:50:43.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj7 2026-02-23T07:50:43.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.370 INFO:tasks.workunit.client.0.trial129.stdout:Object obj7: acting: 2 0 1 2026-02-23T07:50:43.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj7: acting: 2 0 1' 2026-02-23T07:50:43.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:50:43.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.371 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:50:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.372 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj7 (6) 0 1 2 2026-02-23T07:50:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj7 (6) 0 1 2' 2026-02-23T07:50:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:50:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.373 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj7 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj7' 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj7 ' 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj15 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.374 INFO:tasks.workunit.client.0.trial129.stdout:Object obj15: acting: 2 0 1 2026-02-23T07:50:43.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj15: acting: 2 0 1' 2026-02-23T07:50:43.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:50:43.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.375 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:50:43.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.376 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj15 (7) 0 1 2 2026-02-23T07:50:43.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj15 (7) 0 1 2' 2026-02-23T07:50:43.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=1 2026-02-23T07:50:43.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.377 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj15 2026-02-23T07:50:43.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj15' 2026-02-23T07:50:43.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj15 ' 2026-02-23T07:50:43.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj12 2026-02-23T07:50:43.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.378 INFO:tasks.workunit.client.0.trial129.stdout:Object obj12: acting: 2 0 1 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj12: acting: 2 0 1' 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 0 1' 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.380 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj12 (8) 0 1 2 2026-02-23T07:50:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj12 (8) 0 1 2' 2026-02-23T07:50:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:50:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj12' 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj12 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj12 ' 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj5 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.381 INFO:tasks.workunit.client.0.trial129.stdout:Object obj5: acting: 1 2 0 2026-02-23T07:50:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj5: acting: 1 2 0' 2026-02-23T07:50:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:50:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:50:43.382 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj5 (9) 2 0 1 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj5 (9) 2 0 1' 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:50:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj5' 2026-02-23T07:50:43.384 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj5 2026-02-23T07:50:43.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj5 ' 2026-02-23T07:50:43.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:50:43.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 10 )) 2026-02-23T07:50:43.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:50:43.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:50:43.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:50:43.415 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:50:43.415 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:50:43.415 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:43.422 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:50:43.422 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:50:43.422 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:43.429 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:50:43.430 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:50:43.430 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:50:43.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:50:43.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:50:43.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:50:43.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:50:43.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:50:43.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:50:43.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:50:43.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:50:44.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:50:44.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:50:44.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj20 obj7 obj12 obj5 ' 2026-02-23T07:50:44.749 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj20 obj7 obj12 obj5 2026-02-23T07:50:44.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:50:44.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:44.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:44.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj20 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj20 2026-02-23T07:50:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj20 rm-attr _ 2026-02-23T07:50:44.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:44.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:44.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:44.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:44.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:50:44.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:50:44.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:44.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:44.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj7 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj7 2026-02-23T07:50:44.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj7 rm-attr _ 2026-02-23T07:50:45.054 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:50:45.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:45.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:45.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:45.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:50:45.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:50:45.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:45.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj12 2026-02-23T07:50:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:50:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj12 2026-02-23T07:50:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj12 rm-attr _ 2026-02-23T07:50:45.229 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:50:45.229 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:50:45.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:45.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:45.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:45.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:50:45.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:50:45.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:45.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj5 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj5 2026-02-23T07:50:45.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj5 rm-attr _ 2026-02-23T07:50:45.395 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:9a09113a:::obj7:head#, (61) No data available 2026-02-23T07:50:45.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:af5f95cb:::obj12:head#, (61) No data available 2026-02-23T07:50:45.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:24b5611b:::obj20:head#, (61) No data available 2026-02-23T07:50:45.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:45.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:50:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:50:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:50:45.456 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj15 2026-02-23T07:50:45.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj15 ' 2026-02-23T07:50:45.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:50:45.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:45.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:50:45.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj15 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj15 2026-02-23T07:50:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj15 rm-attr _ 2026-02-23T07:50:45.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:45.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:45.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:50:45.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:50:45.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:50:45.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj27 obj19 obj26 obj16 obj30 ' 2026-02-23T07:50:45.627 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj27 obj19 obj26 obj16 obj30 2026-02-23T07:50:45.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:50:45.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:45.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj27 2026-02-23T07:50:45.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:45.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:50:45.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj27 2026-02-23T07:50:45.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj27 rm-attr _ 2026-02-23T07:50:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:50:45.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:50:45.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:45.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:45.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:45.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:45.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj19 2026-02-23T07:50:45.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:45.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:50:45.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj19 2026-02-23T07:50:45.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj19 rm-attr _ 2026-02-23T07:50:45.928 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:45.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj26 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj26 2026-02-23T07:50:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj26 rm-attr _ 2026-02-23T07:50:46.099 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:50:46.099 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:50:46.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:46.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:46.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:46.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:46.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:50:46.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:50:46.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:46.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj16 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj16 2026-02-23T07:50:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj16 rm-attr _ 2026-02-23T07:50:46.262 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:50:46.262 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:50:46.262 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:50:46.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj30 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj30 2026-02-23T07:50:46.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj30 rm-attr _ 2026-02-23T07:50:46.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:dfa74a43:::obj27:head#, (61) No data available 2026-02-23T07:50:46.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:f3c2593a:::obj26:head#, (61) No data available 2026-02-23T07:50:46.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:461f8b5e:::obj16:head#, (61) No data available 2026-02-23T07:50:46.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:00b31b6c:::obj19:head#, (61) No data available 2026-02-23T07:50:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:50:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:50:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:50:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:50:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:50:57.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:51:02.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:50:50.306053+0000 18'11 31:55 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-23T07:50:50.305315+0000 18'4 31:60 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-23T07:50:50.305519+0000 18'9 31:48 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-23T07:50:50.305713+0000 18'8 31:55 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:51:02.742 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:51:02.743 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:51:02.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:51:02.752 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:51:02.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:51:02.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:51:02.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:51:02.827 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:51:02.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:51:02.891 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:51:02.891 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:51:02.891 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:02.898 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:51:02.898 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:51:02.898 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:02.905 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:51:02.905 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:51:02.905 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:02.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:51:03.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:51:03.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771833063916130033 2026-02-23T07:51:03.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:51:03.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:51:03.917573921' 2026-02-23T07:51:03.918 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:51:03.917573921 2026-02-23T07:51:03.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:51:03.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:51:03.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:51:04.070 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:51:04.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:51:04.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771833064084972906 2026-02-23T07:51:04.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:51:04.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:51:04.086196520 (168 ms)' 2026-02-23T07:51:04.087 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:51:04.086196520 (168 ms) 2026-02-23T07:51:04.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:51:04.087 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:51:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:51:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:51:04.089 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:51:04.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:51:04.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:51:04.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 2 ( 2 0 1 ) 1' 2026-02-23T07:51:04.090 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 2 ( 2 0 1 ) 1 2026-02-23T07:51:04.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:51:04.091 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 2 ) 1 2026-02-23T07:51:04.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 2 ) 1' 2026-02-23T07:51:04.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:51:04.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:51:04.092 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:51:04.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:51:04.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:51:04.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:51:04.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:51:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:51:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:51:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:51:04.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:51:04.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:50:50.306053+0000 18'11 31:55 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-23T07:50:50.305315+0000 18'4 31:60 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-23T07:50:50.305519+0000 18'9 31:49 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-23T07:50:50.305713+0000 18'8 31:56 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:51:04.404 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:51:04.405 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:51:04.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:51:04.480 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:51:04.480 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:04.480 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.487 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:51:04.487 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:04.487 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.494 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:51:04.494 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:04.494 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:51:04.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771833064503310423 2026-02-23T07:51:04.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:51:04.504 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:51:04.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:51:04.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:51:04.567 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:04.567 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:51:04.567 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:51:04.567 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:51:04.568 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:51:04.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:51:04.576 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:51:04.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:51:04.638 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:04.638 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:51:04.638 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:51:04.638 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:51:04.639 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:51:04.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:51:04.647 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:51:04.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:51:04.710 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:04.710 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:51:04.710 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:51:04.710 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:51:04.710 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:51:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:51:04.718 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:51:04.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:51:04.782 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:04.782 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:51:04.782 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:51:04.782 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:51:04.782 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:04.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:51:04.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:51:04.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:51:04.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:51:04.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:51:04.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:51:04.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:51:04.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:51:04.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:51:04.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771833064958723591 2026-02-23T07:51:04.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=455 2026-02-23T07:51:04.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:51:05.022 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:51:05.022 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:05.022 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:05.028 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:51:05.029 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:05.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:05.036 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:51:05.036 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:05.036 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:51:07.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:50:50.306053+0000 18'11 31:56 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean+inconsistent 2026-02-23T07:51:05.035609+0000 18'4 31:69 [0,1,2] 0 [0,1,2] 0 18'4 2026-02-23T07:51:05.035568+0000 18'4 2026-02-23T07:51:05.035568+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:51:05.035568+0000 4 0 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean+inconsistent 2026-02-23T07:51:04.900675+0000 18'9 31:59 [2,0,1] 2 [2,0,1] 2 18'9 2026-02-23T07:51:04.900647+0000 18'9 2026-02-23T07:51:04.900647+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:51:04.900647+0000 9 0 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-23T07:50:50.305713+0000 18'8 31:57 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:50:27.957083+0000 0'0 2026-02-23T07:50:27.957083+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:50:27.957083+0000 0 0 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:51:07.199 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:51:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2c 3 4 8 0 10 256 4194304 0 455 2026-02-23T07:51:07.209 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_2c@ NAUT 3 4 8 0/ 10 256 4194304/ 0 455 2026-02-23T07:51:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:07.210 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:51:07.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:51:07.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:51:07.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:51:07.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:51:07.225 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:51:07.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:07.225 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:51:07.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:51:07.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:51:07.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:51:07.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:51:07.240 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:51:07.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:07.240 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:51:07.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:51:07.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:51:07.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:51:07.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:51:07.255 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:51:07.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:07.255 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:51:07.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:51:07.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:51:07.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:51:07.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:51:07.269 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:51:07.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:51:07.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:51:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:51:12.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:51:12.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:51:12.980 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:51:12.981 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:12.981 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:12.987 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:51:12.988 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:12.988 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:12.994 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:51:12.994 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:12.995 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:13.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:51:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771833073003389276 2026-02-23T07:51:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:51:13.156 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:51:13.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:13.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:51:13.318 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.2 to repair 2026-02-23T07:51:13.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:13.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:51:13.481 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:51:13.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:51:13.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:51:13.644 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:51:13.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:51:13.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:51:13.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:51:13.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771833073819121429 2026-02-23T07:51:13.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=815 2026-02-23T07:51:13.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:51:13.883 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:51:13.883 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:13.883 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:13.890 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:51:13.890 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:13.890 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:13.897 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:51:13.897 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:51:13.897 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:13.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:51:18.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:51:19.062 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stdout:1.3 11 0 0 0 0 2816 0 0 11 0 11 active+clean 2026-02-23T07:51:14.317015+0000 18'11 31:90 [1,2,0] 1 [1,2,0] 1 18'11 2026-02-23T07:51:14.314706+0000 18'11 2026-02-23T07:51:14.314706+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:51:14.314706+0000 11 0 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stdout:1.2 4 0 0 0 0 1024 0 0 4 0 4 active+clean 2026-02-23T07:51:14.054396+0000 18'4 31:89 [0,1,2] 0 [0,1,2] 0 18'4 2026-02-23T07:51:14.052086+0000 18'4 2026-02-23T07:51:14.052086+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:51:14.052086+0000 4 0 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stdout:1.1 9 0 0 0 0 2304 0 0 9 0 9 active+clean 2026-02-23T07:51:13.929545+0000 18'9 31:83 [2,0,1] 2 [2,0,1] 2 18'9 2026-02-23T07:51:13.926902+0000 18'9 2026-02-23T07:51:13.926902+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:51:13.926902+0000 9 0 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stdout:1.0 8 0 0 0 0 2048 0 0 8 0 8 active+clean 2026-02-23T07:51:13.356685+0000 18'8 31:91 [1,0,2] 1 [1,0,2] 1 18'8 2026-02-23T07:51:13.355161+0000 18'8 2026-02-23T07:51:13.355161+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:51:13.355161+0000 8 0 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:51:19.063 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:51:19.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_2c 3 4 8 0 10 256 4194304 0 815 2026-02-23T07:51:19.074 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_2c@ REPR 3 4 8 0/ 10 256 4194304/ 0 815 2026-02-23T07:51:19.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 3 'After repair' 2026-02-23T07:51:19.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:51:19.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=3 2026-02-23T07:51:19.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:51:19.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:51:19.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:51:19.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0751 2026-02-23T07:51:19.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:51:19.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:51:19.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:19.177 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.178 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 2, 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.179 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.180 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.181 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.182 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16384 2026-02-23T07:51:19.183 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.184 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.002999986, 2026-02-23T07:51:19.185 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.001499993 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:19.186 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.187 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.188 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:19.189 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.190 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.191 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.192 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.193 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.194 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 2, 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.195 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.196 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.197 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16384 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.198 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.199 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.002999986, 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.001499993 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.200 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:19.201 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.202 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.203 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.204 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.206 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.206 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.206 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.206 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:51:19.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.240 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 10, 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:19.241 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.242 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.243 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16384 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.244 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.010999948, 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002749987 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.245 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:19.246 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.247 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.248 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.249 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:19.250 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 10, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.251 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.252 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.253 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.254 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16384 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.255 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.010999948, 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002749987 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.256 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.257 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:51:19.258 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:19.259 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.260 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:51:19.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.314 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 4, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.315 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.316 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 64 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16384 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.317 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.005999972, 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002999986 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.318 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.319 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.320 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.321 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.322 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.323 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 4, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.324 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:19.325 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.326 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 64 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16384 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:19.327 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.005999972, 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002999986 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.328 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.330 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.331 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:19.332 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:19.333 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:19.333 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:19.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:51:19.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:26.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:51:26.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:26.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:51:26.976 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:26.977 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:26.978 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 3, 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:26.979 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.980 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:26.981 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.982 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.983 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.984 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "value": 24576 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.985 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.986 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.003999981, 2026-02-23T07:51:26.987 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.001333327 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.988 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.989 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:26.990 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.991 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.992 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.993 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:26.994 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:26.995 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:26.996 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:26.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:26.998 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:26.999 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 3, 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.000 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.001 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.002 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.003 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "value": 24576 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.004 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.003999981, 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.001333327 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:27.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.013 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:51:27.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.038 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 15, 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.039 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.040 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:27.041 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 24576 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.042 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.015999923, 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002666653 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.043 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.044 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:27.045 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.046 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.047 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.048 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:27.049 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.050 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 15, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.051 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout: "value": 24576 2026-02-23T07:51:27.053 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:51:27.054 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.015999923, 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002666653 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.055 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.056 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:27.057 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:27.058 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.059 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.060 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:51:27.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.111 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 6, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.112 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.113 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 96 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 24576 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.114 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.008999958, 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.002999986 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.115 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:51:27.116 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.117 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.118 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.119 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:27.120 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.121 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:51:27.122 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.123 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 96 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 24576 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.124 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.008999958, 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.002999986 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.125 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.126 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:51:27.127 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:51:27.128 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.129 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:51:27.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 1 )) 2026-02-23T07:51:42.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:407: corrupt_and_measure: echo 'Pool: test : 1' 2026-02-23T07:51:42.780 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T07:51:42.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:409: corrupt_and_measure: ceph osd pool set test noscrub 1 2026-02-23T07:51:42.986 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 noscrub to 1 2026-02-23T07:51:43.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:410: corrupt_and_measure: ceph osd pool set test nodeep-scrub 1 2026-02-23T07:51:43.191 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 nodeep-scrub to 1 2026-02-23T07:51:43.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:413: corrupt_and_measure: local saved_echo_flag=x 2026-02-23T07:51:43.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:414: corrupt_and_measure: set -x 2026-02-23T07:51:43.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:417: corrupt_and_measure: create_objects td/osd-scrub-dump test 2048 256 4 2026-02-23T07:51:43.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:279: create_objects: local dir=td/osd-scrub-dump 2026-02-23T07:51:43.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:280: create_objects: local poolname=test 2026-02-23T07:51:43.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:281: create_objects: local K=2048 2026-02-23T07:51:43.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:282: create_objects: local S=256 2026-02-23T07:51:43.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:283: create_objects: local NTHR=4 2026-02-23T07:51:43.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: date +%s%N 2026-02-23T07:51:43.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:285: create_objects: local start_times=1771833103206413519 2026-02-23T07:51:43.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: file_with_random_data 256 2026-02-23T07:51:43.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=256 2026-02-23T07:51:43.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T07:51:43.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.JOv0E03iSL bs=256 count=1 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.9614e-05 s, 6.5 MB/s 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:286: create_objects: local testdata_file=/tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i=1 )) 2026-02-23T07:51:43.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj3 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj4 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj5 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj6 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj7 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj8 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj9 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj10 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj11 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj12 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj13 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj14 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj15 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj16 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj17 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj18 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj19 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj20 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj21 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj22 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj23 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj24 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj25 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj26 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj27 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj28 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj29 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj30 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj31 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj32 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj33 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj34 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj35 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj36 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj37 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj38 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj39 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj40 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj41 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj42 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj43 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj44 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj45 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj46 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj47 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj48 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj49 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj50 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj51 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj52 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj53 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj54 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj55 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj56 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj57 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj58 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj59 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj60 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj61 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj62 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj63 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj64 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj65 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj66 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj67 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj68 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj69 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj70 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj71 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj72 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj73 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj74 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj75 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj76 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj77 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj78 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj79 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj80 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj81 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj82 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj83 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj84 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj85 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj86 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj87 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj88 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj89 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj90 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj91 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj92 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj93 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj94 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj95 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj96 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj97 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj98 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj99 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj100 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj101 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj102 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj103 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj104 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj105 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj106 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj107 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj108 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj109 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj110 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj111 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj112 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj113 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj114 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj115 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj116 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj117 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj118 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj119 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj120 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj121 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj122 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj123 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj124 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj125 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj126 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj127 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj128 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj129 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj130 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj131 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj132 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj133 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj134 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj135 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj136 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj137 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj138 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj139 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj140 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj141 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj142 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj143 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj144 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj145 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj146 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj147 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj148 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj149 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj150 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj151 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj152 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj153 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj154 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj155 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj156 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj157 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj158 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj159 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj160 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj161 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj162 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj163 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj164 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj165 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj166 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj167 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj168 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj169 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj170 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj171 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj172 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj173 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj174 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj175 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:43.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj176 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj177 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj178 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj179 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj180 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj181 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj182 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj183 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj184 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj185 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj186 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj187 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj188 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj189 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj190 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj191 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj192 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj193 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj194 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj195 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj196 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj197 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj198 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj199 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj200 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj201 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj202 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj203 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj204 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj205 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj206 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj207 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj208 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj209 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj210 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj211 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj212 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj213 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj214 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj215 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj216 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj217 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj218 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj219 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj220 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj221 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj222 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj223 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj224 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj225 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj226 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj227 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj228 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj229 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj230 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj231 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj232 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj233 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj234 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj235 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj236 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj237 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj238 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj239 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj240 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj241 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj242 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj243 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj244 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj245 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj246 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj247 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj248 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj249 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj250 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj251 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj252 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj253 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj254 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj255 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj256 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj257 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj258 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj259 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj260 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj261 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj262 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj263 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj264 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj265 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj266 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj267 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj268 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj269 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj270 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj271 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj272 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj273 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj274 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj275 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj276 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj277 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj278 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj279 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj280 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj281 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj282 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj283 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj284 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj285 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj286 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj287 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj288 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj289 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj290 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj291 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj292 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj293 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj294 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj295 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj296 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj297 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj298 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj299 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj300 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj301 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj302 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj303 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj304 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj305 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj306 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj307 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj308 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj309 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj310 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj311 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj312 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj313 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj314 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj315 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj316 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj317 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj318 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj319 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj320 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj321 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj322 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj323 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj324 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj325 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj326 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj327 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj328 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj329 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj330 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj331 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj332 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj333 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj334 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj335 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj336 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj337 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj338 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj339 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj340 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj341 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj342 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj343 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj344 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj345 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj346 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj347 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj348 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj349 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj350 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj351 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj352 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj353 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj354 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj355 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj356 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj357 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj358 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj359 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj360 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj361 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj362 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj363 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj364 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj365 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj366 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj367 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj368 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj369 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj370 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj371 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj372 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj373 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj374 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj375 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj376 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj377 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj378 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj379 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj380 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj381 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj382 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj383 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj384 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj385 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj386 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj387 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj388 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj389 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj390 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj391 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj392 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj393 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj394 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj395 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj396 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj397 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj398 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:44.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj399 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:44.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:44.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:44.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj400 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj401 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj402 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj403 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj404 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj405 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj406 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj407 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj408 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj409 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj410 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj411 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj412 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj413 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj414 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj415 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj416 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj417 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj418 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj419 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj420 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj421 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj422 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj423 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj424 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj425 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj426 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj427 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj428 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj429 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj430 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj431 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj432 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj433 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj434 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj435 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj436 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj437 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj438 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj439 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj440 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj441 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj442 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj443 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj444 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj445 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj446 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj447 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj448 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj449 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj450 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj451 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj452 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj453 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj454 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj455 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj456 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj457 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj458 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj459 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj460 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj461 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj462 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj463 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj464 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj465 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj466 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj467 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj468 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj469 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj470 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj471 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj472 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj473 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj474 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj475 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj476 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj477 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj478 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj479 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj480 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj481 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj482 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj483 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj484 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj485 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj486 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj487 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj488 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj489 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj490 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj491 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj492 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj493 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj494 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj495 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj496 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj497 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj498 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj499 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj500 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj501 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj502 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj503 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj504 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj505 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj506 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj507 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj508 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj509 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj510 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj511 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj512 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj513 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj514 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj515 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj516 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj517 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj518 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj519 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj520 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj521 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj522 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj523 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj524 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj525 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj526 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj527 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj528 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj529 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj530 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj531 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj532 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj533 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj534 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj535 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj536 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj537 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj538 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj539 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj540 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj541 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj542 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj543 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj544 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj545 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj546 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj547 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj548 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj549 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj550 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj551 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj552 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj553 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj554 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj555 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj556 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj557 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj558 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj559 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj560 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj561 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj562 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj563 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj564 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj565 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj566 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj567 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj568 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj569 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj570 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj571 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj572 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj573 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj574 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj575 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj576 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj577 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj578 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj579 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj580 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj581 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj582 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj583 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj584 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj585 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj586 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj587 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj588 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj589 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj590 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj591 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj592 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj593 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj594 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj595 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj596 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj597 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj598 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj599 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj600 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj601 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj602 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj603 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj604 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj605 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj606 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj607 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj608 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj609 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj610 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj611 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj612 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj613 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj614 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj615 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj616 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj617 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj618 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj619 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj620 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj621 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj622 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj623 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:45.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj624 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj625 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj626 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj627 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj628 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj629 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj630 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj631 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj632 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj633 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj634 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj635 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj636 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj637 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj638 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj639 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj640 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj641 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj642 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj643 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj644 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj645 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj646 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj647 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj648 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj649 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj650 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj651 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj652 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj653 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj654 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj655 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj656 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj657 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj658 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj659 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj660 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj661 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj662 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj663 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj664 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj665 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj666 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj667 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj668 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj669 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj670 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj671 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj672 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj673 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj674 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj675 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj676 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj677 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj678 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj679 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj680 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj681 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj682 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj683 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj684 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj685 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj686 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj687 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj688 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj689 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj690 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj691 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj692 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj693 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj694 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj695 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj696 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj697 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj698 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj699 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj700 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj701 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj702 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj703 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj704 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj705 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj706 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj707 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj708 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj709 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj710 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj711 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj712 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj713 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj714 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj715 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj716 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj717 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj718 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj719 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj720 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj721 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj722 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj723 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj724 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj725 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj726 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj727 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj728 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj729 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj730 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj731 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj732 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj733 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj734 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj735 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj736 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj737 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj738 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj739 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj740 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj741 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj742 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj743 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj744 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj745 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj746 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj747 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj748 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj749 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj750 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj751 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj752 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj753 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj754 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj755 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj756 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj757 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj758 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj759 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj760 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj761 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj762 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj763 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj764 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj765 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj766 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj767 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj768 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj769 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj770 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj771 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj772 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj773 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj774 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj775 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj776 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj777 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj778 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj779 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj780 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj781 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj782 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj783 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj784 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj785 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj786 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj787 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj788 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj789 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj790 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj791 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj792 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj793 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj794 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj795 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj796 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj797 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj798 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj799 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj800 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj801 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj802 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj803 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj804 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj805 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj806 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj807 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj808 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj809 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj810 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj811 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj812 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj813 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj814 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj815 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj816 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj817 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj818 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj819 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj820 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj821 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj822 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj823 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj824 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj825 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj826 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj827 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj828 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj829 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj830 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj831 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj832 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj833 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj834 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj835 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj836 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj837 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj838 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj839 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj840 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj841 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj842 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj843 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj844 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj845 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj846 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj847 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj848 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj849 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj850 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj851 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj852 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj853 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj854 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj855 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj856 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj857 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj858 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj859 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj860 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj861 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj862 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj863 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj864 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj865 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj866 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj867 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj868 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj869 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj870 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj871 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj872 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj873 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj874 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj875 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj876 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj877 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj878 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj879 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj880 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj881 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj882 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj883 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj884 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj885 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj886 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj887 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj888 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj889 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj890 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj891 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj892 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj893 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj894 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj895 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj896 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj897 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj898 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj899 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj900 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj901 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj902 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj903 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj904 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj905 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj906 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj907 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj908 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj909 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj910 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj911 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj912 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj913 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj914 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj915 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj916 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj917 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj918 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj919 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj920 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj921 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj922 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj923 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj924 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj925 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj926 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj927 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj928 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj929 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj930 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj931 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj932 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj933 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj934 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj935 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj936 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj937 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj938 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj939 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj940 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj941 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj942 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj943 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj944 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj945 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj946 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj947 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj948 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj949 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj950 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj951 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj952 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj953 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj954 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj955 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj956 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj957 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj958 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj959 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj960 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj961 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj962 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj963 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj964 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj965 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj966 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj967 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj968 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj969 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj970 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj971 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj972 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj973 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj974 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj975 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj976 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj977 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj978 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj979 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj980 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj981 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj982 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj983 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj984 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj985 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj986 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj987 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj988 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj989 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj990 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj991 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj992 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj993 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj994 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj995 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj996 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj997 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj998 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj999 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1000 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1001 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1002 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1003 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1004 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1005 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1006 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1007 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1008 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1009 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1010 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1011 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1012 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1013 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1014 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1015 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1016 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1017 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1018 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1019 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1020 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1021 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1022 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1023 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1024 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1025 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1026 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1027 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1028 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1029 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1030 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1031 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1032 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1033 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1034 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1035 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1036 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1037 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1038 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1039 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1040 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1041 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1042 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1043 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1044 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1045 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1046 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1047 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1048 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1049 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1050 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1051 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1052 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1053 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1054 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1055 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1056 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1057 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1058 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1059 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1060 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1061 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1062 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1063 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1064 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1065 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1066 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1067 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:47.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1068 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1069 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1070 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1071 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1072 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1073 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1074 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1075 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1076 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1077 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1078 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1079 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1080 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1081 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1082 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1083 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1084 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1085 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1086 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1087 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1088 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1089 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1090 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1091 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1092 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1093 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1094 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1095 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1096 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1097 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1098 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1099 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1100 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1101 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1102 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1103 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1104 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1105 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1106 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1107 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1108 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1109 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1110 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1111 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1112 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1113 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1114 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1115 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1116 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1117 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1118 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1119 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1120 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1121 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1122 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1123 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1124 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1125 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1126 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1127 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1128 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1129 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1130 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1131 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1132 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1133 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1134 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1135 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1136 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1137 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1138 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1139 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1140 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1141 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1142 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1143 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1144 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1145 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1146 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1147 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1148 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1149 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1150 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1151 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1152 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1153 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1154 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1155 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1156 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1157 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1158 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1159 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1160 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1161 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1162 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1163 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1164 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1165 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1166 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1167 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1168 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1169 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1170 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1171 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1172 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1173 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1174 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1175 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1176 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1177 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1178 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1179 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1180 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1181 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1182 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1183 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1184 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1185 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1186 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1187 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1188 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1189 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1190 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1191 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1192 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1193 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1194 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1195 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1196 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1197 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1198 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1199 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1200 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1201 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1202 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1203 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1204 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1205 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1206 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1207 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1208 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1209 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1210 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1211 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1212 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1213 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1214 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1216 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1215 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1217 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1218 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1219 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1220 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1221 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1222 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1223 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1224 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1225 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1226 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1227 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1228 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1229 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1230 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1231 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1232 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1233 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1234 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1235 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1236 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1237 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1238 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1239 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1240 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1241 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1242 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1243 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1244 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1245 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1246 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1247 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1248 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1249 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1250 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1251 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1252 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1253 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1254 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1255 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1256 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1257 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1258 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1259 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1260 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1261 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1262 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1263 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1264 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1265 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1266 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1267 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1268 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1269 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1270 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1271 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1272 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1273 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1274 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1275 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1276 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1277 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1278 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1279 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1280 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1281 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1282 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1283 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1284 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1285 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1286 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1287 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1288 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1289 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1290 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1291 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:48.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1292 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1293 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1294 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1295 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1296 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1297 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1298 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1299 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1300 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1301 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1302 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1303 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1304 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1305 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1306 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1307 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1308 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1309 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1310 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1311 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1312 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1313 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1314 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1315 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1316 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1317 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1318 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1319 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1320 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1321 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1322 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1323 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1324 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1325 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1326 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1327 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1328 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1329 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1330 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1331 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1332 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1333 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1334 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1335 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1336 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1337 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1338 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1339 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1340 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1341 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1342 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1343 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1344 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1345 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1346 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1347 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1348 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1349 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1350 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1351 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1352 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1353 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1354 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1355 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1356 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1357 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1358 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1359 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1360 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1361 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1362 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1363 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1364 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1365 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1366 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1367 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1368 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1369 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1370 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1371 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1372 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1373 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1374 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1375 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1376 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1377 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1378 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1379 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1380 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1381 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1382 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1383 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1384 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1385 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1386 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1387 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1388 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1389 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1390 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1391 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1392 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1393 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1394 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1395 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1396 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1397 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1398 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1399 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1400 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1401 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1402 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1403 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1404 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1405 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1406 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1407 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1408 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1409 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1410 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1411 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1412 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1413 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1414 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1415 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1416 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1417 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1418 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1419 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1420 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1421 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1422 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1423 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1424 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1425 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1426 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1427 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1428 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1429 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1430 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1431 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1432 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1433 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1434 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1435 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1436 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1437 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1438 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1439 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1440 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1441 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1442 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1443 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1444 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1445 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1446 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1447 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1448 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1449 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1450 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1451 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1452 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1453 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1454 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1455 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1456 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1457 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1458 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1459 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1460 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1461 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1462 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1463 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1464 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1465 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1466 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1467 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1468 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1469 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1470 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1471 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1472 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1473 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1474 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1475 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1476 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1477 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1478 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1479 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1480 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1481 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1482 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1483 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1484 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1485 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1486 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1487 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1488 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1489 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1490 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1491 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1492 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1493 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1494 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1495 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1496 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1497 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1498 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1499 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1500 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1501 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1502 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1503 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1504 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1505 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1506 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1507 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1508 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1509 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1510 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1511 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1512 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1513 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1514 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1515 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:49.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:49.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:49.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1516 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1517 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1518 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1519 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1520 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1521 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1522 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1523 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1524 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1525 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1526 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1527 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1528 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1529 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1530 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1531 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1532 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1533 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1534 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1535 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1536 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1537 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1538 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1539 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1540 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1541 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1542 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1543 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1544 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1545 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1546 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1547 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1548 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1549 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1550 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1551 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1552 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1553 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1554 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1555 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1556 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1557 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1558 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1559 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1560 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1561 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1562 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1563 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1564 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1565 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1566 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1567 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1568 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1569 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1570 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1571 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1572 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1573 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1574 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1575 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1576 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1577 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1578 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1579 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1580 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1581 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1582 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1583 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1584 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1585 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1586 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1587 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1588 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1589 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1590 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1591 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1592 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1593 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1594 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1595 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1596 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1597 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1598 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1599 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1600 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1601 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1602 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1603 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1604 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1605 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1606 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1607 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1608 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1609 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1610 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1611 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1612 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1613 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1614 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1615 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1616 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1617 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1618 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1619 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1620 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1621 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1622 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1623 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1624 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1625 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1626 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1627 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1628 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1629 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1630 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1631 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1632 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1633 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1634 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1635 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1636 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1637 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1638 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1639 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1640 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1641 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1642 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1643 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1644 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1645 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1646 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1647 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1648 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1649 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1650 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1651 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1652 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1653 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1654 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1655 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1656 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1657 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1658 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1659 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1660 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1661 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1662 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1663 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1664 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1665 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1666 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1667 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1668 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1669 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1670 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1671 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1672 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1673 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1674 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1675 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1676 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1677 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1678 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1679 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1680 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1681 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1682 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1683 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1684 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1685 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1686 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1687 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1688 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1689 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1690 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1691 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1692 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1693 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1694 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1695 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1696 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1697 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1698 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1699 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1700 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1701 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1702 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1703 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1704 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1705 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1706 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1707 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1708 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1709 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1710 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1711 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1712 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1713 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1714 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1715 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1716 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1717 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1718 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1719 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1720 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1721 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1722 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1723 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1724 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1725 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1726 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1727 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1728 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1729 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1730 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1731 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1732 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1733 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1734 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1735 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1736 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1737 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1738 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1739 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:50.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1740 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1741 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1742 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1743 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1744 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1745 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1746 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1747 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1748 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1749 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1750 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1751 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1752 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1753 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1754 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1755 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1756 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1757 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1758 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1759 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1760 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1761 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1762 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1763 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1764 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1765 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1766 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1767 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1768 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1769 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1770 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1771 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1772 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1773 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1774 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1775 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1776 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1777 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1778 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1779 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1780 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1781 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1782 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1783 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1784 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1785 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1786 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1787 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1788 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1789 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1790 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1791 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1792 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1793 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1794 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1795 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1796 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1797 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1798 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1799 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1800 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1801 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1802 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1803 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1804 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1805 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1806 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1807 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1808 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1809 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1811 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1812 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1810 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1813 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1814 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1815 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1816 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1817 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1818 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1819 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1820 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1821 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1822 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1823 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1824 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1825 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1826 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1827 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1828 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1829 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1830 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1831 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1832 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1833 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1834 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1835 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1836 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1837 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1838 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1839 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1840 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1841 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1842 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1843 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1844 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1845 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1846 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1847 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1848 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1849 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1850 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1851 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1852 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1853 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1854 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1855 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1856 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1857 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1858 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1859 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1860 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1861 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1862 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1863 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1864 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1865 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1866 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1867 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1868 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1869 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1870 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1871 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1872 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1873 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1874 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1875 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1876 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1877 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1878 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1879 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1880 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1881 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1882 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1883 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1884 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1885 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1886 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1887 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1888 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1889 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1890 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1891 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1892 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1893 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1894 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1895 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1896 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1897 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1898 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1899 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1900 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1901 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1902 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1903 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1904 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1905 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1906 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1907 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1908 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1909 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1910 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1911 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1912 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1913 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1914 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1915 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1916 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1917 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1918 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1919 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1920 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1921 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1922 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1923 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1924 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1925 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1926 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1927 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1928 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1929 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1930 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1931 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1932 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1933 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1934 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1935 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1936 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1937 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1938 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1939 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1940 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1941 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1942 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1943 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1944 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1945 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1946 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1947 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1948 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1949 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1950 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1951 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1952 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1953 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1954 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1955 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1956 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1957 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1958 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1959 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1960 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1961 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1962 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1963 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:51.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1964 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1965 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1966 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1967 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1968 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1969 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1970 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1971 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1972 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1973 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1974 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1975 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1976 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1977 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1978 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1979 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1980 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1981 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1982 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1983 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1984 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1985 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1986 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1987 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1988 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1989 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1990 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1991 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1992 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1993 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1994 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1995 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1996 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1997 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1998 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj1999 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2000 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2001 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2002 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2003 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2004 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2005 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2006 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2007 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2008 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2009 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2010 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2011 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2012 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2013 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2014 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2015 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2016 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2017 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2018 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2019 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2020 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2021 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2022 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2023 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2024 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2025 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2026 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2027 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2028 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2029 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2030 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2031 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2032 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2033 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2034 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2035 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2036 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2037 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2038 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2039 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2040 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2041 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2042 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2043 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2044 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2045 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2046 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2047 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:291: create_objects: (( i % NTHR == 0 )) 2026-02-23T07:51:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:292: create_objects: wait 2026-02-23T07:51:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:290: create_objects: rados -p test put obj2048 /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i++ )) 2026-02-23T07:51:52.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:289: create_objects: (( i<=K )) 2026-02-23T07:51:52.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:295: create_objects: wait 2026-02-23T07:51:52.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:296: create_objects: rm /tmp/tmp.JOv0E03iSL 2026-02-23T07:51:52.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: date +%s%N 2026-02-23T07:51:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:297: create_objects: local end_times=1771833112390506830 2026-02-23T07:51:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:298: create_objects: local duration=9184 2026-02-23T07:51:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:299: create_objects: echo 'create_objects(): created 2048 objects in pool test in 9184 ms' 2026-02-23T07:51:52.392 INFO:tasks.workunit.client.0.trial129.stdout:create_objects(): created 2048 objects in pool test in 9184 ms 2026-02-23T07:51:52.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: date +%T.%N 2026-02-23T07:51:52.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:419: corrupt_and_measure: echo 'Pre-wait-forclean: 07:51:52.391863734' 2026-02-23T07:51:52.393 INFO:tasks.workunit.client.0.trial129.stdout:Pre-wait-forclean: 07:51:52.391863734 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:420: corrupt_and_measure: wait_for_clean 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:51:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:51:52.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:51:52.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:51:52.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:51:52.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:51:52.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:51:52.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:51:52.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:51:52.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:51:52.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:51:52.637 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:51:52.637 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:51:52.637 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T07:51:52.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:51:52.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:51:52.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:51:52.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-23T07:51:52.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-23T07:51:52.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-23T07:51:52.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:51:52.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:51:52.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672984 2026-02-23T07:51:52.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672984 2026-02-23T07:51:52.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-42949672984' 2026-02-23T07:51:52.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:51:52.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:51:52.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542165 2026-02-23T07:51:52.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542165 2026-02-23T07:51:52.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-42949672984 2-60129542165' 2026-02-23T07:51:52.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:51:52.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T07:51:52.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411347 2026-02-23T07:51:52.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411347 2026-02-23T07:51:52.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-42949672984 2-60129542165 3-77309411347' 2026-02-23T07:51:52.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:51:52.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836506 2026-02-23T07:51:52.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:51:52.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:51:52.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-23T07:51:52.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:51:52.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-23T07:51:52.936 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836506 2026-02-23T07:51:52.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-23T07:51:52.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:51:53.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836506 2026-02-23T07:51:53.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:51:54.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:51:54.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:51:54.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-23T07:51:54.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:51:54.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672984 2026-02-23T07:51:54.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:51:54.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:51:54.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672984 2026-02-23T07:51:54.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:51:54.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672984 2026-02-23T07:51:54.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672984' 2026-02-23T07:51:54.271 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672984 2026-02-23T07:51:54.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:51:54.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672985 -lt 42949672984 2026-02-23T07:51:54.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:51:54.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542165 2026-02-23T07:51:54.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:51:54.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:51:54.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542165 2026-02-23T07:51:54.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:51:54.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542165 2026-02-23T07:51:54.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542165' 2026-02-23T07:51:54.440 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542165 2026-02-23T07:51:54.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:51:54.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542166 -lt 60129542165 2026-02-23T07:51:54.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:51:54.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411347 2026-02-23T07:51:54.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:51:54.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T07:51:54.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411347 2026-02-23T07:51:54.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:51:54.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411347 2026-02-23T07:51:54.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411347' 2026-02-23T07:51:54.608 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411347 2026-02-23T07:51:54.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T07:51:54.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411347 -lt 77309411347 2026-02-23T07:51:54.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:51:54.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:51:54.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:51:54.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-23T07:51:54.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:51:54.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:51:54.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:51:54.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:51:54.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:51:54.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:51:54.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:51:55.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-23T07:51:55.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:51:55.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:51:55.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:51:55.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-23T07:51:55.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:51:55.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:51:55.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:421: corrupt_and_measure: ceph osd pool stats 2026-02-23T07:51:55.497 INFO:tasks.workunit.client.0.trial129.stdout:pool test id 1 2026-02-23T07:51:55.497 INFO:tasks.workunit.client.0.trial129.stdout: client io 168 KiB/s wr, 0 op/s rd, 167 op/s wr 2026-02-23T07:51:55.497 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:51:55.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:422: corrupt_and_measure: (( stride_override > 0 )) 2026-02-23T07:51:55.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:426: corrupt_and_measure: sleep 5 2026-02-23T07:52:00.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:427: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:51:36.589618+0000 24'122 24:141 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-23T07:51:36.589201+0000 24'131 24:150 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-23T07:51:36.588846+0000 24'128 24:147 [2,1,3] 2 [2,1,3] 2 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:51:36.589178+0000 24'133 24:158 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:51:36.588965+0000 24'133 24:156 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-23T07:51:36.588919+0000 24'136 24:155 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-23T07:51:36.588081+0000 24'126 24:150 [0,1,3] 0 [0,1,3] 0 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:51:36.589198+0000 24'119 24:140 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:51:36.589755+0000 24'127 24:148 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:51:36.588223+0000 24'127 24:147 [2,3,0] 2 [2,3,0] 2 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-23T07:51:36.589507+0000 24'134 24:154 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:51:36.588275+0000 24'129 24:149 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-23T07:51:36.589007+0000 24'113 24:133 [1,2,3] 1 [1,2,3] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-23T07:51:36.589156+0000 24'121 24:140 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-23T07:51:36.589514+0000 24'132 24:151 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:51:36.588279+0000 24'137 24:156 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:52:00.662 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:52:00.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:52:00.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:52:00.674 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:52:00.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:52:00.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:429: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:52:00.747 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:52:00.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:52:00.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:52:00.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:430: corrupt_and_measure: local actual_stride=4194304 2026-02-23T07:52:00.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: date +%T.%N 2026-02-23T07:52:00.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:432: corrupt_and_measure: echo 'Pre dict creation: 07:52:00.825531769' 2026-02-23T07:52:00.826 INFO:tasks.workunit.client.0.trial129.stdout:Pre dict creation: 07:52:00.825531769 2026-02-23T07:52:00.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: date +%s%N 2026-02-23T07:52:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:433: corrupt_and_measure: local start_dict=1771833120826632382 2026-02-23T07:52:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:434: corrupt_and_measure: declare -A obj_to_pgid 2026-02-23T07:52:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:435: corrupt_and_measure: declare -A obj_to_primary 2026-02-23T07:52:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:436: corrupt_and_measure: declare -A obj_to_acting 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:437: corrupt_and_measure: objs_to_prim_dict_fast td/osd-scrub-dump test obj 2048 obj_to_pgid obj_to_primary obj_to_acting 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:437: objs_to_prim_dict_fast: local dir=td/osd-scrub-dump 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:438: objs_to_prim_dict_fast: local poolname=test 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:439: objs_to_prim_dict_fast: local basename=obj 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:440: objs_to_prim_dict_fast: local obj_num=2048 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:441: objs_to_prim_dict_fast: local -n obj_pgid_dict=obj_to_pgid 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:442: objs_to_prim_dict_fast: local -n obj_prim_dict=obj_to_primary 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:443: objs_to_prim_dict_fast: local -n obj_acting_dict=obj_to_acting 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:445: objs_to_prim_dict_fast: local saved_echo_flag=x 2026-02-23T07:52:00.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:446: objs_to_prim_dict_fast: set +x 2026-02-23T07:52:32.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: date +%s%N 2026-02-23T07:52:32.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:438: corrupt_and_measure: local end_dict=1771833152332756803 2026-02-23T07:52:32.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: date +%T.%N 2026-02-23T07:52:32.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:439: corrupt_and_measure: echo 'Post dict creation: 07:52:32.334082908 (31506 ms)' 2026-02-23T07:52:32.334 INFO:tasks.workunit.client.0.trial129.stdout:Post dict creation: 07:52:32.334082908 (31506 ms) 2026-02-23T07:52:32.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:444: corrupt_and_measure: local all_errors=50 2026-02-23T07:52:32.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: mapfile -t selected_keys 2026-02-23T07:52:32.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: shuf -n 50 2026-02-23T07:52:32.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:446: corrupt_and_measure: printf '%s\n' obj475 obj291 obj474 obj290 obj477 obj293 obj476 obj292 obj769 obj471 obj295 obj768 obj470 obj294 obj598 obj473 obj297 obj599 obj472 obj296 obj765 obj596 obj299 obj764 obj597 obj298 obj767 obj594 obj766 obj595 obj761 obj592 obj479 obj760 obj593 obj478 obj763 obj590 obj762 obj591 obj40 obj41 obj42 obj43 obj44 obj45 obj46 obj47 obj48 obj49 obj1696 obj1263 obj1697 obj1262 obj1694 obj1261 obj1695 obj1260 obj1692 obj1267 obj1693 obj1266 obj1690 obj1265 obj1691 obj1264 obj1269 obj1268 obj1698 obj1699 obj1199 obj1198 obj1191 obj1190 obj1193 obj1192 obj1195 obj1194 obj1197 obj1196 obj1498 obj646 obj233 obj1499 obj647 obj232 obj644 obj231 obj645 obj230 obj642 obj318 obj237 obj643 obj319 obj236 obj640 obj235 obj641 obj234 obj1490 obj314 obj1491 obj315 obj1492 obj316 obj239 obj1493 obj317 obj238 obj1494 obj310 obj1495 obj311 obj1496 obj648 obj312 obj1497 obj649 obj313 obj819 obj818 obj817 obj816 obj815 obj814 obj813 obj812 obj811 obj810 obj615 obj426 obj242 obj614 obj427 obj243 obj617 obj424 obj240 obj616 obj425 obj241 obj611 obj422 obj246 obj610 obj423 obj247 obj738 obj613 obj569 obj420 obj244 obj739 obj612 obj568 obj421 obj245 obj736 obj567 obj737 obj566 obj734 obj565 obj248 obj735 obj564 obj249 obj732 obj619 obj563 obj733 obj618 obj562 obj730 obj561 obj428 obj731 obj560 obj429 obj2046 obj1537 obj192 obj2047 obj1536 obj193 obj2044 obj1535 obj190 obj2045 obj1534 obj191 obj2042 obj1533 obj196 obj2043 obj1532 obj197 obj2040 obj1531 obj194 obj2041 obj1530 obj195 obj198 obj199 obj2048 obj1539 obj1538 obj1906 obj1322 obj1111 obj790 obj1907 obj1323 obj1110 obj791 obj1904 obj1320 obj1113 obj1038 obj792 obj1905 obj1321 obj1112 obj1039 obj793 obj1902 obj1326 obj1115 obj794 obj1903 obj1327 obj1114 obj795 obj1900 obj1618 obj1324 obj1117 obj796 obj1901 obj1619 obj1325 obj1116 obj797 obj1616 obj1119 obj1032 obj798 obj1617 obj1118 obj1033 obj799 obj1614 obj1328 obj1030 obj1615 obj1329 obj1031 obj1612 obj1036 obj1613 obj1037 obj1908 obj1610 obj1034 obj1909 obj1611 obj1035 obj2015 obj1429 obj949 obj840 obj141 obj97 obj2014 obj1428 obj948 obj841 obj140 obj96 obj2017 obj842 obj143 obj95 obj2016 obj843 obj142 obj94 obj2011 obj1818 obj844 obj145 obj93 obj2010 obj1819 obj845 obj144 obj92 obj2013 obj846 obj147 obj91 obj2012 obj847 obj146 obj90 obj1814 obj1421 obj941 obj848 obj149 obj1815 obj1420 obj940 obj849 obj148 obj1816 obj1423 obj943 obj1817 obj1422 obj942 obj2019 obj1810 obj1425 obj945 obj2018 obj1811 obj1424 obj944 obj1812 obj1427 obj947 obj99 obj1813 obj1426 obj946 obj98 obj1955 obj1744 obj530 obj1954 obj1745 obj531 obj1957 obj1746 obj1298 obj532 obj1956 obj1747 obj1299 obj533 obj1951 obj1740 obj1649 obj534 obj1950 obj1741 obj1648 obj535 obj1953 obj1742 obj536 obj1952 obj1743 obj537 obj1645 obj1292 obj538 obj1644 obj1293 obj539 obj1647 obj1290 obj1646 obj1291 obj1959 obj1748 obj1641 obj1296 obj1958 obj1749 obj1640 obj1297 obj1643 obj1294 obj1642 obj1295 obj1098 obj699 obj1099 obj698 obj1094 obj695 obj1095 obj694 obj1096 obj697 obj1097 obj696 obj1090 obj691 obj1091 obj690 obj1092 obj693 obj1093 obj692 obj1568 obj79 obj1569 obj78 obj1560 obj71 obj1561 obj70 obj1562 obj73 obj1563 obj72 obj1564 obj75 obj1565 obj74 obj1566 obj77 obj1567 obj76 obj1353 obj1352 obj1351 obj1049 obj1350 obj1048 obj1357 obj1238 obj1356 obj1239 obj1355 obj1354 obj1234 obj1043 obj1235 obj1042 obj1359 obj1236 obj1041 obj1358 obj1237 obj1040 obj1230 obj1047 obj1231 obj1046 obj1232 obj1045 obj1233 obj1044 obj1894 obj718 obj509 obj400 obj325 obj1895 obj719 obj508 obj401 obj324 obj1896 obj402 obj327 obj1897 obj403 obj326 obj1890 obj1779 obj404 obj321 obj1891 obj1778 obj405 obj320 obj1988 obj1892 obj406 obj323 obj1989 obj1893 obj407 obj322 obj1986 obj1775 obj710 obj501 obj408 obj1987 obj1774 obj711 obj500 obj409 obj1984 obj1777 obj712 obj503 obj1985 obj1776 obj713 obj502 obj1982 obj1898 obj1771 obj714 obj505 obj329 obj1983 obj1899 obj1770 obj715 obj504 obj328 obj1980 obj1773 obj716 obj507 obj1981 obj1772 obj717 obj506 obj268 obj269 obj639 obj638 obj637 obj264 obj636 obj265 obj635 obj266 obj634 obj267 obj633 obj260 obj632 obj261 obj631 obj262 obj630 obj263 obj747 obj394 obj746 obj395 obj745 obj396 obj744 obj397 obj743 obj390 obj742 obj391 obj741 obj392 obj740 obj393 obj398 obj399 obj749 obj748 obj897 obj896 obj895 obj894 obj893 obj892 obj891 obj459 obj890 obj458 obj457 obj456 obj455 obj454 obj453 obj452 obj899 obj451 obj898 obj450 obj1876 obj1403 obj963 obj1877 obj1402 obj962 obj1874 obj1401 obj1139 obj961 obj1875 obj1400 obj1138 obj960 obj1872 obj1407 obj1308 obj967 obj1873 obj1406 obj1309 obj966 obj1870 obj1405 obj965 obj1871 obj1404 obj964 obj1304 obj1133 obj1305 obj1132 obj1409 obj1306 obj1131 obj969 obj1408 obj1307 obj1130 obj968 obj1300 obj1137 obj1301 obj1136 obj1878 obj1302 obj1135 obj1879 obj1303 obj1134 obj1667 obj1666 obj1665 obj169 obj1664 obj168 obj1663 obj1662 obj2039 obj1661 obj2038 obj1660 obj2037 obj163 obj2036 obj162 obj2035 obj161 obj2034 obj160 obj2033 obj167 obj2032 obj166 obj2031 obj1669 obj165 obj2030 obj1668 obj164 obj1825 obj1472 obj912 obj660 obj376 obj1824 obj1473 obj913 obj661 obj377 obj1827 obj1470 obj1148 obj910 obj662 obj374 obj1826 obj1471 obj1149 obj911 obj663 obj375 obj1821 obj1476 obj916 obj664 obj372 obj1820 obj1477 obj917 obj665 obj373 obj1979 obj1823 obj1728 obj1474 obj914 obj666 obj370 obj1978 obj1822 obj1729 obj1475 obj915 obj667 obj371 obj1977 obj1726 obj1142 obj668 obj1976 obj1727 obj1143 obj669 obj1975 obj1724 obj1478 obj1140 obj918 obj1974 obj1725 obj1479 obj1141 obj919 obj1973 obj1829 obj1722 obj1146 obj1972 obj1828 obj1723 obj1147 obj1971 obj1720 obj1144 obj378 obj1970 obj1721 obj1145 obj379 obj879 obj878 obj118 obj119 obj871 obj112 obj870 obj113 obj873 obj110 obj872 obj111 obj875 obj116 obj874 obj117 obj877 obj114 obj876 obj115 obj1582 obj53 obj1583 obj52 obj1580 obj51 obj1581 obj50 obj1586 obj57 obj1587 obj56 obj1584 obj55 obj1585 obj54 obj1588 obj59 obj1589 obj58 obj1780 obj1689 obj1256 obj1781 obj1688 obj1257 obj1782 obj1254 obj1783 obj1255 obj1784 obj1252 obj1785 obj1253 obj1786 obj1250 obj1787 obj1251 obj1788 obj1681 obj1789 obj1680 obj1683 obj1682 obj1685 obj1684 obj1687 obj1258 obj1686 obj1259 obj1551 obj22 obj1550 obj23 obj1553 obj20 obj1552 obj21 obj1555 obj26 obj1554 obj27 obj1557 obj24 obj1556 obj25 obj1559 obj1558 obj28 obj29 obj1920 obj1638 obj1205 obj1014 obj1921 obj1639 obj1204 obj1015 obj1922 obj1207 obj1016 obj1923 obj1206 obj1017 obj1924 obj1201 obj1010 obj1925 obj1200 obj1011 obj1926 obj1203 obj1012 obj1927 obj1202 obj1013 obj1928 obj1630 obj1929 obj1631 obj1632 obj1633 obj1634 obj1209 obj1018 obj1635 obj1208 obj1019 obj1636 obj1637 obj721 obj552 obj720 obj553 obj723 obj550 obj722 obj551 obj725 obj556 obj724 obj557 obj727 obj554 obj726 obj555 obj729 obj728 obj558 obj559 obj439 obj255 obj438 obj254 obj998 obj257 obj999 obj256 obj251 obj250 obj253 obj252 obj992 obj431 obj993 obj430 obj990 obj433 obj991 obj432 obj996 obj435 obj259 obj997 obj434 obj258 obj994 obj437 obj995 obj436 obj581 obj580 obj583 obj582 obj585 obj584 obj587 obj586 obj589 obj588 obj488 obj489 obj480 obj481 obj482 obj483 obj484 obj485 obj486 obj487 obj1919 obj1708 obj1335 obj1164 obj783 obj350 obj1918 obj1709 obj1334 obj1165 obj782 obj351 obj1337 obj1166 obj781 obj352 obj1336 obj1167 obj780 obj353 obj1331 obj1160 obj1029 obj787 obj354 obj1330 obj1161 obj1028 obj786 obj355 obj1333 obj1162 obj785 obj356 obj1332 obj1163 obj784 obj357 obj1911 obj1700 obj1025 obj358 obj1910 obj1701 obj1024 obj359 obj1913 obj1702 obj1027 obj789 obj1912 obj1703 obj1026 obj788 obj1915 obj1704 obj1339 obj1168 obj1021 obj1914 obj1705 obj1338 obj1169 obj1020 obj1917 obj1706 obj1023 obj1916 obj1707 obj1022 obj853 obj134 obj852 obj135 obj851 obj136 obj850 obj137 obj1458 obj938 obj857 obj130 obj1459 obj939 obj856 obj131 obj1809 obj855 obj132 obj1808 obj854 obj133 obj1807 obj1454 obj934 obj1806 obj1455 obj935 obj1805 obj1456 obj936 obj859 obj1804 obj1457 obj937 obj858 obj1803 obj1450 obj930 obj138 obj1802 obj1451 obj931 obj139 obj1801 obj1452 obj932 obj1800 obj1453 obj933 obj1757 obj1384 obj523 obj1756 obj1385 obj522 obj1755 obj1386 obj521 obj1754 obj1387 obj520 obj1753 obj1380 obj1289 obj527 obj1752 obj1381 obj1288 obj526 obj1751 obj1382 obj525 obj1750 obj1383 obj524 obj1285 obj1284 obj1287 obj529 obj1286 obj528 obj1388 obj1281 obj1389 obj1280 obj1759 obj1283 obj1758 obj1282 obj822 obj659 obj206 obj823 obj658 obj207 obj1489 obj820 obj204 obj1488 obj821 obj205 obj826 obj202 obj827 obj203 obj824 obj309 obj200 obj825 obj308 obj201 obj1483 obj651 obj307 obj1482 obj650 obj306 obj1481 obj828 obj653 obj305 obj1480 obj829 obj652 obj304 obj1487 obj655 obj303 obj1486 obj654 obj302 obj1485 obj657 obj301 obj208 obj1484 obj656 obj300 obj209 obj1186 obj1187 obj1184 obj1185 obj1182 obj1183 obj1180 obj1089 obj1181 obj1088 obj1087 obj1086 obj1085 obj1084 obj1083 obj1082 obj1188 obj1081 obj1189 obj1080 obj1579 obj1578 obj1573 obj1572 obj1571 obj1570 obj1577 obj1576 obj1575 obj1574 obj1850 obj1366 obj1851 obj1367 obj1852 obj1364 obj1853 obj1365 obj1854 obj1362 obj1855 obj1363 obj1856 obj1360 obj1229 obj1078 obj1857 obj1361 obj1228 obj1079 obj1858 obj1227 obj1076 obj1859 obj1226 obj1077 obj1225 obj1074 obj1224 obj1075 obj1223 obj1072 obj1222 obj1073 obj1368 obj1221 obj1070 obj1369 obj1220 obj1071 obj1601 obj185 obj1600 obj184 obj1603 obj1508 obj187 obj1602 obj1509 obj186 obj1605 obj181 obj1604 obj180 obj1607 obj183 obj1606 obj182 obj1609 obj1502 obj1608 obj1503 obj1500 obj1501 obj1506 obj189 obj1507 obj188 obj1504 obj1505 obj279 obj278 obj277 obj276 obj275 obj274 obj273 obj272 obj271 obj270 obj462 obj387 obj463 obj386 obj778 obj460 obj385 obj779 obj461 obj384 obj466 obj383 obj467 obj382 obj464 obj381 obj465 obj380 obj772 obj773 obj770 obj468 obj771 obj469 obj776 obj777 obj774 obj389 obj775 obj388 obj288 obj289 obj286 obj287 obj284 obj285 obj282 obj283 obj280 obj281 obj1270 obj1271 obj1272 obj1273 obj1274 obj1275 obj1276 obj1277 obj1278 obj1279 obj1942 obj1731 obj1943 obj1730 obj1940 obj1733 obj1658 obj1941 obj1732 obj1659 obj1946 obj1735 obj1947 obj1734 obj1944 obj1737 obj158 obj1945 obj1736 obj159 obj1739 obj1652 obj156 obj1738 obj1653 obj157 obj1948 obj1650 obj154 obj1949 obj1651 obj155 obj1656 obj152 obj1657 obj153 obj1654 obj150 obj1655 obj151 obj1465 obj905 obj673 obj369 obj220 obj1464 obj904 obj672 obj368 obj221 obj1467 obj907 obj671 obj222 obj1466 obj906 obj670 obj223 obj1461 obj1159 obj901 obj677 obj224 obj1460 obj1158 obj900 obj676 obj225 obj1463 obj903 obj675 obj226 obj1462 obj902 obj674 obj227 obj1155 obj361 obj228 obj1154 obj360 obj229 obj1157 obj679 obj363 obj1156 obj678 obj362 obj1469 obj1151 obj909 obj365 obj1468 obj1150 obj908 obj364 obj1153 obj367 obj1152 obj366 obj1991 obj1990 obj1993 obj1992 obj1995 obj808 obj109 obj1994 obj809 obj108 obj1997 obj1996 obj1999 obj804 obj105 obj1998 obj805 obj104 obj806 obj107 obj807 obj106 obj800 obj101 obj801 obj100 obj802 obj103 obj803 obj102 obj1887 obj602 obj413 obj1886 obj603 obj412 obj1885 obj709 obj600 obj411 obj1884 obj708 obj601 obj410 obj1883 obj606 obj578 obj417 obj1882 obj607 obj579 obj416 obj1881 obj604 obj415 obj1880 obj605 obj414 obj703 obj574 obj702 obj575 obj701 obj608 obj576 obj419 obj700 obj609 obj577 obj418 obj707 obj570 obj706 obj571 obj1889 obj705 obj572 obj1888 obj704 obj573 obj1793 obj1340 obj1249 obj1058 obj1792 obj1341 obj1248 obj1059 obj1791 obj1342 obj1790 obj1343 obj1797 obj1344 obj1796 obj1345 obj1795 obj1346 obj1794 obj1347 obj1348 obj1241 obj1050 obj1349 obj1240 obj1051 obj1799 obj1243 obj1052 obj1798 obj1242 obj1053 obj1245 obj1054 obj1244 obj1055 obj1247 obj1056 obj1246 obj1057 obj1524 obj35 obj1525 obj34 obj1526 obj37 obj1527 obj36 obj1520 obj31 obj1521 obj30 obj1522 obj33 obj1523 obj32 obj1528 obj39 obj1529 obj38 obj1933 obj1007 obj1932 obj1006 obj1931 obj1629 obj1005 obj1930 obj1628 obj1004 obj1937 obj1003 obj1936 obj1002 obj1935 obj1001 obj1934 obj1000 obj1623 obj1622 obj1939 obj1621 obj1938 obj1620 obj1627 obj1626 obj1625 obj1009 obj1624 obj1008 obj2002 obj1869 obj1436 obj956 obj84 obj2003 obj1868 obj1437 obj957 obj85 obj2000 obj1434 obj954 obj86 obj2001 obj1435 obj955 obj87 obj2006 obj1432 obj952 obj80 obj2007 obj1433 obj953 obj81 obj2004 obj1430 obj1319 obj1108 obj950 obj82 obj2005 obj1431 obj1318 obj1109 obj951 obj83 obj1861 obj1317 obj1106 obj1860 obj1316 obj1107 obj2008 obj1863 obj1315 obj1104 obj2009 obj1862 obj1314 obj1105 obj1865 obj1313 obj1102 obj88 obj1864 obj1312 obj1103 obj89 obj1867 obj1438 obj1311 obj1100 obj958 obj1866 obj1439 obj1310 obj1101 obj959 obj884 obj885 obj886 obj887 obj989 obj880 obj448 obj988 obj881 obj449 obj882 obj883 obj985 obj444 obj984 obj445 obj987 obj446 obj986 obj447 obj981 obj888 obj440 obj980 obj889 obj441 obj983 obj442 obj982 obj443 obj4 obj5 obj688 obj499 obj6 obj689 obj498 obj7 obj1 obj2 obj3 obj682 obj493 obj683 obj492 obj680 obj491 obj681 obj490 obj686 obj497 obj8 obj687 obj496 obj9 obj684 obj495 obj685 obj494 obj1595 obj66 obj1594 obj67 obj1597 obj64 obj1596 obj65 obj1591 obj62 obj1590 obj63 obj1593 obj60 obj1592 obj61 obj1599 obj1598 obj68 obj69 obj866 obj127 obj867 obj126 obj864 obj125 obj865 obj124 obj862 obj123 obj863 obj122 obj1449 obj929 obj860 obj121 obj1448 obj928 obj861 obj120 obj1447 obj927 obj1446 obj926 obj1445 obj925 obj1444 obj924 obj1443 obj923 obj1442 obj922 obj1441 obj921 obj868 obj129 obj1440 obj920 obj869 obj128 obj1397 obj516 obj332 obj1396 obj517 obj333 obj1768 obj1395 obj514 obj330 obj1769 obj1394 obj515 obj331 obj1393 obj512 obj336 obj1392 obj513 obj337 obj1391 obj510 obj334 obj1390 obj511 obj335 obj1762 obj1763 obj1760 obj338 obj1761 obj339 obj1766 obj1767 obj1764 obj1399 obj518 obj1765 obj1398 obj519 obj835 obj219 obj834 obj218 obj837 obj836 obj831 obj628 obj830 obj629 obj833 obj832 obj624 obj211 obj625 obj210 obj626 obj213 obj627 obj212 obj839 obj620 obj215 obj838 obj621 obj214 obj622 obj217 obj623 obj216 obj754 obj545 obj755 obj544 obj756 obj547 obj757 obj546 obj750 obj541 obj751 obj540 obj752 obj543 obj753 obj542 obj758 obj549 obj759 obj548 obj1212 obj1061 obj1213 obj1060 obj1210 obj1063 obj1211 obj1062 obj1216 obj1065 obj1217 obj1064 obj1548 obj1214 obj1067 obj19 obj1549 obj1215 obj1066 obj18 obj1546 obj1069 obj17 obj1547 obj1068 obj16 obj1544 obj1218 obj15 obj1545 obj1219 obj14 obj1542 obj13 obj1543 obj12 obj1540 obj11 obj1541 obj10 obj1843 obj1410 obj1379 obj1128 obj970 obj1842 obj1411 obj1378 obj1129 obj971 obj1841 obj1412 obj972 obj1840 obj1413 obj973 obj1847 obj1414 obj974 obj1846 obj1415 obj975 obj1845 obj1416 obj976 obj1844 obj1417 obj977 obj1418 obj1371 obj1120 obj978 obj1419 obj1370 obj1121 obj979 obj1849 obj1373 obj1122 obj1848 obj1372 obj1123 obj1375 obj1124 obj1374 obj1125 obj1377 obj1126 obj1376 obj1127 obj1674 obj178 obj1675 obj179 obj1676 obj1677 obj2028 obj1670 obj1519 obj2029 obj1671 obj1518 obj1672 obj1673 obj2024 obj1515 obj170 obj2025 obj1514 obj171 obj2026 obj1517 obj172 obj2027 obj1516 obj173 obj2020 obj1678 obj1511 obj174 obj2021 obj1679 obj1510 obj175 obj2022 obj1513 obj176 obj2023 obj1512 obj177 obj1832 obj1177 obj343 obj1833 obj1176 obj342 obj1830 obj1719 obj1175 obj341 obj1831 obj1718 obj1174 obj340 obj1968 obj1836 obj1173 obj347 obj1969 obj1837 obj1172 obj346 obj1834 obj1171 obj345 obj1835 obj1170 obj344 obj1964 obj1713 obj1965 obj1712 obj1966 obj1838 obj1711 obj349 obj1967 obj1839 obj1710 obj348 obj1960 obj1717 obj1961 obj1716 obj1962 obj1715 obj1179 obj1963 obj1714 obj1178 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:448: corrupt_and_measure: echo 'Selected keys: 50' 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stdout:Selected keys: 50 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stdout:First element: obj874 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:449: corrupt_and_measure: echo 'First element: obj874' 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:450: corrupt_and_measure: echo 'obj_to_primary: 2048' 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stdout:obj_to_primary: 2048 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:455: corrupt_and_measure: declare -A prim_objs_to_corrupt 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:456: corrupt_and_measure: declare -A repl_objs_to_corrupt 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i=0 )) 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj874 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj874' 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj874 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj874 ' 2026-02-23T07:52:32.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj706 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj706' 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj706 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj706 ' 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1026' 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1026 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1026 2026-02-23T07:52:32.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1026 ' 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj972' 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj972 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj972 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj972 ' 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1898 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1898' 2026-02-23T07:52:32.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1898 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1898 ' 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj343' 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj343 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj343 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj343 ' 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj376 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj376' 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj376 2026-02-23T07:52:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj376 ' 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1304 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1304' 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1304 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1304 ' 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1083 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1083' 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1083 2026-02-23T07:52:32.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1083 ' 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj191 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj191' 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj191 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj191 ' 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj181 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj181' 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj181 2026-02-23T07:52:32.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj181 ' 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1560 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1560' 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1560 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1560 ' 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1385 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1385' 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1385 2026-02-23T07:52:32.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1385 ' 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1510 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1510' 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1510 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1510 ' 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1578' 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1578 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1578 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1578 ' 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj328 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj328' 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj328 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj328 ' 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1272 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1272' 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1272 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1272 ' 2026-02-23T07:52:32.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1678 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1678' 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1678 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1678 ' 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj139 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj139' 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj139 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj139 ' 2026-02-23T07:52:32.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj322 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj322' 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj322 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj322 ' 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj393 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj393' 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj393 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj393 ' 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj182 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj182' 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj182 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj182 ' 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1119 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1119' 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1119 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1119 ' 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1679 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1679' 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1679 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1679 ' 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj161 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj161' 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj161 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj161 ' 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.351 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj808 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj808' 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj808 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj808 ' 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj95 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj95' 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj95 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj95 ' 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.352 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1899 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1899' 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1899 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj286 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1899 ' 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj286' 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj286 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj286 ' 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj62' 2026-02-23T07:52:32.353 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj62 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj62 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj62 ' 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1389' 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1389 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1389 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1389 ' 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1134 2026-02-23T07:52:32.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1134' 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1134 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1134 ' 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj194 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj194' 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj194 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj194 ' 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj605 2026-02-23T07:52:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj605' 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj605 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj605 ' 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj335' 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj335 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj335 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj335 ' 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj754 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj754' 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj754 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=1 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj754 ' 2026-02-23T07:52:32.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj661 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj661' 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj661 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj661 ' 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1727 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1727' 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1727 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=0 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1727 ' 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj1097 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj1097' 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj1097 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=2 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj1097 ' 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.358 INFO:tasks.workunit.client.0.trial129.stdout:Corrupting primary object (td/osd-scrub-dump) obj709 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:459: corrupt_and_measure: echo 'Corrupting primary object (td/osd-scrub-dump) obj709' 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:460: corrupt_and_measure: k=obj709 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:461: corrupt_and_measure: prim_osd=3 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:462: corrupt_and_measure: prim_objs_to_corrupt["$prim_osd"]+='obj709 ' 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:458: corrupt_and_measure: (( i < 40 )) 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i=40 )) 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj989 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj989: acting: 1 2 3' 2026-02-23T07:52:32.359 INFO:tasks.workunit.client.0.trial129.stdout:Object obj989: acting: 1 2 3 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 3' 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj989 (40) 2 3 1' 2026-02-23T07:52:32.360 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj989 (40) 2 3 1 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj989' 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj989 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj989 ' 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj428 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.361 INFO:tasks.workunit.client.0.trial129.stdout:Object obj428: acting: 1 3 2 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj428: acting: 1 3 2' 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 3 2' 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj428 (41) 3 2 1 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj428 (41) 3 2 1' 2026-02-23T07:52:32.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj428 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj428' 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj428 ' 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj967 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj967: acting: 1 2 3' 2026-02-23T07:52:32.363 INFO:tasks.workunit.client.0.trial129.stdout:Object obj967: acting: 1 2 3 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 3' 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj967 (42) 2 3 1 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj967 (42) 2 3 1' 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj967 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj967' 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj967 ' 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1777 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stdout:Object obj1777: acting: 1 2 0 2026-02-23T07:52:32.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1777: acting: 1 2 0' 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj1777 (43) 2 0 1 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1777 (43) 2 0 1' 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=0 2026-02-23T07:52:32.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj1777' 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj1777 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1777 ' 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj623 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stdout:Object obj623: acting: 1 2 0 2026-02-23T07:52:32.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj623: acting: 1 2 0' 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 2 0' 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj623 (44) 2 0 1' 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj623 (44) 2 0 1 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=2 2026-02-23T07:52:32.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj623 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj623' 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj623 ' 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj2018 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stdout:Object obj2018: acting: 3 0 2 2026-02-23T07:52:32.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj2018: acting: 3 0 2' 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '3 0 2' 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stdout:r----- 3 for obj2018 (45) 0 2 3 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 3 for obj2018 (45) 0 2 3' 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:52:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj2018' 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj2018 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj2018 ' 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj507 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stdout:Object obj507: acting: 1 0 2 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj507: acting: 1 0 2' 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 0 2' 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj507 (46) 0 2 1 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj507 (46) 0 2 1' 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=0 2026-02-23T07:52:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.373 INFO:tasks.workunit.client.0.trial129.stdout:replosd 0 for obj507 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 0 for obj507' 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj507 ' 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj359 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stdout:Object obj359: acting: 2 1 3 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj359: acting: 2 1 3' 2026-02-23T07:52:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '2 1 3' 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stdout:r----- 2 for obj359 (47) 1 3 2 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 2 for obj359 (47) 1 3 2' 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=3 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.375 INFO:tasks.workunit.client.0.trial129.stdout:replosd 3 for obj359 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 3 for obj359' 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj359 ' 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1319 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stdout:Object obj1319: acting: 0 1 3 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1319: acting: 0 1 3' 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '0 1 3' 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.376 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stdout:r----- 0 for obj1319 (48) 1 3 0 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 0 for obj1319 (48) 1 3 0' 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:474: corrupt_and_measure: repl_osd=1 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.377 INFO:tasks.workunit.client.0.trial129.stdout:replosd 1 for obj1319 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 1 for obj1319' 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1319 ' 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:465: corrupt_and_measure: k=obj1095 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:467: corrupt_and_measure: echo 'Object obj1095: acting: 1 3 2' 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stdout:Object obj1095: acting: 1 3 2 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: echo '1 3 2' 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:468: corrupt_and_measure: awk '{print $NF}' 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:471: corrupt_and_measure: acting_as_arr=(${obj_to_acting[$k]}) 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:472: corrupt_and_measure: echo 'r----- 1 for obj1095 (49) 3 2 1' 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stdout:r----- 1 for obj1095 (49) 3 2 1 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:473: corrupt_and_measure: (( i % 2 == 0 )) 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:476: corrupt_and_measure: repl_osd=2 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stdout:replosd 2 for obj1095 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:478: corrupt_and_measure: echo 'replosd 2 for obj1095' 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:479: corrupt_and_measure: repl_objs_to_corrupt["$repl_osd"]+='obj1095 ' 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i++ )) 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:464: corrupt_and_measure: (( i < 50 )) 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: [[ -n x ]] 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:481: corrupt_and_measure: set -x 2026-02-23T07:52:32.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:484: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_backoff_ratio 0.9999 2026-02-23T07:52:32.420 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:52:32.420 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:52:32.420 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:52:32.427 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:52:32.427 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:52:32.427 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:52:32.434 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:52:32.434 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:52:32.434 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:52:32.441 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T07:52:32.442 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_backoff_ratio = '' (not observed, change may require restart) " 2026-02-23T07:52:32.442 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:52:32.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:488: corrupt_and_measure: kill_daemons td/osd-scrub-dump TERM osd 2026-02-23T07:52:32.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:52:32.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:52:32.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:52:32.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:52:32.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:52:32.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:52:32.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:489: corrupt_and_measure: sleep 1 2026-02-23T07:52:33.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:52:33.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:52:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj182 obj335 obj1727 ' 2026-02-23T07:52:33.762 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj182 obj335 obj1727 2026-02-23T07:52:33.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:33.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:33.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj182 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:52:33.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj182 2026-02-23T07:52:33.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj182 rm-attr _ 2026-02-23T07:52:33.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:33.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:33.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:33.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:33.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:52:33.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:52:33.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:33.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj335 2026-02-23T07:52:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:33.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:52:33.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj335 2026-02-23T07:52:33.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj335 rm-attr _ 2026-02-23T07:52:34.062 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:49f89eae:::obj182:head#, (61) No data available 2026-02-23T07:52:34.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:34.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:34.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:34.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:34.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj1727 2026-02-23T07:52:34.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:34.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:52:34.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1727 2026-02-23T07:52:34.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj1727 rm-attr _ 2026-02-23T07:52:34.231 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:49f89eae:::obj182:head#, (61) No data available 2026-02-23T07:52:34.231 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 0 'obj1777 obj507 ' obj_to_pgid delete_oi 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=0 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj1777 obj507 ' 2026-02-23T07:52:34.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:52:34.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:52:34.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:52:34.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj1777 obj507 ]] 2026-02-23T07:52:34.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:52:34.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.0: obj1777 obj507 ' 2026-02-23T07:52:34.288 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.0: obj1777 obj507 2026-02-23T07:52:34.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:34.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:34.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj1777 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1777 2026-02-23T07:52:34.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj1777 rm-attr _ 2026-02-23T07:52:34.408 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:40f8cc26:::obj1727:head#, (61) No data available 2026-02-23T07:52:34.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:49f89eae:::obj182:head#, (61) No data available 2026-02-23T07:52:34.409 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:34.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 0 obj507 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=0 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj507 2026-02-23T07:52:34.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/0 obj507 rm-attr _ 2026-02-23T07:52:34.571 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:534f8104:::obj1777:head#, (61) No data available 2026-02-23T07:52:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:40f8cc26:::obj1727:head#, (61) No data available 2026-02-23T07:52:34.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:49f89eae:::obj182:head#, (61) No data available 2026-02-23T07:52:34.576 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.2_head,#1:4b57ab44:::obj335:head#, (61) No data available 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj874 obj706 obj1026 obj1898 obj1304 obj1083 obj181 obj1560 obj1510 obj1578 obj328 obj1678 obj139 obj322 obj95 obj1899 obj62 obj1134 obj605 obj754 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj874 obj706 obj1026 obj1898 obj1304 obj1083 obj181 obj1560 obj1510 obj1578 obj328 obj1678 obj139 obj322 obj95 obj1899 obj62 obj1134 obj605 obj754 ' 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.8 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.8 ]] 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj874 2026-02-23T07:52:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj874 2026-02-23T07:52:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj874 rm-attr _ 2026-02-23T07:52:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:34.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:34.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:34.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:34.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj706 2026-02-23T07:52:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj706 2026-02-23T07:52:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj706 rm-attr _ 2026-02-23T07:52:34.941 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:35.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:35.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:35.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-23T07:52:35.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-23T07:52:35.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:35.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1026 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1026 2026-02-23T07:52:35.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1026 rm-attr _ 2026-02-23T07:52:35.110 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.111 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:35.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:35.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:35.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:35.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.b 2026-02-23T07:52:35.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.b ]] 2026-02-23T07:52:35.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:35.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1898 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1898 2026-02-23T07:52:35.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1898 rm-attr _ 2026-02-23T07:52:35.275 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:35.276 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.277 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:52:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:52:35.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:35.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1304 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1304 2026-02-23T07:52:35.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1304 rm-attr _ 2026-02-23T07:52:35.465 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:35.466 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:35.467 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.469 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:35.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:35.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:35.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:35.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:52:35.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:52:35.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:35.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1083 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:35.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1083 2026-02-23T07:52:35.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1083 rm-attr _ 2026-02-23T07:52:35.649 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:35.650 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:35.650 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.652 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:35.653 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:52:35.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:35.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj181 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj181 2026-02-23T07:52:35.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj181 rm-attr _ 2026-02-23T07:52:35.815 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:35.817 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:35.817 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.818 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:35.820 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:35.820 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:35.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1560 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1560 2026-02-23T07:52:35.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1560 rm-attr _ 2026-02-23T07:52:35.984 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:35.985 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:35.986 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:35.987 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:35.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:35.989 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:35.990 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:36.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:36.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:36.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:36.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.9 2026-02-23T07:52:36.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.9 ]] 2026-02-23T07:52:36.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:36.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:36.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:36.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:36.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1510 2026-02-23T07:52:36.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:36.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:36.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1510 2026-02-23T07:52:36.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1510 rm-attr _ 2026-02-23T07:52:36.167 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:36.169 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:36.169 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:36.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:36.171 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:36.172 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:36.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:36.173 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:36.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.7 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.7 ]] 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:36.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:36.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:36.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1578 2026-02-23T07:52:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1578 2026-02-23T07:52:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1578 rm-attr _ 2026-02-23T07:52:36.335 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:36.336 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:36.336 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:36.336 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:36.338 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:36.338 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:36.339 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:36.340 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:36.340 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.8 2026-02-23T07:52:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.8 ]] 2026-02-23T07:52:36.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:36.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj328 2026-02-23T07:52:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj328 2026-02-23T07:52:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj328 rm-attr _ 2026-02-23T07:52:36.514 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:36.514 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:36.515 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:36.516 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:36.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:36.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:36.518 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:36.519 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:36.520 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:36.520 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:36.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:36.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1678 2026-02-23T07:52:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1678 2026-02-23T07:52:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1678 rm-attr _ 2026-02-23T07:52:36.675 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:36.676 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:36.676 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:36.677 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:36.677 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:36.678 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:36.678 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:36.678 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:36.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:36.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:36.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:36.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:36.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:36.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj139 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj139 2026-02-23T07:52:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj139 rm-attr _ 2026-02-23T07:52:36.869 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:36.870 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:36.871 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:36.871 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:36.871 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:36.871 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:36.873 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:36.873 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:36.873 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:36.874 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:36.874 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:36.874 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.e 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.e ]] 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:36.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:36.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:36.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:36.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:36.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj322 2026-02-23T07:52:36.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:36.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:36.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj322 2026-02-23T07:52:36.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj322 rm-attr _ 2026-02-23T07:52:37.028 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:37.031 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:37.032 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:37.034 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:37.034 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:37.034 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:37.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:37.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:37.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:37.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:52:37.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:52:37.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:37.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:37.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:37.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:37.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj95 2026-02-23T07:52:37.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:37.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:37.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj95 2026-02-23T07:52:37.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj95 rm-attr _ 2026-02-23T07:52:37.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:37.205 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:37.208 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:37.208 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:37.208 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:37.208 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:37.208 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:37.208 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.9 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.9 ]] 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:37.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:37.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:37.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:37.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1899 2026-02-23T07:52:37.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:37.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:37.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1899 2026-02-23T07:52:37.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1899 rm-attr _ 2026-02-23T07:52:37.379 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:37.382 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:37.384 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:52:37.384 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:37.384 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:37.384 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:37.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:37.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:37.386 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:37.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:37.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:37.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:37.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.0 2026-02-23T07:52:37.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.0 ]] 2026-02-23T07:52:37.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:37.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:37.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:37.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:37.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj62 2026-02-23T07:52:37.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:37.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:37.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj62 2026-02-23T07:52:37.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj62 rm-attr _ 2026-02-23T07:52:37.575 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:37.582 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:99742596:::obj1899:head#, (61) No data available 2026-02-23T07:52:37.582 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:37.582 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:37.582 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:37.583 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:37.584 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:37.584 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:37.584 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.b 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.b ]] 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:37.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:37.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1134 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1134 2026-02-23T07:52:37.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1134 rm-attr _ 2026-02-23T07:52:37.751 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:99742596:::obj1899:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:37.755 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:37.756 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:37.757 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:37.757 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:52:37.757 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:37.757 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:37.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:37.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:37.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:37.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.b 2026-02-23T07:52:37.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.b ]] 2026-02-23T07:52:37.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:37.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:37.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:37.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:37.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:37.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj605 2026-02-23T07:52:37.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:37.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:37.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj605 2026-02-23T07:52:37.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj605 rm-attr _ 2026-02-23T07:52:37.976 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:37.976 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:dcf6733a:::obj1134:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:99742596:::obj1899:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:37.977 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:37.978 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:37.978 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:52:37.978 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:37.978 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.a 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.a ]] 2026-02-23T07:52:38.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:38.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj754 2026-02-23T07:52:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj754 2026-02-23T07:52:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj754 rm-attr _ 2026-02-23T07:52:38.130 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:38.130 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6f359b4:::obj605:head#, (61) No data available 2026-02-23T07:52:38.130 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:dcf6733a:::obj1134:head#, (61) No data available 2026-02-23T07:52:38.131 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:99742596:::obj1899:head#, (61) No data available 2026-02-23T07:52:38.131 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:38.131 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:38.131 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:38.131 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:38.131 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:38.132 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:38.132 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:38.133 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:52:38.133 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:38.133 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:38.133 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:38.135 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:38.135 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:52:38.135 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:38.135 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:38.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 1 'obj1319 ' obj_to_pgid delete_oi 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=1 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj1319 ' 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:52:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:52:38.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj1319 ]] 2026-02-23T07:52:38.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:52:38.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.1: obj1319 ' 2026-02-23T07:52:38.188 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.1: obj1319 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.2 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.2 ]] 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:38.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 1 obj1319 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=1 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1319 2026-02-23T07:52:38.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/1 obj1319 rm-attr _ 2026-02-23T07:52:38.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6a275bb:::obj1898:head#, (61) No data available 2026-02-23T07:52:38.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:d6f359b4:::obj605:head#, (61) No data available 2026-02-23T07:52:38.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.b_head,#1:dcf6733a:::obj1134:head#, (61) No data available 2026-02-23T07:52:38.288 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:99742596:::obj1899:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.9_head,#1:9f48f0e8:::obj1510:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:545db4bf:::obj139:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5baded79:::obj754:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5bdd154b:::obj1678:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.a_head,#1:5dbb2a56:::obj1026:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1a783fd9:::obj328:head#, (61) No data available 2026-02-23T07:52:38.289 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1d26163c:::obj874:head#, (61) No data available 2026-02-23T07:52:38.290 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:7c955dfc:::obj322:head#, (61) No data available 2026-02-23T07:52:38.291 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cbce4a0b:::obj95:head#, (61) No data available 2026-02-23T07:52:38.291 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cddfc35c:::obj1560:head#, (61) No data available 2026-02-23T07:52:38.291 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e37e8bbd:::obj1578:head#, (61) No data available 2026-02-23T07:52:38.291 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.7_head,#1:e42ceef3:::obj706:head#, (61) No data available 2026-02-23T07:52:38.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:07c44a4d:::obj181:head#, (61) No data available 2026-02-23T07:52:38.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08a5234b:::obj62:head#, (61) No data available 2026-02-23T07:52:38.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:08f6bf90:::obj1304:head#, (61) No data available 2026-02-23T07:52:38.293 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:0bd441f7:::obj1083:head#, (61) No data available 2026-02-23T07:52:38.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:38.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:38.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:38.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:52:38.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:52:38.348 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj972 obj1385 obj1679 obj808 obj194 obj661 obj1097 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj972 obj1385 obj1679 obj808 obj194 obj661 obj1097 ' 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj972 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:38.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj972 2026-02-23T07:52:38.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj972 rm-attr _ 2026-02-23T07:52:38.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:38.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:38.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:38.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-23T07:52:38.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-23T07:52:38.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:38.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:38.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:38.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:38.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1385 2026-02-23T07:52:38.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:38.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1385 2026-02-23T07:52:38.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1385 rm-attr _ 2026-02-23T07:52:38.647 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:38.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:38.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:38.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-23T07:52:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-23T07:52:38.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:38.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:38.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:38.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:38.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1679 2026-02-23T07:52:38.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:38.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1679 2026-02-23T07:52:38.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1679 rm-attr _ 2026-02-23T07:52:38.819 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:38.819 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:38.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:38.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:38.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:38.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-23T07:52:38.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-23T07:52:38.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:38.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj808 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj808 2026-02-23T07:52:38.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj808 rm-attr _ 2026-02-23T07:52:38.959 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:38.959 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:38.959 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:39.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj194 2026-02-23T07:52:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:39.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj194 2026-02-23T07:52:39.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj194 rm-attr _ 2026-02-23T07:52:39.135 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:39.136 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:39.136 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:39.136 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:39.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj661 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj661 2026-02-23T07:52:39.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj661 rm-attr _ 2026-02-23T07:52:39.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:39.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:39.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:39.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:39.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.5 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.5 ]] 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:39.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:39.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:39.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:39.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1097 2026-02-23T07:52:39.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:39.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1097 2026-02-23T07:52:39.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1097 rm-attr _ 2026-02-23T07:52:39.504 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:39.504 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:39.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:39.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:39.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:39.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 2 'obj989 obj428 obj967 obj623 obj2018 obj1095 ' obj_to_pgid delete_oi 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=2 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj989 obj428 obj967 obj623 obj2018 obj1095 ' 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj989 obj428 obj967 obj623 obj2018 obj1095 ]] 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:52:39.567 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.2: obj989 obj428 obj967 obj623 obj2018 obj1095 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.2: obj989 obj428 obj967 obj623 obj2018 obj1095 ' 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.8 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.8 ]] 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:39.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj989 2026-02-23T07:52:39.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:39.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj989 2026-02-23T07:52:39.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj989 rm-attr _ 2026-02-23T07:52:39.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:39.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:39.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:39.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:39.680 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:39.681 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:39.681 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ac6bc9d8:::obj1097:head#, (61) No data available 2026-02-23T07:52:39.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:39.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:39.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:39.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.e 2026-02-23T07:52:39.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.e ]] 2026-02-23T07:52:39.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:39.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj428 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj428 2026-02-23T07:52:39.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj428 rm-attr _ 2026-02-23T07:52:39.860 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:134f672b:::obj989:head#, (61) No data available 2026-02-23T07:52:39.861 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:39.861 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:39.861 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:39.861 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:39.861 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:39.862 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:39.862 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ac6bc9d8:::obj1097:head#, (61) No data available 2026-02-23T07:52:39.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:39.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:39.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:39.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.8 2026-02-23T07:52:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.8 ]] 2026-02-23T07:52:39.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:39.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj967 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj967 2026-02-23T07:52:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj967 rm-attr _ 2026-02-23T07:52:40.037 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:134f672b:::obj989:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:40.038 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ac6bc9d8:::obj1097:head#, (61) No data available 2026-02-23T07:52:40.039 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:748dbcc6:::obj428:head#, (61) No data available 2026-02-23T07:52:40.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:40.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:40.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:40.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.3 2026-02-23T07:52:40.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.3 ]] 2026-02-23T07:52:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj623 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj623 2026-02-23T07:52:40.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj623 rm-attr _ 2026-02-23T07:52:40.201 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:134f672b:::obj989:head#, (61) No data available 2026-02-23T07:52:40.201 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1619bd9a:::obj967:head#, (61) No data available 2026-02-23T07:52:40.201 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:40.201 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:40.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:40.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:40.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:40.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:40.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ac6bc9d8:::obj1097:head#, (61) No data available 2026-02-23T07:52:40.202 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:748dbcc6:::obj428:head#, (61) No data available 2026-02-23T07:52:40.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:40.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:40.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:40.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:40.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj2018 2026-02-23T07:52:40.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:40.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:40.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj2018 2026-02-23T07:52:40.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj2018 rm-attr _ 2026-02-23T07:52:40.395 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:134f672b:::obj989:head#, (61) No data available 2026-02-23T07:52:40.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1619bd9a:::obj967:head#, (61) No data available 2026-02-23T07:52:40.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:40.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:40.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:40.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:40.396 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:40.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:40.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ac6bc9d8:::obj1097:head#, (61) No data available 2026-02-23T07:52:40.397 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:748dbcc6:::obj428:head#, (61) No data available 2026-02-23T07:52:40.398 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cad24dee:::obj623:head#, (61) No data available 2026-02-23T07:52:40.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:40.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:40.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:40.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.9 2026-02-23T07:52:40.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.9 ]] 2026-02-23T07:52:40.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:40.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:40.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:40.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:40.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 2 obj1095 2026-02-23T07:52:40.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:40.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=2 2026-02-23T07:52:40.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1095 2026-02-23T07:52:40.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/2 obj1095 rm-attr _ 2026-02-23T07:52:40.564 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:134f672b:::obj989:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.8_head,#1:1619bd9a:::obj967:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b90abd95:::obj808:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:b9ca1b04:::obj1385:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:ba6fc5a4:::obj661:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf41f007:::obj972:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.d_head,#1:bf769020:::obj1679:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:a87532ae:::obj194:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.5_head,#1:ac6bc9d8:::obj1097:head#, (61) No data available 2026-02-23T07:52:40.565 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.e_head,#1:748dbcc6:::obj428:head#, (61) No data available 2026-02-23T07:52:40.566 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#1:cad24dee:::obj623:head#, (61) No data available 2026-02-23T07:52:40.566 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8d45e24e:::obj2018:head#, (61) No data available 2026-02-23T07:52:40.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:40.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:40.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:40.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:52:40.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd= 1 )) 2026-02-23T07:52:40.620 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.3: obj343 obj376 obj191 obj1272 obj393 obj1119 obj161 obj286 obj1389 obj709 2026-02-23T07:52:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.3: obj343 obj376 obj191 obj1272 obj393 obj1119 obj161 obj286 obj1389 obj709 ' 2026-02-23T07:52:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-23T07:52:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-23T07:52:40.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:40.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:40.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:40.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:40.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj343 2026-02-23T07:52:40.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:40.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:40.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj343 2026-02-23T07:52:40.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj343 rm-attr _ 2026-02-23T07:52:40.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:40.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj376 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj376 2026-02-23T07:52:40.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj376 rm-attr _ 2026-02-23T07:52:40.915 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:40.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:40.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:40.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:40.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-23T07:52:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-23T07:52:40.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:40.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj191 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj191 2026-02-23T07:52:40.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj191 rm-attr _ 2026-02-23T07:52:41.082 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:41.082 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:41.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:41.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:41.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:41.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.f 2026-02-23T07:52:41.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.f ]] 2026-02-23T07:52:41.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:41.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:41.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:41.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:41.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1272 2026-02-23T07:52:41.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:41.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:41.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1272 2026-02-23T07:52:41.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1272 rm-attr _ 2026-02-23T07:52:41.266 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:41.267 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:41.269 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:41.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:41.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:41.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:41.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:52:41.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:52:41.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:41.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj393 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj393 2026-02-23T07:52:41.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj393 rm-attr _ 2026-02-23T07:52:41.444 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:41.444 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:41.447 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:41.447 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.1 2026-02-23T07:52:41.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.1 ]] 2026-02-23T07:52:41.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:41.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:41.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:41.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:41.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1119 2026-02-23T07:52:41.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:41.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:41.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1119 2026-02-23T07:52:41.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1119 rm-attr _ 2026-02-23T07:52:41.619 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:41.620 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:41.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:41.622 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:41.623 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8a5b4a06:::obj393:head#, (61) No data available 2026-02-23T07:52:41.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:41.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:41.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:41.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:41.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj161 2026-02-23T07:52:41.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:41.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:41.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj161 2026-02-23T07:52:41.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj161 rm-attr _ 2026-02-23T07:52:41.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:41.790 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:41.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:41.792 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:41.794 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:85182763:::obj1119:head#, (61) No data available 2026-02-23T07:52:41.794 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8a5b4a06:::obj393:head#, (61) No data available 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.6 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.6 ]] 2026-02-23T07:52:41.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:41.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj286 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj286 2026-02-23T07:52:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj286 rm-attr _ 2026-02-23T07:52:41.971 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:41.971 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:41.974 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:41.974 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:41.975 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2222704f:::obj161:head#, (61) No data available 2026-02-23T07:52:41.976 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:85182763:::obj1119:head#, (61) No data available 2026-02-23T07:52:41.976 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8a5b4a06:::obj393:head#, (61) No data available 2026-02-23T07:52:42.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:42.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:42.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:42.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:42.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.4 2026-02-23T07:52:42.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.4 ]] 2026-02-23T07:52:42.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj1389 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:42.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj1389 2026-02-23T07:52:42.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj1389 rm-attr _ 2026-02-23T07:52:42.141 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:42.141 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:42.142 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:52:42.144 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:42.144 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:42.144 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2222704f:::obj161:head#, (61) No data available 2026-02-23T07:52:42.145 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:85182763:::obj1119:head#, (61) No data available 2026-02-23T07:52:42.145 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8a5b4a06:::obj393:head#, (61) No data available 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.c 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.c ]] 2026-02-23T07:52:42.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:42.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj709 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj709 2026-02-23T07:52:42.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj709 rm-attr _ 2026-02-23T07:52:42.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:42.324 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:42.325 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:52:42.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:42.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:42.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2222704f:::obj161:head#, (61) No data available 2026-02-23T07:52:42.327 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2d562932:::obj1389:head#, (61) No data available 2026-02-23T07:52:42.328 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:85182763:::obj1119:head#, (61) No data available 2026-02-23T07:52:42.328 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8a5b4a06:::obj393:head#, (61) No data available 2026-02-23T07:52:42.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:42.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:42.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:42.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:493: corrupt_and_measure: modify_obs_of_an_osd td/osd-scrub-dump 3 'obj359 ' obj_to_pgid delete_oi 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:141: modify_obs_of_an_osd: local dir=td/osd-scrub-dump 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:142: modify_obs_of_an_osd: local target_osd=3 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:144: modify_obs_of_an_osd: local 'objects_to_modify=obj359 ' 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:145: modify_obs_of_an_osd: local -n o_to_pg=obj_to_pgid 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:146: modify_obs_of_an_osd: local manips=delete_oi 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:147: modify_obs_of_an_osd: local extr_dbg=1 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:150: modify_obs_of_an_osd: [[ -z obj359 ]] 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: (( extr_dbg >= 1 )) 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:155: modify_obs_of_an_osd: echo 'Objects to modify on osd.3: obj359 ' 2026-02-23T07:52:42.383 INFO:tasks.workunit.client.0.trial129.stdout:Objects to modify on osd.3: obj359 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:158: modify_obs_of_an_osd: local cur_fn_index=0 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:159: modify_obs_of_an_osd: for obj in $objects_to_modify 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:160: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:162: modify_obs_of_an_osd: local pgid=1.d 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:163: modify_obs_of_an_osd: [[ -z 1.d ]] 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: echo delete_oi 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: cut '-d ' -f1 2026-02-23T07:52:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:168: modify_obs_of_an_osd: local manipulator=delete_oi 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:169: modify_obs_of_an_osd: (( extr_dbg >= 2 )) 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:170: modify_obs_of_an_osd: declare -f delete_oi 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:171: modify_obs_of_an_osd: delete_oi td/osd-scrub-dump 3 obj359 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:115: delete_oi: local dir=td/osd-scrub-dump 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:116: delete_oi: local target_osd=3 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:117: delete_oi: local obj=obj359 2026-02-23T07:52:42.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:118: delete_oi: ceph-objectstore-tool --data-path td/osd-scrub-dump/3 obj359 rm-attr _ 2026-02-23T07:52:42.504 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:38801388:::obj709:head#, (61) No data available 2026-02-23T07:52:42.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3bc05e5f:::obj343:head#, (61) No data available 2026-02-23T07:52:42.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.c_head,#1:3ed3e33d:::obj376:head#, (61) No data available 2026-02-23T07:52:42.505 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.6_head,#1:640d3668:::obj286:head#, (61) No data available 2026-02-23T07:52:42.507 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fcc34b3b:::obj191:head#, (61) No data available 2026-02-23T07:52:42.507 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.f_head,#1:fd75d110:::obj1272:head#, (61) No data available 2026-02-23T07:52:42.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2222704f:::obj161:head#, (61) No data available 2026-02-23T07:52:42.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.4_head,#1:2d562932:::obj1389:head#, (61) No data available 2026-02-23T07:52:42.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:85182763:::obj1119:head#, (61) No data available 2026-02-23T07:52:42.508 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.1_head,#1:8a5b4a06:::obj393:head#, (61) No data available 2026-02-23T07:52:42.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:119: delete_oi: return 0 2026-02-23T07:52:42.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:173: modify_obs_of_an_osd: (( cur_fn_index++ )) 2026-02-23T07:52:42.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:175: modify_obs_of_an_osd: return 0 2026-02-23T07:52:42.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd++ )) 2026-02-23T07:52:42.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:490: corrupt_and_measure: (( osd 0 )) 2026-02-23T07:52:55.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:519: corrupt_and_measure: sleep 5 2026-02-23T07:53:00.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:520: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:53:00.406 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:53:00.406 INFO:tasks.workunit.client.0.trial129.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:52:47.931771+0000 24'122 40:153 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.406 INFO:tasks.workunit.client.0.trial129.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-23T07:52:47.930756+0000 24'131 40:180 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.406 INFO:tasks.workunit.client.0.trial129.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-23T07:52:47.931474+0000 24'128 40:172 [2,1,3] 2 [2,1,3] 2 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.406 INFO:tasks.workunit.client.0.trial129.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:52:46.442489+0000 24'133 40:190 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.406 INFO:tasks.workunit.client.0.trial129.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:52:47.931496+0000 24'133 40:170 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-23T07:52:47.931184+0000 24'136 40:168 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-23T07:52:47.930334+0000 24'126 40:198 [0,1,3] 0 [0,1,3] 0 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:52:46.442363+0000 24'119 40:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:52:47.931233+0000 24'127 40:161 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:52:47.931249+0000 24'127 40:175 [2,3,0] 2 [2,3,0] 2 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-23T07:52:47.931274+0000 24'134 40:167 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:52:47.931104+0000 24'129 40:177 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-23T07:52:47.930115+0000 24'113 40:164 [1,2,3] 1 [1,2,3] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-23T07:52:47.930821+0000 24'121 40:172 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-23T07:52:46.442281+0000 24'132 40:179 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.407 INFO:tasks.workunit.client.0.trial129.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:52:46.442721+0000 24'137 40:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:00.408 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:53:00.408 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:53:00.408 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:53:00.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:00.417 INFO:tasks.workunit.client.0.trial129.stdout:Getting actual osd_deep_scrub_stride: 2026-02-23T07:53:00.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: echo 'Getting actual osd_deep_scrub_stride: ' 2026-02-23T07:53:00.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: ceph tell osd.0 config show 2026-02-23T07:53:00.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:522: corrupt_and_measure: jq -r .osd_deep_scrub_stride 2026-02-23T07:53:00.490 INFO:tasks.workunit.client.0.trial129.stdout:4194304 2026-02-23T07:53:00.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:525: corrupt_and_measure: ceph tell 'osd.*' config set osd_scrub_auto_repair false 2026-02-23T07:53:00.555 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:53:00.555 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:53:00.555 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:00.562 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:53:00.562 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:53:00.562 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:00.569 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:53:00.569 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:53:00.569 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:00.576 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T07:53:00.576 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:53:00.576 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:00.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:526: corrupt_and_measure: sleep 1 2026-02-23T07:53:01.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: date +%s%N 2026-02-23T07:53:01.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:529: corrupt_and_measure: local start_stdict=1771833181587081203 2026-02-23T07:53:01.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: date +%T.%N 2026-02-23T07:53:01.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:530: corrupt_and_measure: echo 'Pre standard dict creation: 07:53:01.588948202' 2026-02-23T07:53:01.589 INFO:tasks.workunit.client.0.trial129.stdout:Pre standard dict creation: 07:53:01.588948202 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:531: corrupt_and_measure: declare -A pg_pr 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:532: corrupt_and_measure: declare -A pg_ac 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:533: corrupt_and_measure: declare -A pg_po 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:534: corrupt_and_measure: build_pg_dicts td/osd-scrub-dump pg_pr pg_ac pg_po - 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-dump 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T07:53:01.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T07:53:01.743 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T07:53:01.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: date +%s%N 2026-02-23T07:53:01.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:535: corrupt_and_measure: local end_stdict=1771833181758269725 2026-02-23T07:53:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: date +%T.%N 2026-02-23T07:53:01.759 INFO:tasks.workunit.client.0.trial129.stdout:Post standard dict creation: 07:53:01.759362173 (171 ms) 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:536: corrupt_and_measure: echo 'Post standard dict creation: 07:53:01.759362173 (171 ms)' 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:537: corrupt_and_measure: echo 'PGs table:' 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stdout:PGs table: 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.8: 1 ( 1 2 3 ) 1 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.8: 1 ( 1 2 3 ) 1' 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.9: 1 ( 1 3 2 ) 1 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.9: 1 ( 1 3 2 ) 1' 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.4: 3 ( 3 0 1 ) 1 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.4: 3 ( 3 0 1 ) 1' 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.761 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.5: 2 ( 2 3 0 ) 1 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.5: 2 ( 2 3 0 ) 1' 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.6: 3 ( 3 0 2 ) 1 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.6: 3 ( 3 0 2 ) 1' 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.7: 1 ( 1 3 0 ) 1 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.7: 1 ( 1 3 0 ) 1' 2026-02-23T07:53:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.0: 1 ( 1 0 2 ) 1 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.0: 1 ( 1 0 2 ) 1' 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.1: 3 ( 3 0 2 ) 1 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.1: 3 ( 3 0 2 ) 1' 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.763 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.2: 0 ( 0 1 3 ) 1 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.2: 0 ( 0 1 3 ) 1' 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.3: 1 ( 1 2 0 ) 1 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.3: 1 ( 1 2 0 ) 1' 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.d: 2 ( 2 1 3 ) 1 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.d: 2 ( 2 1 3 ) 1' 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.e: 1 ( 1 3 2 ) 1 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.e: 1 ( 1 3 2 ) 1' 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.f: 3 ( 3 0 2 ) 1 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.f: 3 ( 3 0 2 ) 1' 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.a: 1 ( 1 2 0 ) 1' 2026-02-23T07:53:01.765 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.a: 1 ( 1 2 0 ) 1 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.b: 1 ( 1 0 2 ) 1 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.b: 1 ( 1 0 2 ) 1' 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:538: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: (( extr_dbg >= 2 )) 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stdout:Got: 1.c: 3 ( 3 0 1 ) 1 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:540: corrupt_and_measure: echo 'Got: 1.c: 3 ( 3 0 1 ) 1' 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:543: corrupt_and_measure: local -A saved_last_stamp 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:544: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:53:01.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:53:01.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:53:01.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:545: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:53:02.086 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:52:47.931771+0000 24'122 40:153 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-23T07:52:47.930756+0000 24'131 40:181 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-23T07:52:47.931474+0000 24'128 40:173 [2,1,3] 2 [2,1,3] 2 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:52:46.442489+0000 24'133 40:191 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:52:47.931496+0000 24'133 40:170 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-23T07:52:47.931184+0000 24'136 40:168 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-23T07:52:47.930334+0000 24'126 40:199 [0,1,3] 0 [0,1,3] 0 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:52:46.442363+0000 24'119 40:170 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:52:47.931233+0000 24'127 40:162 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:52:47.931249+0000 24'127 40:176 [2,3,0] 2 [2,3,0] 2 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-23T07:52:47.931274+0000 24'134 40:167 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:52:47.931104+0000 24'129 40:177 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-23T07:52:47.930115+0000 24'113 40:164 [1,2,3] 1 [1,2,3] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-23T07:52:47.930821+0000 24'121 40:172 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-23T07:52:46.442281+0000 24'132 40:179 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:52:46.442721+0000 24'137 40:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:53:02.087 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:53:02.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:547: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:53:02.161 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:53:02.162 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:02.162 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.168 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:53:02.169 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:02.169 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.176 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:53:02.176 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:02.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.183 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T07:53:02.183 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:02.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: date +%s%N 2026-02-23T07:53:02.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:548: corrupt_and_measure: local start_time=1771833182192056544 2026-02-23T07:53:02.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.8' 2026-02-23T07:53:02.193 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.8 2026-02-23T07:53:02.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.8 deep-scrub 2026-02-23T07:53:02.258 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.258 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.258 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.258 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.258 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.9' 2026-02-23T07:53:02.268 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.9 2026-02-23T07:53:02.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.9 deep-scrub 2026-02-23T07:53:02.332 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.332 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.332 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.332 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.343 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.4 2026-02-23T07:53:02.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.4' 2026-02-23T07:53:02.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.4 deep-scrub 2026-02-23T07:53:02.408 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.408 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.408 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.408 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.408 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.415 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.5 2026-02-23T07:53:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.5' 2026-02-23T07:53:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.5 deep-scrub 2026-02-23T07:53:02.479 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.479 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.479 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.479 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.479 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.6' 2026-02-23T07:53:02.491 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.6 2026-02-23T07:53:02.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.6 deep-scrub 2026-02-23T07:53:02.554 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.554 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.555 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.555 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.555 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.7' 2026-02-23T07:53:02.562 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.7 2026-02-23T07:53:02.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.7 deep-scrub 2026-02-23T07:53:02.625 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.625 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.625 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.625 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.625 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.0' 2026-02-23T07:53:02.633 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.0 2026-02-23T07:53:02.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.0 deep-scrub 2026-02-23T07:53:02.697 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.697 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.697 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.697 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.697 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.1' 2026-02-23T07:53:02.708 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.1 2026-02-23T07:53:02.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.1 deep-scrub 2026-02-23T07:53:02.773 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.773 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.773 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.774 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.781 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.2 2026-02-23T07:53:02.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.2' 2026-02-23T07:53:02.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.2 deep-scrub 2026-02-23T07:53:02.846 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.846 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.846 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.847 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.847 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.3' 2026-02-23T07:53:02.855 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.3 2026-02-23T07:53:02.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.3 deep-scrub 2026-02-23T07:53:02.918 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.918 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.918 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.918 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.918 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.d' 2026-02-23T07:53:02.928 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.d 2026-02-23T07:53:02.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.d deep-scrub 2026-02-23T07:53:02.991 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:02.991 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:02.991 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:02.991 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:02.991 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:02.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:02.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:02.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.e' 2026-02-23T07:53:02.999 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.e 2026-02-23T07:53:02.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.e deep-scrub 2026-02-23T07:53:03.062 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:03.062 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:03.062 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:03.062 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:03.062 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:03.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:03.069 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.f 2026-02-23T07:53:03.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.f' 2026-02-23T07:53:03.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.f deep-scrub 2026-02-23T07:53:03.133 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:03.133 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:03.133 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:03.133 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:03.133 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:03.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:03.141 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.a 2026-02-23T07:53:03.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.a' 2026-02-23T07:53:03.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.a deep-scrub 2026-02-23T07:53:03.205 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:03.205 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:03.205 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:03.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:03.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.b' 2026-02-23T07:53:03.214 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.b 2026-02-23T07:53:03.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.b deep-scrub 2026-02-23T07:53:03.279 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:03.279 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:03.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:549: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: (( extr_dbg >= 1 )) 2026-02-23T07:53:03.287 INFO:tasks.workunit.client.0.trial129.stdout:deep-scrub 1.c 2026-02-23T07:53:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:550: corrupt_and_measure: echo 'deep-scrub 1.c' 2026-02-23T07:53:03.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:551: corrupt_and_measure: ceph pg 1.c deep-scrub 2026-02-23T07:53:03.351 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:53:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:03.352 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:555: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:53:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:53:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:53:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:53:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:53:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:53:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:53:03.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:53:03.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: date +%s%N 2026-02-23T07:53:03.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:557: corrupt_and_measure: local end_time=1771833183523533621 2026-02-23T07:53:03.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:558: corrupt_and_measure: local duration=1331 2026-02-23T07:53:03.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:559: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:53:03.588 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:53:03.588 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:03.588 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.596 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:53:03.596 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:03.596 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.603 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:53:03.603 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:03.603 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.610 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T07:53:03.610 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:03.610 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:03.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:561: corrupt_and_measure: sleep 2 2026-02-23T07:53:05.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:562: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:53:05.777 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:53:05.777 INFO:tasks.workunit.client.0.trial129.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:52:47.931771+0000 24'122 40:154 [3,0,2] 3 [3,0,2] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:53:05.777 INFO:tasks.workunit.client.0.trial129.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-23T07:52:47.930756+0000 24'131 40:181 [1,3,2] 1 [1,3,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:05.777 INFO:tasks.workunit.client.0.trial129.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean+inconsistent 2026-02-23T07:53:04.215138+0000 24'128 40:206 [2,1,3] 2 [2,1,3] 2 24'128 2026-02-23T07:53:04.215101+0000 24'128 2026-02-23T07:53:04.215101+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:04.215101+0000 128 0 2026-02-23T07:53:05.777 INFO:tasks.workunit.client.0.trial129.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:52:46.442489+0000 24'133 40:193 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean+inconsistent 2026-02-23T07:53:04.690936+0000 24'133 40:206 [3,0,2] 3 [3,0,2] 3 24'133 2026-02-23T07:53:04.690906+0000 24'133 2026-02-23T07:53:04.690906+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:04.690906+0000 133 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-23T07:52:47.931184+0000 24'136 40:169 [3,0,1] 3 [3,0,1] 3 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean+inconsistent 2026-02-23T07:53:03.403763+0000 24'126 40:233 [0,1,3] 0 [0,1,3] 0 24'126 2026-02-23T07:53:03.403738+0000 24'126 2026-02-23T07:53:03.403738+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:03.403738+0000 126 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:52:46.442363+0000 24'119 40:171 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean+inconsistent 2026-02-23T07:53:02.733303+0000 24'127 40:196 [3,0,1] 3 [3,0,1] 3 24'127 2026-02-23T07:53:02.733277+0000 24'127 2026-02-23T07:53:02.733277+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:02.733277+0000 127 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean+inconsistent 2026-02-23T07:53:03.204335+0000 24'127 40:209 [2,3,0] 2 [2,3,0] 2 24'127 2026-02-23T07:53:03.204303+0000 24'127 2026-02-23T07:53:03.204303+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:03.204303+0000 127 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean+inconsistent 2026-02-23T07:53:03.692803+0000 24'134 40:202 [3,0,2] 3 [3,0,2] 3 24'134 2026-02-23T07:53:03.692765+0000 24'134 2026-02-23T07:53:03.692765+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:03.692765+0000 134 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:52:47.931104+0000 24'129 40:178 [1,3,0] 1 [1,3,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 queued for deep scrub 0 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean+inconsistent 2026-02-23T07:53:02.808632+0000 24'113 40:195 [1,2,3] 1 [1,2,3] 1 24'113 2026-02-23T07:53:02.808606+0000 24'113 2026-02-23T07:53:02.808606+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:02.808606+0000 113 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean+inconsistent 2026-02-23T07:53:03.851658+0000 24'121 40:204 [1,3,2] 1 [1,3,2] 1 24'121 2026-02-23T07:53:03.851630+0000 24'121 2026-02-23T07:53:03.851630+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:03.851630+0000 121 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean 2026-02-23T07:52:46.442281+0000 24'132 40:179 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean 2026-02-23T07:52:46.442721+0000 24'137 40:184 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-23T07:51:36.478526+0000 0'0 2026-02-23T07:51:36.478526+0000 0 0 periodic scrub scheduled @ 2026-02-24T07:51:36.478526+0000 0 0 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:53:05.778 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:53:05.779 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:53:05.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:563: corrupt_and_measure: printf 'MSR @%15s@ NAUT %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_3 4 16 128 40 10 256 4194304 0 1331 2026-02-23T07:53:05.788 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_3@ NAUT 4 16 128 40/ 10 256 4194304/ 0 1331 2026-02-23T07:53:05.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.789 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.8 2026-02-23T07:53:05.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.8' 2026-02-23T07:53:05.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.8 --format=json-pretty 2026-02-23T07:53:05.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.805 INFO:tasks.workunit.client.0.trial129.stdout:589 2026-02-23T07:53:05.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.9' 2026-02-23T07:53:05.805 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.9 2026-02-23T07:53:05.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.9 --format=json-pretty 2026-02-23T07:53:05.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.821 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:53:05.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.4' 2026-02-23T07:53:05.821 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.4 2026-02-23T07:53:05.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.4 --format=json-pretty 2026-02-23T07:53:05.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.5' 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.5 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.5 --format=json-pretty 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.853 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:53:05.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.853 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.6 2026-02-23T07:53:05.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.6' 2026-02-23T07:53:05.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.6 --format=json-pretty 2026-02-23T07:53:05.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.868 INFO:tasks.workunit.client.0.trial129.stdout:151 2026-02-23T07:53:05.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.7' 2026-02-23T07:53:05.869 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.7 2026-02-23T07:53:05.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.7 --format=json-pretty 2026-02-23T07:53:05.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.884 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:53:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.0' 2026-02-23T07:53:05.885 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.0 2026-02-23T07:53:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T07:53:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.900 INFO:tasks.workunit.client.0.trial129.stdout:735 2026-02-23T07:53:05.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.1' 2026-02-23T07:53:05.901 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.1 2026-02-23T07:53:05.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.1 --format=json-pretty 2026-02-23T07:53:05.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.916 INFO:tasks.workunit.client.0.trial129.stdout:443 2026-02-23T07:53:05.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.2' 2026-02-23T07:53:05.916 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.2 2026-02-23T07:53:05.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.2 --format=json-pretty 2026-02-23T07:53:05.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stdout:589 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.3' 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.3 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.3 --format=json-pretty 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.945 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.3 2026-02-23T07:53:05.945 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.d' 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.d 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.d --format=json-pretty 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.962 INFO:tasks.workunit.client.0.trial129.stdout:881 2026-02-23T07:53:05.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.e' 2026-02-23T07:53:05.963 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.e 2026-02-23T07:53:05.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.e --format=json-pretty 2026-02-23T07:53:05.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.977 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.e 2026-02-23T07:53:05.977 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:53:05.978 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:05.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.f' 2026-02-23T07:53:05.979 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.f 2026-02-23T07:53:05.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.f --format=json-pretty 2026-02-23T07:53:05.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:05.993 INFO:tasks.workunit.client.0.trial129.stdout:297 2026-02-23T07:53:05.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:05.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.a' 2026-02-23T07:53:05.995 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.a 2026-02-23T07:53:05.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.a --format=json-pretty 2026-02-23T07:53:05.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:05.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:06.007 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.a 2026-02-23T07:53:06.007 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:53:06.008 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:06.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:06.009 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.b 2026-02-23T07:53:06.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.b' 2026-02-23T07:53:06.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.b --format=json-pretty 2026-02-23T07:53:06.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:06.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:06.022 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.b 2026-02-23T07:53:06.022 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:53:06.023 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:06.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:566: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:06.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:567: corrupt_and_measure: echo 'list-inconsistent for PG 1.c' 2026-02-23T07:53:06.025 INFO:tasks.workunit.client.0.trial129.stdout:list-inconsistent for PG 1.c 2026-02-23T07:53:06.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: rados -p test list-inconsistent-obj 1.c --format=json-pretty 2026-02-23T07:53:06.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: jq . 2026-02-23T07:53:06.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:568: corrupt_and_measure: wc -l 2026-02-23T07:53:06.038 INFO:tasks.workunit.client.0.trial129.stderr:No scrub information available for pg 1.c 2026-02-23T07:53:06.038 INFO:tasks.workunit.client.0.trial129.stderr:error 2: (2) No such file or directory 2026-02-23T07:53:06.039 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:06.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd=0 )) 2026-02-23T07:53:06.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:570: corrupt_and_measure: (( osd= 3 )) 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:583: corrupt_and_measure: (( extr_dbg >= 3 )) 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:586: corrupt_and_measure: collect_pool_stamps td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:48: collect_pool_stamps: local dir=td/osd-scrub-dump 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:49: collect_pool_stamps: local poolid=1 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:50: collect_pool_stamps: local -n out_dict=saved_last_stamp 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:51: collect_pool_stamps: local saved_echo_flag=x 2026-02-23T07:53:11.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:52: collect_pool_stamps: set +x 2026-02-23T07:53:11.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:62: collect_pool_stamps: return 0 2026-02-23T07:53:11.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:587: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 10/10 2026-02-23T07:53:11.933 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:53:11.933 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:11.933 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:11.940 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:53:11.940 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:11.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:11.946 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:53:11.947 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:11.947 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:11.953 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T07:53:11.953 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:11.953 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:11.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: date +%s%N 2026-02-23T07:53:11.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:588: corrupt_and_measure: start_time=1771833191964036063 2026-02-23T07:53:11.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:11.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.8 2026-02-23T07:53:12.122 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.8 on osd.1 to repair 2026-02-23T07:53:12.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:12.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.9 2026-02-23T07:53:12.283 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.9 on osd.1 to repair 2026-02-23T07:53:12.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:12.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.4 2026-02-23T07:53:12.445 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.4 on osd.3 to repair 2026-02-23T07:53:12.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:12.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.5 2026-02-23T07:53:12.608 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.5 on osd.2 to repair 2026-02-23T07:53:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.6 2026-02-23T07:53:12.772 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.6 on osd.3 to repair 2026-02-23T07:53:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.7 2026-02-23T07:53:12.941 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.7 on osd.1 to repair 2026-02-23T07:53:12.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:12.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.0 2026-02-23T07:53:13.105 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:53:13.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:13.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.1 2026-02-23T07:53:13.268 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.1 on osd.3 to repair 2026-02-23T07:53:13.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:13.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.2 2026-02-23T07:53:13.430 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.2 on osd.0 to repair 2026-02-23T07:53:13.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:13.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.3 2026-02-23T07:53:13.594 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:53:13.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:13.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.d 2026-02-23T07:53:13.761 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.d on osd.2 to repair 2026-02-23T07:53:13.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:13.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.e 2026-02-23T07:53:13.928 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.e on osd.1 to repair 2026-02-23T07:53:13.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:13.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.f 2026-02-23T07:53:14.093 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.f on osd.3 to repair 2026-02-23T07:53:14.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:14.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.a 2026-02-23T07:53:14.264 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.a on osd.1 to repair 2026-02-23T07:53:14.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:14.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.b 2026-02-23T07:53:14.433 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.b on osd.1 to repair 2026-02-23T07:53:14.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:589: corrupt_and_measure: for pg in "${!pg_pr[@]}" 2026-02-23T07:53:14.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:590: corrupt_and_measure: ceph pg repair 1.c 2026-02-23T07:53:14.598 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.c on osd.3 to repair 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:594: corrupt_and_measure: wait_for_pool_scrubbed td/osd-scrub-dump 1 saved_last_stamp 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:85: wait_for_pool_scrubbed: local dir=td/osd-scrub-dump 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:86: wait_for_pool_scrubbed: local pool_id=1 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:87: wait_for_pool_scrubbed: local -n prev_stamps=saved_last_stamp 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:88: wait_for_pool_scrubbed: local timeout=1000 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:89: wait_for_pool_scrubbed: local saved_echo_flag=x 2026-02-23T07:53:14.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:90: wait_for_pool_scrubbed: set +x 2026-02-23T07:53:14.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:106: wait_for_pool_scrubbed: return 0 2026-02-23T07:53:14.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: date +%s%N 2026-02-23T07:53:14.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:595: corrupt_and_measure: end_time=1771833194780061403 2026-02-23T07:53:14.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:596: corrupt_and_measure: duration=2816 2026-02-23T07:53:14.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:597: corrupt_and_measure: ceph tell 'osd.*' config set debug_osd 20/20 2026-02-23T07:53:14.844 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:53:14.844 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:14.844 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:14.851 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:53:14.851 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:14.851 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:14.858 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:53:14.858 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:14.858 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:14.865 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T07:53:14.865 INFO:tasks.workunit.client.0.trial129.stdout: "success": "" 2026-02-23T07:53:14.865 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:14.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:599: corrupt_and_measure: sleep 5 2026-02-23T07:53:19.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:600: corrupt_and_measure: ceph pg dump pgs 2026-02-23T07:53:20.036 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:53:20.036 INFO:tasks.workunit.client.0.trial129.stdout:1.f 122 0 0 0 0 31232 0 0 122 0 122 active+clean 2026-02-23T07:53:15.754969+0000 24'122 40:228 [3,0,2] 3 [3,0,2] 3 24'122 2026-02-23T07:53:15.753302+0000 24'122 2026-02-23T07:53:15.753302+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:15.753302+0000 122 0 2026-02-23T07:53:20.036 INFO:tasks.workunit.client.0.trial129.stdout:1.e 131 0 0 0 0 33536 0 0 131 0 131 active+clean 2026-02-23T07:53:17.725130+0000 24'131 40:259 [1,3,2] 1 [1,3,2] 1 24'131 2026-02-23T07:53:17.723487+0000 24'131 2026-02-23T07:53:17.723487+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:17.723487+0000 131 0 2026-02-23T07:53:20.036 INFO:tasks.workunit.client.0.trial129.stdout:1.d 128 0 0 0 0 32768 0 0 128 0 128 active+clean 2026-02-23T07:53:14.213147+0000 24'128 40:257 [2,1,3] 2 [2,1,3] 2 24'128 2026-02-23T07:53:14.209948+0000 24'128 2026-02-23T07:53:14.209948+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:14.209948+0000 128 0 2026-02-23T07:53:20.036 INFO:tasks.workunit.client.0.trial129.stdout:1.0 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:53:15.700205+0000 24'133 40:285 [1,0,2] 1 [1,0,2] 1 24'133 2026-02-23T07:53:15.696540+0000 24'133 2026-02-23T07:53:15.696540+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:15.696540+0000 133 0 2026-02-23T07:53:20.036 INFO:tasks.workunit.client.0.trial129.stdout:1.1 133 0 0 0 0 34048 0 0 133 0 133 active+clean 2026-02-23T07:53:14.795155+0000 24'133 40:256 [3,0,2] 3 [3,0,2] 3 24'133 2026-02-23T07:53:14.793267+0000 24'133 2026-02-23T07:53:14.793267+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:14.793267+0000 133 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.c 136 0 0 0 0 34816 0 0 136 0 136 active+clean 2026-02-23T07:53:16.736196+0000 24'136 40:251 [3,0,1] 3 [3,0,1] 3 24'136 2026-02-23T07:53:16.734128+0000 24'136 2026-02-23T07:53:16.734128+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:16.734128+0000 136 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.2 126 0 0 0 0 32256 0 0 126 0 126 active+clean 2026-02-23T07:53:14.374026+0000 24'126 40:284 [0,1,3] 0 [0,1,3] 0 24'126 2026-02-23T07:53:14.371487+0000 24'126 2026-02-23T07:53:14.371487+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:14.371487+0000 126 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.3 119 0 0 0 0 30464 0 0 119 0 119 active+clean 2026-02-23T07:53:16.715745+0000 24'119 40:247 [1,2,0] 1 [1,2,0] 1 24'119 2026-02-23T07:53:16.713411+0000 24'119 2026-02-23T07:53:16.713411+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:16.713411+0000 119 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.4 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:53:12.799927+0000 24'127 40:241 [3,0,1] 3 [3,0,1] 3 24'127 2026-02-23T07:53:12.798463+0000 24'127 2026-02-23T07:53:12.798463+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:12.798463+0000 127 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.5 127 0 0 0 0 32512 0 0 127 0 127 active+clean 2026-02-23T07:53:13.172660+0000 24'127 40:254 [2,3,0] 2 [2,3,0] 2 24'127 2026-02-23T07:53:13.171392+0000 24'127 2026-02-23T07:53:13.171392+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:13.171392+0000 127 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.6 134 0 0 0 0 34304 0 0 134 0 134 active+clean 2026-02-23T07:53:13.772460+0000 24'134 40:245 [3,0,2] 3 [3,0,2] 3 24'134 2026-02-23T07:53:13.767183+0000 24'134 2026-02-23T07:53:13.767183+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:13.767183+0000 134 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.7 129 0 0 0 0 33024 0 0 129 0 129 active+clean 2026-02-23T07:53:14.708299+0000 24'129 40:255 [1,3,0] 1 [1,3,0] 1 24'129 2026-02-23T07:53:14.706946+0000 24'129 2026-02-23T07:53:14.706946+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:14.706946+0000 129 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.8 113 0 0 0 0 28928 0 0 113 0 113 active+clean 2026-02-23T07:53:12.699427+0000 24'113 40:239 [1,2,3] 1 [1,2,3] 1 24'113 2026-02-23T07:53:12.696981+0000 24'113 2026-02-23T07:53:12.696981+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:12.696981+0000 113 0 2026-02-23T07:53:20.037 INFO:tasks.workunit.client.0.trial129.stdout:1.9 121 0 0 0 0 30976 0 0 121 0 121 active+clean 2026-02-23T07:53:13.710201+0000 24'121 40:249 [1,3,2] 1 [1,3,2] 1 24'121 2026-02-23T07:53:13.708226+0000 24'121 2026-02-23T07:53:13.708226+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:13.708226+0000 121 0 2026-02-23T07:53:20.038 INFO:tasks.workunit.client.0.trial129.stdout:1.a 132 0 0 0 0 33792 0 0 132 0 132 active+clean+scrubbing+deep+inconsistent+repair 2026-02-23T07:53:18.661078+0000 24'132 40:218 [1,2,0] 1 [1,2,0] 1 24'132 2026-02-23T07:53:08.813841+0000 24'132 2026-02-23T07:53:08.813841+0000 0 1 deep scrubbing for 0s 0 0 2026-02-23T07:53:20.038 INFO:tasks.workunit.client.0.trial129.stdout:1.b 137 0 0 0 0 35072 0 0 137 0 137 active+clean+inconsistent 2026-02-23T07:53:09.821853+0000 24'137 40:220 [1,0,2] 1 [1,0,2] 1 24'137 2026-02-23T07:53:09.821819+0000 24'137 2026-02-23T07:53:09.821819+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:53:09.821819+0000 137 0 2026-02-23T07:53:20.038 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:53:20.038 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:53:20.038 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:53:20.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:601: corrupt_and_measure: printf 'MSR @%15s@ REPR %3d %3d %3d %3d/%3d %7d %7d/%7d %6d\n' basic_3 4 16 128 40 10 256 4194304 0 2816 2026-02-23T07:53:20.047 INFO:tasks.workunit.client.0.trial129.stdout:MSR @ basic_3@ REPR 4 16 128 40/ 10 256 4194304/ 0 2816 2026-02-23T07:53:20.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:604: corrupt_and_measure: dump_scrub_counters td/osd-scrub-dump 4 'After repair' 2026-02-23T07:53:20.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:186: dump_scrub_counters: local dir=td/osd-scrub-dump 2026-02-23T07:53:20.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:187: dump_scrub_counters: local OSDS=4 2026-02-23T07:53:20.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:188: dump_scrub_counters: local 'hdr_msg=After repair' 2026-02-23T07:53:20.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:189: dump_scrub_counters: local extr_dbg=1 2026-02-23T07:53:20.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: date +%d_%H%M 2026-02-23T07:53:20.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:191: dump_scrub_counters: fnm=/tmp/dscrub_counters_23_0753 2026-02-23T07:53:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:192: dump_scrub_counters: (( extr_dbg >= 3 )) 2026-02-23T07:53:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:53:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:20.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:20.147 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.147 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.147 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.147 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.148 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 52, 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.149 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.150 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.151 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.152 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3110 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3110 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.153 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3110 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3110 2026-02-23T07:53:20.154 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3110 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 796160 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.155 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.156 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.157 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 2, 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.043999773, 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.021999886 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.158 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.159 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.160 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.161 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.162 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.163 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.164 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.165 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.166 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.167 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.168 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.169 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 52, 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.170 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.171 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3110 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3110 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.172 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3110 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3110 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3110 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "value": 796160 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.173 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.174 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 2, 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.043999773, 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.021999886 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.176 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.177 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.178 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.179 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.180 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.181 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.182 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.183 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:20.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.215 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 414, 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.216 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.217 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3064 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3064 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3064 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.218 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3064 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3064 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 784384 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.219 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 16, 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.428997788, 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.026812361 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.220 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.221 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "value": 16 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.222 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.223 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.224 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.225 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.226 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 414, 2026-02-23T07:53:20.227 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.228 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3064 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.229 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3064 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3064 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3064 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3064 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "value": 784384 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.230 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 16, 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.428997788, 2026-02-23T07:53:20.231 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.026812361 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.232 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "value": 16 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.233 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.234 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.235 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.236 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.237 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.237 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.237 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:20.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.284 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 104, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.285 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3060 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3060 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.286 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3060 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3060 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3060 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 783360 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.287 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 4, 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.095999506, 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.023999876 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.288 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.289 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.290 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.291 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.292 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.293 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 104, 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.294 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.295 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3060 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3060 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3060 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3060 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3060 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "value": 783360 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.296 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 4, 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.095999506, 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.023999876 2026-02-23T07:53:20.297 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.298 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.299 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.300 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.301 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:20.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.363 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 266, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.364 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3054 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.365 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3054 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3054 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3054 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3054 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 781824 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.366 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 10, 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.259998658, 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.025999865 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.367 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.368 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": 10 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.369 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.370 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.371 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.372 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 266, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.373 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:20.374 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3054 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3054 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3054 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3054 2026-02-23T07:53:20.375 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3054 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 781824 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.376 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 10, 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.259998658, 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.025999865 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "value": 10 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.378 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.379 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.380 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:20.381 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:31.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd=0 )) 2026-02-23T07:53:31.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.781 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.782 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 78, 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.783 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.784 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.785 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.786 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4396 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4396 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.787 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4396 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4396 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4396 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.788 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1125376 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.789 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 3, 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.071999629, 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.023999876 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.790 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.791 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "value": 3 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.792 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.793 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:31.794 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.795 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.796 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 78, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.797 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.798 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4396 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4396 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4396 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4396 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4396 2026-02-23T07:53:31.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1125376 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.800 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 3, 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.071999629, 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.023999876 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.801 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": 3 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.802 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.803 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.804 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.805 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.806 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.806 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.806 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.806 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:31.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.857 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 539, 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.858 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4196 2026-02-23T07:53:31.859 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4196 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4196 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4196 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4196 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1074176 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.860 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 21 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 21 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr: "value": 21 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.861 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 21, 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.558997120, 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.026618910 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:31.862 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "value": 21 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.863 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:31.864 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.865 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.866 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.867 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 539, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.868 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.869 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4196 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4196 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4196 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4196 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4196 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1074176 2026-02-23T07:53:31.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 21 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 21 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": 21 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 21, 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.558997120, 2026-02-23T07:53:31.871 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.026618910 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.872 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 21 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.873 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.874 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.875 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:31.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.923 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 156, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.924 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4321 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4321 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4321 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4321 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4321 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1106176 2026-02-23T07:53:31.925 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 6, 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.151999217, 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.025333202 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.926 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.927 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "value": 6 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.928 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.929 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:31.930 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.931 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.932 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.933 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 156, 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.934 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.935 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.936 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:31.937 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4321 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4321 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4321 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4321 2026-02-23T07:53:31.938 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4321 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1106176 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:53:31.939 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 6, 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.151999217, 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.025333202 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.940 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 6 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:31.941 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.942 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:31.943 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:31.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd= 3 )) 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:198: dump_scrub_counters: echo '{ 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.996 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 399, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "ec" 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.997 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "value": [ 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "labels": { 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "pooltype": "replicated" 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "counters": { 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "preemptions": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_selected": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "chunk_busy": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "locked_object": 0, 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "write_blocked_by_scrub": 0 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: ] 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4581 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_cnt", 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4581 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.998 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_omapget_bytes", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4581 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4581 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 4581 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 1172736 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:31.999 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 15, 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0.396997952, 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0.026466530 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.000 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": 15 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr: "value": 2 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.001 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_started_ec", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.002 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "value": { 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "avgcount": 0, 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "sum": 0E-9, 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "avgtime": 0E-9 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.003 INFO:tasks.workunit.client.0.trial129.stderr: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:} 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:{ 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr: "value": 0 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_ec", 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:32.004 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_dp_repl", 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 399, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_ec", 2026-02-23T07:53:32.005 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "key": "osd_scrub_sh_repl", 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "value": [ 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_cnt", 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4581 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.006 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapgetheader_bytes", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4581 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_omapget_bytes", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_getattr_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4581 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_stats_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4581 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 4581 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_read_bytes", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 1172736 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_getattr_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_stats_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_cnt", 2026-02-23T07:53:32.007 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_read_bytes", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_replicated", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_replicated", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_replicated_elapsed", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 15, 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0.396997952, 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0.026466530 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_replicated_elapsed", 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.008 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_intersects", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_io_blocked", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_scrub_reservations_completed", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_successful_reservations_elapsed", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_aborted", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_failure", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_reservation_process_skipped", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": 15 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_failed_reservations_elapsed", 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.009 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_replicated_replicas_in_reservation", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 2 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_started_ec", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "num_scrubs_past_reservation_ec", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "successful_scrubs_ec_elapsed", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "failed_scrubs_ec_elapsed", 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.010 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_intersects", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_io_blocked", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservations_completed", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_successful_reservations_elapsed", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_aborted", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_failure", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_reservation_process_skipped", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_failed_reservations_elapsed", 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "value": { 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "avgcount": 0, 2026-02-23T07:53:32.011 INFO:tasks.workunit.client.0.trial129.stdout: "sum": 0E-9, 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "avgtime": 0E-9 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "scrub_ec_replicas_in_reservation", 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "write_blocked_by_scrub", 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout: "value": 0 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd++ )) 2026-02-23T07:53:32.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh:193: dump_scrub_counters: (( osd sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T07:53:32.294 INFO:tasks.workunit:Running workunit scrub/osd-scrub-repair.sh... 2026-02-23T07:53:32.294 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-scrub-repair.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh 2026-02-23T07:53:32.358 INFO:tasks.workunit.client.0.trial129.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2026-02-23T07:53:32.358 INFO:tasks.workunit.client.0.trial129.stderr:++ TIMEOUT=300 2026-02-23T07:53:32.358 INFO:tasks.workunit.client.0.trial129.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2026-02-23T07:53:32.358 INFO:tasks.workunit.client.0.trial129.stderr:++ MAX_TIMEOUT=15 2026-02-23T07:53:32.358 INFO:tasks.workunit.client.0.trial129.stderr:++ PG_NUM=4 2026-02-23T07:53:32.358 INFO:tasks.workunit.client.0.trial129.stderr:++ TMPDIR=/tmp 2026-02-23T07:53:32.359 INFO:tasks.workunit.client.0.trial129.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2026-02-23T07:53:32.359 INFO:tasks.workunit.client.0.trial129.stderr:++ TESTDIR=/home/ubuntu/cephtest 2026-02-23T07:53:32.359 INFO:tasks.workunit.client.0.trial129.stderr:+++ uname 2026-02-23T07:53:32.360 INFO:tasks.workunit.client.0.trial129.stderr:++ '[' Linux = FreeBSD ']' 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:++ SED=sed 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:++ AWK=awk 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:+++ stty -a 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:+++ head -1 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:++ termwidth= 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2026-02-23T07:53:32.361 INFO:tasks.workunit.client.0.trial129.stderr:++ DIFFCOLOPTS='-y ' 2026-02-23T07:53:32.362 INFO:tasks.workunit.client.0.trial129.stderr:++ KERNCORE=kernel.core_pattern 2026-02-23T07:53:32.362 INFO:tasks.workunit.client.0.trial129.stderr:++ EXTRA_OPTS= 2026-02-23T07:53:32.363 INFO:tasks.workunit.client.0.trial129.stderr:++ test '' = TESTS 2026-02-23T07:53:32.363 INFO:tasks.workunit.client.0.trial129.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh 2026-02-23T07:53:32.363 INFO:tasks.workunit.client.0.trial129.stderr:++ uname 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr:+ '[' Linux = FreeBSD ']' 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr:+ use_ec_overwrite=true 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr:+ getjson=no 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr:+ jqfilter='def walk(f): 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T07:53:32.364 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T07:53:32.365 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T07:53:32.366 INFO:tasks.workunit.client.0.trial129.stderr:+ sortkeys='import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T07:53:32.369 INFO:tasks.workunit.client.0.trial129.stderr:+ main osd-scrub-repair 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:+ local dir=td/osd-scrub-repair 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:+ shift 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:+ shopt -s -o xtrace 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T07:53:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-repair 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:52: run: local dir=td/osd-scrub-repair 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:53: run: shift 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:55: run: export CEPH_MON=127.0.0.1:7107 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:55: run: CEPH_MON=127.0.0.1:7107 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:56: run: export CEPH_ARGS 2026-02-23T07:53:32.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:57: run: uuidgen 2026-02-23T07:53:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:57: run: CEPH_ARGS+='--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none ' 2026-02-23T07:53:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:58: run: CEPH_ARGS+='--mon-host=127.0.0.1:7107 ' 2026-02-23T07:53:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:59: run: CEPH_ARGS+='--osd-skip-data-digest=false ' 2026-02-23T07:53:32.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:61: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T07:53:32.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: set 2026-02-23T07:53:32.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T07:53:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:62: run: local 'funcs=TEST_allow_oper_initiated_scrub_during_recovery 2026-02-23T07:53:32.374 INFO:tasks.workunit.client.0.trial129.stderr:TEST_allow_repair_during_recovery 2026-02-23T07:53:32.374 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_bluestore_basic 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_bluestore_failed 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_bluestore_failed_norecov 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_bluestore_scrub 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_bluestore_tag 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_erasure_coded_appends 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_auto_repair_erasure_coded_overwrites 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_and_repair_jerasure_appends 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_and_repair_jerasure_overwrites 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_and_repair_lrc_appends 2026-02-23T07:53:32.375 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_and_repair_lrc_overwrites 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_and_repair_replicated 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_scrub_erasure_appends 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_scrub_erasure_overwrites 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_scrub_replicated 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_corrupt_snapset_scrub_rep 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_dual_store_replicated_cluster 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_list_missing_erasure_coded_appends 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_list_missing_erasure_coded_overwrites 2026-02-23T07:53:32.376 INFO:tasks.workunit.client.0.trial129.stderr:TEST_periodic_scrub_replicated 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_repair_stats 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_repair_stats_ec 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_request_scrub_priority 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_scrub_warning 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_skip_non_repair_during_recovery 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_unfound_erasure_coded_appends 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:TEST_unfound_erasure_coded_overwrites' 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:53:32.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:53:32.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:53:32.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:53:32.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:53:32.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:53:32.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:53:32.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:53:32.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:53:32.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:53:32.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:53:32.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:32.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:32.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:32.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:53:32.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:53:32.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T07:53:32.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T07:53:32.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:53:32.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:53:32.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_allow_oper_initiated_scrub_during_recovery td/osd-scrub-repair 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:115: TEST_allow_oper_initiated_scrub_during_recovery: local dir=td/osd-scrub-repair 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:116: TEST_allow_oper_initiated_scrub_during_recovery: cluster_conf=(['osds_num']='2' ['pgs_in_pool']='4' ['pool_name']='nopool' ['pool_default_size']='2' ['extras']='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true') 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:116: TEST_allow_oper_initiated_scrub_during_recovery: local -A cluster_conf 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:125: TEST_allow_oper_initiated_scrub_during_recovery: standard_scrub_cluster td/osd-scrub-repair cluster_conf 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-repair 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=2 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=nopool 2026-02-23T07:53:32.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=nopool 2026-02-23T07:53:32.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=2 2026-02-23T07:53:32.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=2 2026-02-23T07:53:32.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars=--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-23T07:53:32.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-23T07:53:32.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T07:53:32.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T07:53:32.665 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 b3397f64-62d7-423d-8c42-b4b80d7bd18d 2026-02-23T07:53:32.764 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:32.792 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:32.791+0000 7f46ed47e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:32.794 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:32.793+0000 7f46ed47e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:32.794 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:32.794+0000 7f46ed47e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:32.795 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:32.794+0000 7f46ed47e780 -1 bdev(0x5622b1b2f400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:53:32.795 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:32.794+0000 7f46ed47e780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:53:33.257 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:53:33.352 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:53:33.369 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:33.368+0000 7fe1a1007780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:33.370 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:33.369+0000 7fe1a1007780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:33.371 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:33.370+0000 7fe1a1007780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:33.443 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:33.584 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:33.584+0000 7fe1a1007780 -1 Falling back to public interface 2026-02-23T07:53:33.955 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:33.954+0000 7fe1a1007780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:53:34.540 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:53:34.631 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1354810354,v1:127.0.0.1:6801/1354810354] [v2:127.0.0.1:6802/1354810354,v1:127.0.0.1:6803/1354810354] exists,up b3397f64-62d7-423d-8c42-b4b80d7bd18d 2026-02-23T07:53:34.634 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 adee27b0-d7a0-46d1-a75b-24f8d6b7a586 2026-02-23T07:53:34.735 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:53:34.761 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:34.760+0000 7f7f4cf51780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:34.762 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:34.761+0000 7f7f4cf51780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:34.763 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:34.762+0000 7f7f4cf51780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:34.764 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:34.763+0000 7f7f4cf51780 -1 bdev(0x55d1fca1b400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:53:34.764 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:34.763+0000 7f7f4cf51780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:53:35.195 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:53:35.403 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:53:35.418 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:35.417+0000 7fd0e4e0e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:35.420 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:35.419+0000 7fd0e4e0e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:35.420 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:35.420+0000 7fd0e4e0e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:35.564 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:35.616 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:35.614+0000 7fd0e4e0e780 -1 Falling back to public interface 2026-02-23T07:53:35.938 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:35.937+0000 7fd0e4e0e780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:53:36.734 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:53:36.905 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/580256499,v1:127.0.0.1:6811/580256499] [v2:127.0.0.1:6812/580256499,v1:127.0.0.1:6813/580256499] exists,up adee27b0-d7a0-46d1-a75b-24f8d6b7a586 2026-02-23T07:53:37.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:126: TEST_allow_oper_initiated_scrub_during_recovery: local poolname=rbd 2026-02-23T07:53:37.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:127: TEST_allow_oper_initiated_scrub_during_recovery: create_rbd_pool 2026-02-23T07:53:37.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T07:53:38.065 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T07:53:38.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T07:53:38.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T07:53:38.285 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T07:53:38.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:53:39.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T07:53:39.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:128: TEST_allow_oper_initiated_scrub_during_recovery: wait_for_clean 2026-02-23T07:53:39.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:53:39.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:53:39.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:53:39.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:53:39.578 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:53:39.578 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:53:39.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:53:39.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:53:39.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:53:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:53:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:53:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:53:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:53:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:53:39.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:53:39.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:53:39.818 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T07:53:39.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:53:39.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:53:39.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:53:39.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T07:53:39.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T07:53:39.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T07:53:39.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:53:39.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:53:39.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T07:53:39.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T07:53:39.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672964' 2026-02-23T07:53:39.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:53:39.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T07:53:39.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:53:39.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:53:39.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T07:53:39.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:53:39.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T07:53:39.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T07:53:39.969 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T07:53:39.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:53:40.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-23T07:53:40.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:53:41.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:53:41.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:53:41.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T07:53:41.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:53:41.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T07:53:41.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:53:41.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:53:41.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T07:53:41.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:53:41.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T07:53:41.308 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T07:53:41.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T07:53:41.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:53:41.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672964 2026-02-23T07:53:41.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:53:41.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:53:41.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:53:41.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:53:41.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:53:41.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:53:41.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:53:41.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:53:41.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:53:41.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:53:41.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:53:41.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:53:41.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:53:41.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:53:41.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:130: TEST_allow_oper_initiated_scrub_during_recovery: add_something td/osd-scrub-repair rbd 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T07:53:42.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T07:53:42.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T07:53:42.263 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T07:53:42.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T07:53:42.527 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T07:53:42.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T07:53:42.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T07:53:42.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:53:42.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:131: TEST_allow_oper_initiated_scrub_during_recovery: get_not_primary rbd SOMETHING 2026-02-23T07:53:42.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-23T07:53:42.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:53:42.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-23T07:53:42.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-23T07:53:42.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:53:42.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T07:53:42.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:53:42.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:53:42.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T07:53:42.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:53:42.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:131: TEST_allow_oper_initiated_scrub_during_recovery: oper_scrub_and_schedule td/osd-scrub-repair rbd 0 2026-02-23T07:53:42.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:180: oper_scrub_and_schedule: local dir=td/osd-scrub-repair 2026-02-23T07:53:42.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:181: oper_scrub_and_schedule: local poolname=rbd 2026-02-23T07:53:42.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:182: oper_scrub_and_schedule: local osd=0 2026-02-23T07:53:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:187: oper_scrub_and_schedule: get_pg rbd SOMETHING 2026-02-23T07:53:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-23T07:53:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:53:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-23T07:53:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:53:43.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:187: oper_scrub_and_schedule: local pg=1.3 2026-02-23T07:53:43.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:188: oper_scrub_and_schedule: get_last_scrub_stamp 1.3 2026-02-23T07:53:43.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:53:43.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:53:43.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:53:43.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:53:43.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:188: oper_scrub_and_schedule: local last_scrub=2026-02-23T07:53:38.284322+0000 2026-02-23T07:53:43.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:189: oper_scrub_and_schedule: ceph tell 1.3 scrub 2026-02-23T07:53:43.284 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:53:43.285 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T07:53:43.285 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T07:53:43.285 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T07:53:43.285 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:53:43.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:194: oper_scrub_and_schedule: sleep 3 2026-02-23T07:53:46.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:195: oper_scrub_and_schedule: (( i=0 )) 2026-02-23T07:53:46.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:195: oper_scrub_and_schedule: (( i < 3 )) 2026-02-23T07:53:46.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:196: oper_scrub_and_schedule: get_last_scrub_stamp 1.3 2026-02-23T07:53:46.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:53:46.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:53:46.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:53:46.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:196: oper_scrub_and_schedule: test 2026-02-23T07:53:43.910893+0000 '>' 2026-02-23T07:53:38.284322+0000 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:197: oper_scrub_and_schedule: break 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:208: oper_scrub_and_schedule: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:53:46.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:53:46.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:53:46.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:53:46.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:53:46.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:53:46.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:53:46.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:53:46.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-23T07:53:46.620 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:53:46.620 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:53:46.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:53:46.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:53:46.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:53:46.681 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:46.680+0000 7f9077c7a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:46.682 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:46.682+0000 7f9077c7a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:46.683 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:46.682+0000 7f9077c7a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:53:46.835 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:53:46.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:53:46.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:53:46.866 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:46.865+0000 7f9077c7a780 -1 Falling back to public interface 2026-02-23T07:53:47.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:53:47.240 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:47.239+0000 7f9077c7a780 -1 osd.0 21 log_to_monitors true 2026-02-23T07:53:48.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:53:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:53:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:53:48.004 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:53:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:53:48.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:53:48.171 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 25 up_thru 25 down_at 22 last_clean_interval [5,21) [v2:127.0.0.1:6800/824868393,v1:127.0.0.1:6801/824868393] [v2:127.0.0.1:6802/824868393,v1:127.0.0.1:6803/824868393] exists,up b3397f64-62d7-423d-8c42-b4b80d7bd18d 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:53:48.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:53:48.173 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:53:48.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:53:48.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:53:48.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:53:48.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:53:48.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:53:48.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:53:48.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:53:48.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:53:48.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:53:48.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:53:48.412 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T07:53:48.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:53:48.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:53:48.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:53:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182403 2026-02-23T07:53:48.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182403 2026-02-23T07:53:48.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182403' 2026-02-23T07:53:48.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:53:48.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:53:48.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672974 2026-02-23T07:53:48.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672974 2026-02-23T07:53:48.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-107374182403 1-42949672974' 2026-02-23T07:53:48.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:53:48.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-107374182403 2026-02-23T07:53:48.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:53:48.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:53:48.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-107374182403 2026-02-23T07:53:48.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:53:48.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182403 2026-02-23T07:53:48.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 107374182403' 2026-02-23T07:53:48.559 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 107374182403 2026-02-23T07:53:48.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:53:48.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182403 -lt 107374182403 2026-02-23T07:53:48.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:53:48.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672974 2026-02-23T07:53:48.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:53:48.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:53:48.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672974 2026-02-23T07:53:48.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:53:48.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672974 2026-02-23T07:53:48.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2026-02-23T07:53:48.730 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672974 2026-02-23T07:53:48.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:53:48.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672974 -lt 42949672974 2026-02-23T07:53:48.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:53:48.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:53:48.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:53:49.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:53:49.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:53:49.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:53:49.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:53:49.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:53:49.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:53:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:53:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:53:49.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:53:49.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:209: oper_scrub_and_schedule: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T07:53:49.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:210: oper_scrub_and_schedule: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:53:49.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:53:49.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:53:49.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:53:49.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:53:49.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:53:49.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:53:49.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:53:49.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:53:49.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:53:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:53:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:53:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:53:49.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:53:49.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:53:49.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:53:49.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:53:49.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:53:49.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:53:49.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:53:49.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:53:49.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:53:49.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:53:49.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:53:49.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:53:49.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:53:49.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:53:49.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:53:49.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:53:49.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:53:49.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:53:49.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:53:49.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:53:49.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:53:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:53:49.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:53:49.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:53:49.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:53:49.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:53:49.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:53:49.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:53:49.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:53:49.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:53:49.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_allow_repair_during_recovery td/osd-scrub-repair 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:138: TEST_allow_repair_during_recovery: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:139: TEST_allow_repair_during_recovery: local poolname=rbd 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:141: TEST_allow_repair_during_recovery: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:53:49.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-23T07:53:49.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:53:49.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:53:49.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:53:49.635 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:53:49.635 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.636 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:49.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T07:53:49.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:53:49.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:53:49.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:53:49.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:53:49.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.657 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.658 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:53:49.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:53:49.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:53:49.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:53:49.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:53:49.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:53:49.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:53:49.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:53:49.719 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:53:49.719 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:53:49.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:142: TEST_allow_repair_during_recovery: run_mgr td/osd-scrub-repair x 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:53:49.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:49.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:53:49.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:143: TEST_allow_repair_during_recovery: run_osd td/osd-scrub-repair 0 --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:53:49.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-23T07:53:49.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:53:49.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:53:49.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2479f887-221d-434d-9897-eb6000eed9bb 2026-02-23T07:53:49.891 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 2479f887-221d-434d-9897-eb6000eed9bb 2026-02-23T07:53:49.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2479f887-221d-434d-9897-eb6000eed9bb' 2026-02-23T07:53:49.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:53:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCNB5xpEYeQNRAAihCzEj4xOHGKnBaU9EwXQA== 2026-02-23T07:53:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCNB5xpEYeQNRAAihCzEj4xOHGKnBaU9EwXQA=="}' 2026-02-23T07:53:49.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2479f887-221d-434d-9897-eb6000eed9bb -i td/osd-scrub-repair/0/new.json 2026-02-23T07:53:49.986 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:49.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:53:49.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true --mkfs --key AQCNB5xpEYeQNRAAihCzEj4xOHGKnBaU9EwXQA== --osd-uuid 2479f887-221d-434d-9897-eb6000eed9bb 2026-02-23T07:53:50.010 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.009+0000 7fdb5d681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:50.011 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.010+0000 7fdb5d681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:50.012 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.011+0000 7fdb5d681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:50.012 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.011+0000 7fdb5d681780 -1 bdev(0x5564ed923400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:53:50.012 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.011+0000 7fdb5d681780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:53:50.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:53:50.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:53:50.510 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:53:50.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:53:50.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:53:50.605 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:53:50.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:53:50.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-23T07:53:50.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:53:50.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:53:50.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:53:50.619 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.618+0000 7fe0e6351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:50.620 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.619+0000 7fe0e6351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:50.621 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.620+0000 7fe0e6351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:53:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:53:50.698 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:50.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:53:50.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:53:50.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:53:50.835 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:50.833+0000 7fe0e6351780 -1 Falling back to public interface 2026-02-23T07:53:51.228 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:51.227+0000 7fe0e6351780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:53:51.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:53:51.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:53:51.787 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:53:51.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:53:51.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:53:51.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:53:51.880 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/739949086,v1:127.0.0.1:6801/739949086] [v2:127.0.0.1:6802/739949086,v1:127.0.0.1:6803/739949086] exists,up 2479f887-221d-434d-9897-eb6000eed9bb 2026-02-23T07:53:51.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:145: TEST_allow_repair_during_recovery: run_osd td/osd-scrub-repair 1 --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:53:51.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:51.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:53:51.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:53:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=580277f3-caf6-41b0-966d-f68bc7980bbe 2026-02-23T07:53:51.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 580277f3-caf6-41b0-966d-f68bc7980bbe' 2026-02-23T07:53:51.888 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 580277f3-caf6-41b0-966d-f68bc7980bbe 2026-02-23T07:53:51.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:53:51.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCPB5xp6iopNRAABGZ43QSpt4aKxcopIw4agg== 2026-02-23T07:53:51.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCPB5xp6iopNRAABGZ43QSpt4aKxcopIw4agg=="}' 2026-02-23T07:53:51.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 580277f3-caf6-41b0-966d-f68bc7980bbe -i td/osd-scrub-repair/1/new.json 2026-02-23T07:53:51.980 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:53:51.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:53:51.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true --mkfs --key AQCPB5xp6iopNRAABGZ43QSpt4aKxcopIw4agg== --osd-uuid 580277f3-caf6-41b0-966d-f68bc7980bbe 2026-02-23T07:53:52.003 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.002+0000 7f1ba140c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:52.005 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.004+0000 7f1ba140c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:52.005 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.004+0000 7f1ba140c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:52.006 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.005+0000 7f1ba140c780 -1 bdev(0x55b49a339400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:53:52.006 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.005+0000 7f1ba140c780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:53:52.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:53:52.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:53:52.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:53:52.410 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:53:52.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:53:52.614 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:53:52.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:53:52.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true 2026-02-23T07:53:52.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:53:52.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:53:52.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:53:52.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.626+0000 7f00ea408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:52.629 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.628+0000 7f00ea408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:52.629 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.629+0000 7f00ea408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:53:52.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:53:52.779 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:53:52.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:53:52.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:53:52.826 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:52.824+0000 7f00ea408780 -1 Falling back to public interface 2026-02-23T07:53:52.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:53:53.182 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:53:53.181+0000 7f00ea408780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:53:53.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:53:53.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:53:53.944 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:53:53.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:53:53.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:53:53.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:53:54.109 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/115011542,v1:127.0.0.1:6811/115011542] [v2:127.0.0.1:6812/115011542,v1:127.0.0.1:6813/115011542] exists,up 580277f3-caf6-41b0-966d-f68bc7980bbe 2026-02-23T07:53:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:53:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:53:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:53:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:147: TEST_allow_repair_during_recovery: create_rbd_pool 2026-02-23T07:53:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T07:53:54.270 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T07:53:54.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T07:53:54.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T07:53:54.452 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T07:53:54.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:53:55.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T07:53:55.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:148: TEST_allow_repair_during_recovery: wait_for_clean 2026-02-23T07:53:55.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:53:55.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:53:55.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:53:55.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:53:55.745 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:53:55.745 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:53:55.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:53:55.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:53:55.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:53:55.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:53:55.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:53:55.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:53:55.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:53:55.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:53:55.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:53:55.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:53:55.984 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T07:53:55.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:53:55.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:53:55.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:53:56.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T07:53:56.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T07:53:56.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T07:53:56.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:53:56.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:53:56.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-23T07:53:56.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-23T07:53:56.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705666' 2026-02-23T07:53:56.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:53:56.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T07:53:56.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:53:56.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:53:56.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T07:53:56.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:53:56.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T07:53:56.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T07:53:56.137 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T07:53:56.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:53:56.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T07:53:56.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:53:57.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:53:57.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:53:57.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T07:53:57.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:53:58.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:53:58.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:53:58.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-23T07:53:58.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:53:58.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-23T07:53:58.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:53:58.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:53:58.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-23T07:53:58.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:53:58.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-23T07:53:58.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-23T07:53:58.645 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705666 2026-02-23T07:53:58.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:53:58.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705666 -lt 38654705666 2026-02-23T07:53:58.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:53:58.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:53:58.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:53:59.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:53:59.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:53:59.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:53:59.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:53:59.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:53:59.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:53:59.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:53:59.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:53:59.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:53:59.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:150: TEST_allow_repair_during_recovery: add_something td/osd-scrub-repair rbd 2026-02-23T07:53:59.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T07:53:59.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-23T07:53:59.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T07:53:59.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T07:53:59.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T07:53:59.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T07:53:59.590 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T07:53:59.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T07:53:59.794 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T07:53:59.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T07:53:59.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T07:53:59.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:151: TEST_allow_repair_during_recovery: get_not_primary rbd SOMETHING 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T07:53:59.827 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:53:59.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:53:59.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T07:53:59.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:151: TEST_allow_repair_during_recovery: corrupt_and_repair_one td/osd-scrub-repair rbd 0 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=rbd 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=0 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:00.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T07:54:00.603 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:00.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:00.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:54:00.660 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:54:00.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:54:00.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:54:00.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:54:00.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:54:00.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:54:00.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:54:00.672 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:00.671+0000 7f65bc36b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:00.674 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:00.673+0000 7f65bc36b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:00.674 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:00.674+0000 7f65bc36b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:00.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:00.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:00.882 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:00.881+0000 7f65bc36b780 -1 Falling back to public interface 2026-02-23T07:54:00.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:01.224 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:01.223+0000 7f65bc36b780 -1 osd.0 19 log_to_monitors true 2026-02-23T07:54:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:54:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:54:01.994 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:02.160 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 23 up_thru 23 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/1063445938,v1:127.0.0.1:6801/1063445938] [v2:127.0.0.1:6802/1063445938,v1:127.0.0.1:6803/1063445938] exists,up 2479f887-221d-434d-9897-eb6000eed9bb 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:02.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:02.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:02.162 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:02.162 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:02.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:02.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:02.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:02.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:02.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:02.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:02.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:02.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:02.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:02.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:02.404 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T07:54:02.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:02.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:02.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:02.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247810 2026-02-23T07:54:02.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247810 2026-02-23T07:54:02.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810' 2026-02-23T07:54:02.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:02.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T07:54:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T07:54:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-38654705668' 2026-02-23T07:54:02.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:02.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247810 2026-02-23T07:54:02.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:02.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:02.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247810 2026-02-23T07:54:02.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:02.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247810 2026-02-23T07:54:02.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247810' 2026-02-23T07:54:02.553 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 98784247810 2026-02-23T07:54:02.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:02.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247810 2026-02-23T07:54:02.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:03.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:03.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:03.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247810 2026-02-23T07:54:03.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:04.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:54:04.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:05.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 98784247810 2026-02-23T07:54:05.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:05.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T07:54:05.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:05.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:05.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T07:54:05.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:05.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T07:54:05.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T07:54:05.054 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705668 2026-02-23T07:54:05.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:05.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-23T07:54:05.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:05.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:05.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:05.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:54:05.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:05.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:05.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:05.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:54:05.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:05.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:05.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg rbd SOMETHING 2026-02-23T07:54:05.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-23T07:54:05.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:54:05.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-23T07:54:05.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=1.3 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 1.3 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.3 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.3 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:05.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:05.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:54:06.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:06.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.3 2026-02-23T07:54:06.270 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T07:54:06.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.3 2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:06.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:06.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:54:06.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:53:54.450253+0000 '>' 2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:06.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:54:07.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:54:07.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:07.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T07:54:07.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:54:07.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:07.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:07.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:54:07.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:53:54.450253+0000 '>' 2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:07.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:54:08.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:54:08.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:08.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T07:54:08.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:54:08.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:08.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:08.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:54:08.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:53:54.450253+0000 '>' 2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:08.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:54:09.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:54:09.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T07:54:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T07:54:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T07:54:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:54:07.167214+0000 '>' 2026-02-23T07:53:54.450253+0000 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:54:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:10.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:10.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:54:10.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:54:10.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:54:10.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:54:10.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:54:10.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:54:10.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T07:54:10.318 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T07:54:10.319 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T07:54:10.319 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:54:10.319 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:10.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:54:10.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:54:10.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:54:10.365 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:54:10.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:54:10.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:54:10.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:54:10.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:54:10.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:54:10.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:54:10.378 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:10.376+0000 7efedea81780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:10.379 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:10.378+0000 7efedea81780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:10.380 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:10.379+0000 7efedea81780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:10.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:54:10.555 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:10.554+0000 7efedea81780 -1 Falling back to public interface 2026-02-23T07:54:10.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:10.869 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:10.867+0000 7efedea81780 -1 osd.1 27 log_to_monitors true 2026-02-23T07:54:11.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:54:11.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:11.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:54:11.698 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:11.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:11.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 30 up_thru 30 down_at 27 last_clean_interval [9,27) [v2:127.0.0.1:6810/3476584318,v1:127.0.0.1:6811/3476584318] [v2:127.0.0.1:6812/3476584318,v1:127.0.0.1:6813/3476584318] exists,up 580277f3-caf6-41b0-966d-f68bc7980bbe 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:11.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:11.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:11.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:11.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:11.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:11.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:11.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:11.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:11.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:11.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:11.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:11.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:12.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:12.111 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T07:54:12.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:12.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:12.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:12.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247813 2026-02-23T07:54:12.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247813 2026-02-23T07:54:12.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247813' 2026-02-23T07:54:12.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:12.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:12.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-23T07:54:12.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-23T07:54:12.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247813 1-128849018882' 2026-02-23T07:54:12.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:12.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247813 2026-02-23T07:54:12.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:12.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247813 2026-02-23T07:54:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:12.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247813 2026-02-23T07:54:12.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247813' 2026-02-23T07:54:12.264 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 98784247813 2026-02-23T07:54:12.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:12.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247812 -lt 98784247813 2026-02-23T07:54:12.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:13.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:13.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:13.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247812 -lt 98784247813 2026-02-23T07:54:13.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:14.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:54:14.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:14.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247813 -lt 98784247813 2026-02-23T07:54:14.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:14.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-128849018882 2026-02-23T07:54:14.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:14.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:14.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018882 2026-02-23T07:54:14.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:14.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-23T07:54:14.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 128849018882' 2026-02-23T07:54:14.773 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 128849018882 2026-02-23T07:54:14.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:14.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018882 -lt 128849018882 2026-02-23T07:54:14.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:14.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:14.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:15.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:15.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:54:15.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:15.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:15.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:15.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:54:15.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:15.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:15.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T07:54:15.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:54:15.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:15.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:15.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:15.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:54:15.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:54:15.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:54:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:54:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:54:15.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:54:15.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:15.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:54:15.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:54:15.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:15.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:54:15.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:54:15.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:54:15.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:54:15.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:15.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:15.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:54:15.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:54:15.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:54:15.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:54:15.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:54:15.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:15.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:15.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:54:15.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:54:15.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:54:15.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:54:15.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:54:15.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:54:15.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:15.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:54:15.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:54:15.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:15.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:54:15.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:54:15.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:54:15.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:54:15.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:15.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:15.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:54:15.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:54:15.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:54:15.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:54:15.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:54:15.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:15.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:15.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_basic td/osd-scrub-repair 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:498: TEST_auto_repair_bluestore_basic: local dir=td/osd-scrub-repair 2026-02-23T07:54:15.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:499: TEST_auto_repair_bluestore_basic: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='1' ['pool_name']='testpool' ['extras']=' --osd_scrub_auto_repair=true') 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:499: TEST_auto_repair_bluestore_basic: local -A cluster_conf 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:505: TEST_auto_repair_bluestore_basic: standard_scrub_cluster td/osd-scrub-repair cluster_conf 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-repair 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=1 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=testpool 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=testpool 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars= --osd_scrub_auto_repair=true' 2026-02-23T07:54:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-23T07:54:15.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T07:54:15.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T07:54:15.937 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 ddac06cd-2df5-4af3-8cc3-9407592a8a91 2026-02-23T07:54:16.033 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:16.061 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.059+0000 7f610677b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:16.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.061+0000 7f610677b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:16.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.062+0000 7f610677b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:16.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.062+0000 7f610677b780 -1 bdev(0x5600556f9400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:54:16.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.062+0000 7f610677b780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:54:16.456 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:54:16.554 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:54:16.570 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.568+0000 7fa80656f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:16.572 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.570+0000 7fa80656f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:16.572 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.571+0000 7fa80656f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:16.644 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:16.774 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:16.772+0000 7fa80656f780 -1 Falling back to public interface 2026-02-23T07:54:17.202 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:17.200+0000 7fa80656f780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:54:17.738 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:54:17.829 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1718296628,v1:127.0.0.1:6801/1718296628] [v2:127.0.0.1:6802/1718296628,v1:127.0.0.1:6803/1718296628] exists,up ddac06cd-2df5-4af3-8cc3-9407592a8a91 2026-02-23T07:54:17.832 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 fe2b2cc8-7f46-4fec-8afe-53457d0b83ce 2026-02-23T07:54:17.929 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:54:17.958 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:17.956+0000 7f66ea94d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:17.959 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:17.957+0000 7f66ea94d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:17.960 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:17.958+0000 7f66ea94d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:17.961 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:17.959+0000 7f66ea94d780 -1 bdev(0x556ece0e3400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:54:17.961 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:17.959+0000 7f66ea94d780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:54:18.341 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:54:18.547 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:54:18.563 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:18.561+0000 7f5bfd554780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:18.564 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:18.562+0000 7f5bfd554780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:18.565 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:18.563+0000 7f5bfd554780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:18.712 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:18.740 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:18.738+0000 7f5bfd554780 -1 Falling back to public interface 2026-02-23T07:54:19.095 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:19.093+0000 7f5bfd554780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:54:19.878 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:54:20.046 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/19936071,v1:127.0.0.1:6811/19936071] [v2:127.0.0.1:6812/19936071,v1:127.0.0.1:6813/19936071] exists,up fe2b2cc8-7f46-4fec-8afe-53457d0b83ce 2026-02-23T07:54:20.049 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 1938bb00-72d4-4142-9884-f67fa1985e7f 2026-02-23T07:54:20.218 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:54:20.248 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.246+0000 7fe77ff4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:20.249 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.247+0000 7fe77ff4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:20.249 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.248+0000 7fe77ff4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:20.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.248+0000 7fe77ff4f780 -1 bdev(0x5594f6a0d400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:54:20.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.248+0000 7fe77ff4f780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:54:20.676 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:54:20.881 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:54:20.897 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.894+0000 7f7020a0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:20.898 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.896+0000 7f7020a0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:20.899 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:20.897+0000 7f7020a0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:21.047 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:21.087 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:21.085+0000 7f7020a0d780 -1 Falling back to public interface 2026-02-23T07:54:21.443 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:21.442+0000 7f7020a0d780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:54:22.211 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:54:22.377 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3360310704,v1:127.0.0.1:6819/3360310704] [v2:127.0.0.1:6820/3360310704,v1:127.0.0.1:6821/3360310704] exists,up 1938bb00-72d4-4142-9884-f67fa1985e7f 2026-02-23T07:54:22.620 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T07:54:24.106 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T07:54:26.609 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705669 2026-02-23T07:54:26.777 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542147 2026-02-23T07:54:28.690 INFO:tasks.workunit.client.0.trial129.stdout:standard_scrub_cluster: dbg: test pool is testpool 1 2026-02-23T07:54:28.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:506: TEST_auto_repair_bluestore_basic: local poolid=1 2026-02-23T07:54:28.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:507: TEST_auto_repair_bluestore_basic: local poolname=testpool 2026-02-23T07:54:28.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:509: TEST_auto_repair_bluestore_basic: ceph osd pool set testpool size 2 2026-02-23T07:54:28.895 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 2 2026-02-23T07:54:28.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:510: TEST_auto_repair_bluestore_basic: wait_for_clean 2026-02-23T07:54:28.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:28.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:28.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:28.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:28.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:28.912 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:28.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:28.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:28.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:28.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:29.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:29.155 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:29.155 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:54:29.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:29.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:29.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T07:54:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T07:54:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T07:54:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:29.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:29.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-23T07:54:29.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-23T07:54:29.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676' 2026-02-23T07:54:29.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:29.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:54:29.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T07:54:29.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T07:54:29.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705676 2-60129542153' 2026-02-23T07:54:29.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:29.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T07:54:29.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:29.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:29.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T07:54:29.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:29.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T07:54:29.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T07:54:29.383 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836494 2026-02-23T07:54:29.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:29.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836494 2026-02-23T07:54:29.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:30.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:30.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:30.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T07:54:30.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:30.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-23T07:54:30.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:30.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:30.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-23T07:54:30.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:30.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-23T07:54:30.726 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705676 2026-02-23T07:54:30.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-23T07:54:30.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:30.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-23T07:54:30.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:30.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T07:54:30.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:30.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:54:30.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:30.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T07:54:30.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T07:54:30.898 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542153 2026-02-23T07:54:30.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T07:54:30.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:54:31.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542153 2026-02-23T07:54:31.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:31.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:31.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:54:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:31.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:54:31.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:31.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:31.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:54:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:513: TEST_auto_repair_bluestore_basic: local payload=ABCDEF 2026-02-23T07:54:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:514: TEST_auto_repair_bluestore_basic: echo ABCDEF 2026-02-23T07:54:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:515: TEST_auto_repair_bluestore_basic: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:54:31.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:519: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2026-02-23T07:54:31.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:54:31.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:54:31.654 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:54:31.654 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:54:31.655 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:54:31.655 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:31.655 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:54:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:54:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:54:31.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:519: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:54:31.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:54:31.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:54:31.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:54:31.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:54:31.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:32.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T07:54:32.425 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:32.493 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:54:32.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:54:32.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:54:32.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:54:32.495 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:54:32.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:54:32.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:54:32.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:54:32.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:54:32.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:54:32.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:54:32.503 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:32.501+0000 7fb13ac08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:32.504 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:32.502+0000 7fb13ac08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:32.505 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:32.503+0000 7fb13ac08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:32.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:32.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:32.715 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:32.712+0000 7fb13ac08780 -1 Falling back to public interface 2026-02-23T07:54:32.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:33.080 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:33.077+0000 7fb13ac08780 -1 osd.0 20 log_to_monitors true 2026-02-23T07:54:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:54:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:54:33.829 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:33.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:33.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/1016743687,v1:127.0.0.1:6801/1016743687] [v2:127.0.0.1:6802/1016743687,v1:127.0.0.1:6803/1016743687] exists,up ddac06cd-2df5-4af3-8cc3-9407592a8a91 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:33.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:33.998 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:33.998 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:33.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:33.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:33.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:34.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:34.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:34.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:34.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:34.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:34.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:34.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:34.243 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:34.244 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:54:34.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:34.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:34.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:34.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215107 2026-02-23T07:54:34.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215107 2026-02-23T07:54:34.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215107' 2026-02-23T07:54:34.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:34.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:34.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705682 2026-02-23T07:54:34.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705682 2026-02-23T07:54:34.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215107 1-38654705682' 2026-02-23T07:54:34.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:34.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:54:34.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542159 2026-02-23T07:54:34.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542159 2026-02-23T07:54:34.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215107 1-38654705682 2-60129542159' 2026-02-23T07:54:34.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:34.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215107 2026-02-23T07:54:34.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:34.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:34.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215107 2026-02-23T07:54:34.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:34.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215107 2026-02-23T07:54:34.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215107' 2026-02-23T07:54:34.467 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215107 2026-02-23T07:54:34.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:34.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215107 2026-02-23T07:54:34.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:35.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:35.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:35.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215107 2026-02-23T07:54:35.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:36.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:54:36.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:36.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215107 2026-02-23T07:54:36.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:36.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705682 2026-02-23T07:54:36.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:36.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:36.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705682 2026-02-23T07:54:36.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:36.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705682 2026-02-23T07:54:36.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705682' 2026-02-23T07:54:36.975 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705682 2026-02-23T07:54:36.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:37.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705683 -lt 38654705682 2026-02-23T07:54:37.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:37.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542159 2026-02-23T07:54:37.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:37.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:54:37.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542159 2026-02-23T07:54:37.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:37.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542159 2026-02-23T07:54:37.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542159' 2026-02-23T07:54:37.142 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542159 2026-02-23T07:54:37.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:54:37.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542161 -lt 60129542159 2026-02-23T07:54:37.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:37.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:37.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:37.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:54:37.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:37.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:37.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:37.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:37.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:37.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:37.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:37.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:54:37.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:37.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:37.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:37.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:54:37.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:37.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:37.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:520: TEST_auto_repair_bluestore_basic: ceph tell 'osd.*' config set osd_scrub_auto_repair true 2026-02-23T07:54:37.949 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:54:37.949 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T07:54:37.949 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:54:37.956 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:54:37.957 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T07:54:37.957 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:54:37.964 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:54:37.964 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T07:54:37.964 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:54:37.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:522: TEST_auto_repair_bluestore_basic: get_pg testpool SOMETHING 2026-02-23T07:54:37.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T07:54:37.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:54:37.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:37.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:54:38.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:522: TEST_auto_repair_bluestore_basic: local pgid=1.0 2026-02-23T07:54:38.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:523: TEST_auto_repair_bluestore_basic: get_primary testpool SOMETHING 2026-02-23T07:54:38.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:54:38.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:54:38.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:38.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:54:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:523: TEST_auto_repair_bluestore_basic: local primary=1 2026-02-23T07:54:38.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:524: TEST_auto_repair_bluestore_basic: get_last_scrub_stamp 1.0 2026-02-23T07:54:38.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:54:38.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:38.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:38.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:54:38.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:524: TEST_auto_repair_bluestore_basic: local last_scrub_stamp=2026-02-23T07:54:22.617760+0000 2026-02-23T07:54:38.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:527: TEST_auto_repair_bluestore_basic: ceph tell 1.0 schedule-deep-scrub 2026-02-23T07:54:38.534 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:54:38.534 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:54:38.534 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T07:54:38.534 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-12T03:06:28.533654+0000" 2026-02-23T07:54:38.534 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:530: TEST_auto_repair_bluestore_basic: wait_for_scrub 1.0 2026-02-23T07:54:22.617760+0000 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:54:22.617760+0000 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:38.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:38.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:54:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:54:22.617760+0000 '>' 2026-02-23T07:54:22.617760+0000 2026-02-23T07:54:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:54:39.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:54:39.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:39.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:54:39.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:54:39.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:54:39.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:54:22.617760+0000 '>' 2026-02-23T07:54:22.617760+0000 2026-02-23T07:54:39.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:54:40.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:54:40.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:54:40.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:54:40.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:54:40.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:54:40.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:54:40.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:54:39.108197+0000 '>' 2026-02-23T07:54:22.617760+0000 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:531: TEST_auto_repair_bluestore_basic: wait_for_clean 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:41.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:41.048 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:41.048 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:41.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:41.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:41.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:41.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:41.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:41.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:41.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:41.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:41.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:41.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:41.293 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:41.293 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:54:41.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:41.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:41.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:41.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215115 2026-02-23T07:54:41.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215115 2026-02-23T07:54:41.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215115' 2026-02-23T07:54:41.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:41.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:41.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705690 2026-02-23T07:54:41.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705690 2026-02-23T07:54:41.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215115 1-38654705690' 2026-02-23T07:54:41.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:41.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:54:41.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542167 2026-02-23T07:54:41.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542167 2026-02-23T07:54:41.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215115 1-38654705690 2-60129542167' 2026-02-23T07:54:41.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:41.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215115 2026-02-23T07:54:41.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:41.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:41.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215115 2026-02-23T07:54:41.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:41.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215115 2026-02-23T07:54:41.516 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215115 2026-02-23T07:54:41.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215115' 2026-02-23T07:54:41.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:41.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215112 -lt 103079215115 2026-02-23T07:54:41.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:42.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:42.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:42.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215115 -lt 103079215115 2026-02-23T07:54:42.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705690 2026-02-23T07:54:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:42.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:42.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705690 2026-02-23T07:54:42.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:42.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705690 2026-02-23T07:54:42.854 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705690 2026-02-23T07:54:42.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705690' 2026-02-23T07:54:42.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:43.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705690 -lt 38654705690 2026-02-23T07:54:43.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:43.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542167 2026-02-23T07:54:43.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:43.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:54:43.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542167 2026-02-23T07:54:43.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:43.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542167 2026-02-23T07:54:43.022 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542167 2026-02-23T07:54:43.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542167' 2026-02-23T07:54:43.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:54:43.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542168 -lt 60129542167 2026-02-23T07:54:43.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:43.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:43.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:43.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:54:43.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:43.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:43.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:43.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:43.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:43.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:43.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:54:43.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:43.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:43.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:43.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:54:43.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:43.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:43.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:532: TEST_auto_repair_bluestore_basic: ceph pg dump pgs 2026-02-23T07:54:43.910 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:54:43.910 INFO:tasks.workunit.client.0.trial129.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-23T07:54:39.109588+0000 20'1 26:71 [1,0] 1 [1,0] 1 20'1 2026-02-23T07:54:39.108197+0000 20'1 2026-02-23T07:54:39.108197+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:54:39.108197+0000 1 0 2026-02-23T07:54:43.910 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:54:43.911 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:54:43.911 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:54:43.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:535: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2026-02-23T07:54:43.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:54:43.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:54:43.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:54:43.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:54:43.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:54:43.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:43.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:54:44.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:54:44.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:44.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:54:44.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:535: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:54:44.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:44.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:44.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:44.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:44.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:54:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:54:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:54:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:54:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:54:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-23T07:54:44.409 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:54:44.409 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:54:44.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T07:54:44.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:54:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:44.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:54:44.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:54:44.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:54:44.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:54:44.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:54:44.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:54:44.464 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:44.462+0000 7f5f8e2ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:44.466 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:44.464+0000 7f5f8e2ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:44.466 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:44.465+0000 7f5f8e2ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:44.652 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:44.650+0000 7f5f8e2ba780 -1 Falling back to public interface 2026-02-23T07:54:44.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:45.031 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:45.029+0000 7f5f8e2ba780 -1 osd.0 26 log_to_monitors true 2026-02-23T07:54:45.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:54:45.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:45.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:54:45.784 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:45.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:45.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:45.951 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 30 up_thru 0 down_at 27 last_clean_interval [24,26) [v2:127.0.0.1:6800/144953738,v1:127.0.0.1:6801/144953738] [v2:127.0.0.1:6802/144953738,v1:127.0.0.1:6803/144953738] exists,up ddac06cd-2df5-4af3-8cc3-9407592a8a91 2026-02-23T07:54:45.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:54:45.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:54:45.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:54:45.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:54:45.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:45.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:45.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:46.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:46.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:46.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:46.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:46.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:46.193 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:46.193 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:54:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:46.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:46.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:46.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018883 2026-02-23T07:54:46.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018883 2026-02-23T07:54:46.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883' 2026-02-23T07:54:46.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:46.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:46.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705696 2026-02-23T07:54:46.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705696 2026-02-23T07:54:46.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883 1-38654705696' 2026-02-23T07:54:46.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:46.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:54:46.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542173 2026-02-23T07:54:46.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542173 2026-02-23T07:54:46.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018883 1-38654705696 2-60129542173' 2026-02-23T07:54:46.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:46.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-128849018883 2026-02-23T07:54:46.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:46.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:46.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-128849018883 2026-02-23T07:54:46.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:46.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018883 2026-02-23T07:54:46.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 128849018883' 2026-02-23T07:54:46.419 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 128849018883 2026-02-23T07:54:46.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:46.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 128849018883 2026-02-23T07:54:46.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:47.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 128849018883 2026-02-23T07:54:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:48.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:54:48.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018883 2026-02-23T07:54:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:48.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705696 2026-02-23T07:54:48.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:48.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:48.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705696 2026-02-23T07:54:48.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:48.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705696 2026-02-23T07:54:48.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705696' 2026-02-23T07:54:48.922 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705696 2026-02-23T07:54:48.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:49.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705697 -lt 38654705696 2026-02-23T07:54:49.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:49.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542173 2026-02-23T07:54:49.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:49.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:54:49.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542173 2026-02-23T07:54:49.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:49.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542173 2026-02-23T07:54:49.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542173' 2026-02-23T07:54:49.093 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542173 2026-02-23T07:54:49.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:54:49.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542175 -lt 60129542173 2026-02-23T07:54:49.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:49.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:49.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:49.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:54:49.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:49.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:49.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:49.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:49.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:49.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:49.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:49.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:54:49.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:49.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:49.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:54:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:49.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:49.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:536: TEST_auto_repair_bluestore_basic: get_not_primary testpool SOMETHING 2026-02-23T07:54:49.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:54:49.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:54:49.829 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:54:49.829 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:54:49.829 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:54:49.829 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:49.829 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:54:50.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:54:50.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:54:50.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:536: TEST_auto_repair_bluestore_basic: objectstore_tool td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:50.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:50.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:50.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:54:50.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T07:54:50.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:50.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:54:50.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:54:50.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:54:50.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:50.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:54:50.366 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:54:50.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:54:50.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:54:50.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:54:50.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:54:50.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:54:50.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:54:50.377 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:50.375+0000 7fe137616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:50.378 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:50.377+0000 7fe137616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:50.379 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:50.378+0000 7fe137616780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:50.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:54:50.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:50.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:50.568 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:50.565+0000 7fe137616780 -1 Falling back to public interface 2026-02-23T07:54:50.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:50.901 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:50.899+0000 7fe137616780 -1 osd.0 31 log_to_monitors true 2026-02-23T07:54:51.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:54:51.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:51.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:54:51.699 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:51.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:51.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 35 up_thru 0 down_at 32 last_clean_interval [30,31) [v2:127.0.0.1:6800/4127669615,v1:127.0.0.1:6801/4127669615] [v2:127.0.0.1:6802/4127669615,v1:127.0.0.1:6803/4127669615] exists,up ddac06cd-2df5-4af3-8cc3-9407592a8a91 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:54:51.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:54:51.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:54:51.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:54:51.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:54:51.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:54:51.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:54:51.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:54:51.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:54:51.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:54:51.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:54:51.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:54:51.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:54:52.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:54:52.115 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:54:52.115 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:54:52.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:54:52.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:52.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:54:52.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-23T07:54:52.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-23T07:54:52.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-23T07:54:52.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:52.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:54:52.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705703 2026-02-23T07:54:52.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705703 2026-02-23T07:54:52.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 1-38654705703' 2026-02-23T07:54:52.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:54:52.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:54:52.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542180 2026-02-23T07:54:52.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542180 2026-02-23T07:54:52.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 1-38654705703 2-60129542180' 2026-02-23T07:54:52.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:52.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-23T07:54:52.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:52.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:54:52.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-23T07:54:52.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-23T07:54:52.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-23T07:54:52.338 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 150323855363 2026-02-23T07:54:52.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:52.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-23T07:54:52.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:54:53.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:53.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-23T07:54:53.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:54:54.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:54:54.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:54:54.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855364 -lt 150323855363 2026-02-23T07:54:54.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:54.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705703 2026-02-23T07:54:54.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:54.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:54:54.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705703 2026-02-23T07:54:54.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:54.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705703 2026-02-23T07:54:54.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705703' 2026-02-23T07:54:54.845 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705703 2026-02-23T07:54:54.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:54:55.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705704 -lt 38654705703 2026-02-23T07:54:55.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:54:55.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542180 2026-02-23T07:54:55.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:54:55.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:54:55.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542180 2026-02-23T07:54:55.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:54:55.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542180 2026-02-23T07:54:55.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542180' 2026-02-23T07:54:55.016 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542180 2026-02-23T07:54:55.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:54:55.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542182 -lt 60129542180 2026-02-23T07:54:55.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:54:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:54:55.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:54:55.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:54:55.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:54:55.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:54:55.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:54:55.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:54:55.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:54:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:54:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:54:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:537: TEST_auto_repair_bluestore_basic: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:54:55.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:538: TEST_auto_repair_bluestore_basic: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-23T07:54:55.763 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:54:39.106+0000 7f5bdee506c0 10 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:54:55.763 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:54:39.106+0000 7f5bdee506c0 10 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:54:55.764 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:54:39.106+0000 7f5bdee506c0 15 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-23T07:54:55.764 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:54:39.106+0000 7f5bdee506c0 20 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish All may be fixed 2026-02-23T07:54:55.764 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:54:39.106+0000 7f5bdee506c0 19 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:54:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:54:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:54:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:54:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:54:55.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:55.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:55.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:55.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:55.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:54:55.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:54:55.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:54:55.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:54:55.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:54:55.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:54:55.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:55.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:54:55.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:54:55.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:55.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:54:55.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:54:55.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:54:55.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:54:55.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:55.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:55.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:54:55.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:54:55.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:54:55.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:54:55.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:54:55.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:54:55.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:54:55.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:54:55.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:55.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:54:55.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:54:55.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:54:55.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:54:55.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:54:55.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:54:55.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:54:55.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:55.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:55.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:54:55.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:54:55.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:54:55.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:54:55.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:54:55.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:55.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:55.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:54:55.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_failed td/osd-scrub-repair 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:598: TEST_auto_repair_bluestore_failed: local dir=td/osd-scrub-repair 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:599: TEST_auto_repair_bluestore_failed: local poolname=testpool 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:602: TEST_auto_repair_bluestore_failed: run_mon td/osd-scrub-repair a 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:54:55.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:54:55.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:54:55.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:54:55.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:54:55.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:55.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:55.917 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:55.917 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:55.918 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:55.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:55.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:54:55.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:54:55.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:54:55.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:54:55.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:54:55.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:55.939 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:55.940 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:54:55.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:54:55.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:54:55.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:54:55.999 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:54:56.000 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:54:56.000 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:56.000 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:56.000 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:54:56.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:54:56.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:603: TEST_auto_repair_bluestore_failed: run_mgr td/osd-scrub-repair x 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:54:56.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:54:56.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:54:56.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:56.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:56.151 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:56.151 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:56.151 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:56.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:56.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:54:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:54:56.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:606: TEST_auto_repair_bluestore_failed: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:54:56.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: seq 0 2 2026-02-23T07:54:56.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:608: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:56.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:56.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:54:56.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:54:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:54:56.174 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:54:56.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b8fc6821-8f17-45da-ab24-50f632ecdcf2' 2026-02-23T07:54:56.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:54:56.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDQB5xpazuoChAAdQzv8yNTq9cBoF3gc9hUzw== 2026-02-23T07:54:56.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDQB5xpazuoChAAdQzv8yNTq9cBoF3gc9hUzw=="}' 2026-02-23T07:54:56.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b8fc6821-8f17-45da-ab24-50f632ecdcf2 -i td/osd-scrub-repair/0/new.json 2026-02-23T07:54:56.268 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:56.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:54:56.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDQB5xpazuoChAAdQzv8yNTq9cBoF3gc9hUzw== --osd-uuid b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:54:56.292 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.290+0000 7fac0688d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:56.293 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.291+0000 7fac0688d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:56.294 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.292+0000 7fac0688d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:56.295 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.292+0000 7fac0688d780 -1 bdev(0x55d6d21cd400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:54:56.295 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.292+0000 7fac0688d780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:54:56.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:54:56.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:54:56.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:54:56.736 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:54:56.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:54:56.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:54:56.832 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:54:56.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:54:56.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:54:56.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:54:56.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:54:56.846 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.844+0000 7f5ab1d4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:56.848 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.846+0000 7f5ab1d4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:56.849 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:56.847+0000 7f5ab1d4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:56.924 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:56.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:56.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:56.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:57.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:57.039 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:57.036+0000 7f5ab1d4f780 -1 Falling back to public interface 2026-02-23T07:54:57.418 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:57.415+0000 7f5ab1d4f780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:54:58.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:54:58.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:58.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:54:58.020 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:54:58.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:58.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:54:58.112 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/843582359,v1:127.0.0.1:6801/843582359] [v2:127.0.0.1:6802/843582359,v1:127.0.0.1:6803/843582359] exists,up b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:54:58.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:54:58.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:54:58.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:54:58.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2026-02-23T07:54:58.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:608: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:54:58.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:54:58.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:54:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0bea919f-0565-428a-901b-811f86a11cfb 2026-02-23T07:54:58.121 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 0bea919f-0565-428a-901b-811f86a11cfb 2026-02-23T07:54:58.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0bea919f-0565-428a-901b-811f86a11cfb' 2026-02-23T07:54:58.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:54:58.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDSB5xpr85dBxAAKZCBApF8NXtYdCInpZMmcw== 2026-02-23T07:54:58.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDSB5xpr85dBxAAKZCBApF8NXtYdCInpZMmcw=="}' 2026-02-23T07:54:58.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0bea919f-0565-428a-901b-811f86a11cfb -i td/osd-scrub-repair/1/new.json 2026-02-23T07:54:58.215 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:54:58.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:54:58.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDSB5xpr85dBxAAKZCBApF8NXtYdCInpZMmcw== --osd-uuid 0bea919f-0565-428a-901b-811f86a11cfb 2026-02-23T07:54:58.239 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.237+0000 7f54ddb96780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:58.240 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.238+0000 7f54ddb96780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:58.241 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.239+0000 7f54ddb96780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:58.241 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.239+0000 7f54ddb96780 -1 bdev(0x560c53f3f400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:54:58.242 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.239+0000 7f54ddb96780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:54:58.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:54:58.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:54:58.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:54:58.646 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:54:58.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:54:58.856 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:54:58.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:54:58.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:54:58.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:54:58.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:54:58.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:54:58.870 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.868+0000 7f4fff169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:58.871 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.869+0000 7f4fff169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:58.872 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:58.870+0000 7f4fff169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:54:59.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:54:59.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:54:59.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:54:59.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:54:59.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:54:59.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:54:59.020 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:54:59.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:54:59.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:54:59.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:54:59.069 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:59.067+0000 7f4fff169780 -1 Falling back to public interface 2026-02-23T07:54:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:54:59.420 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:54:59.418+0000 7f4fff169780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:55:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:00.182 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:55:00.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:00.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:00.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:55:00.345 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1887205853,v1:127.0.0.1:6811/1887205853] [v2:127.0.0.1:6812/1887205853,v1:127.0.0.1:6813/1887205853] exists,up 0bea919f-0565-428a-901b-811f86a11cfb 2026-02-23T07:55:00.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:607: TEST_auto_repair_bluestore_failed: for id in $(seq 0 2) 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:608: TEST_auto_repair_bluestore_failed: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:55:00.346 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:55:00.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:55:00.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:55:00.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d854f4cb-50a5-4fa5-b101-e453d673c71e 2026-02-23T07:55:00.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d854f4cb-50a5-4fa5-b101-e453d673c71e' 2026-02-23T07:55:00.349 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 d854f4cb-50a5-4fa5-b101-e453d673c71e 2026-02-23T07:55:00.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:55:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDUB5xpsq9BFRAAnQWbnofbiO+pBgvLXvPUBw== 2026-02-23T07:55:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDUB5xpsq9BFRAAnQWbnofbiO+pBgvLXvPUBw=="}' 2026-02-23T07:55:00.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d854f4cb-50a5-4fa5-b101-e453d673c71e -i td/osd-scrub-repair/2/new.json 2026-02-23T07:55:00.516 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:55:00.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:55:00.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQDUB5xpsq9BFRAAnQWbnofbiO+pBgvLXvPUBw== --osd-uuid d854f4cb-50a5-4fa5-b101-e453d673c71e 2026-02-23T07:55:00.543 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:00.541+0000 7ffb5c596780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:00.544 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:00.542+0000 7ffb5c596780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:00.545 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:00.543+0000 7ffb5c596780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:00.545 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:00.543+0000 7ffb5c596780 -1 bdev(0x555ab529f400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:55:00.546 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:00.543+0000 7ffb5c596780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:55:00.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:55:00.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:55:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:55:00.964 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:55:00.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:55:01.171 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:55:01.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:55:01.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:01.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:55:01.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:55:01.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:55:01.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:01.184+0000 7f9ef1f71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:01.187 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:01.185+0000 7f9ef1f71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:01.188 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:01.186+0000 7f9ef1f71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:01.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:55:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:55:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:55:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:55:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:55:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:01.336 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:55:01.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:55:01.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:01.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:55:01.405 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:01.403+0000 7f9ef1f71780 -1 Falling back to public interface 2026-02-23T07:55:01.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:55:01.728 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:01.725+0000 7f9ef1f71780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:55:02.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:02.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:02.501 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:55:02.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:02.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:02.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:55:02.664 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3141177108,v1:127.0.0.1:6819/3141177108] [v2:127.0.0.1:6820/3141177108,v1:127.0.0.1:6821/3141177108] exists,up d854f4cb-50a5-4fa5-b101-e453d673c71e 2026-02-23T07:55:02.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:02.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:02.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:02.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:611: TEST_auto_repair_bluestore_failed: create_pool testpool 1 1 2026-02-23T07:55:02.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-23T07:55:02.907 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T07:55:02.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:55:03.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:612: TEST_auto_repair_bluestore_failed: ceph osd pool set testpool size 2 2026-02-23T07:55:04.126 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 2 2026-02-23T07:55:04.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:613: TEST_auto_repair_bluestore_failed: wait_for_clean 2026-02-23T07:55:04.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:04.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:04.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:04.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:04.139 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:04.139 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:04.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:04.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:04.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:04.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:04.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:04.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:04.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:04.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:04.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:04.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:04.388 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:04.388 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:04.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:04.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:04.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:04.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:55:04.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:55:04.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:55:04.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:04.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:04.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T07:55:04.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T07:55:04.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T07:55:04.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:04.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:04.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574850 2026-02-23T07:55:04.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574850 2026-02-23T07:55:04.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-55834574850' 2026-02-23T07:55:04.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:04.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:55:04.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:04.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:04.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:55:04.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:04.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:55:04.615 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:55:04.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:55:04.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:04.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:55:04.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:05.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:05.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:55:05.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:06.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:55:06.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:07.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:55:07.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:07.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T07:55:07.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:07.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:07.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T07:55:07.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:07.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T07:55:07.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T07:55:07.119 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T07:55:07.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:07.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705667 2026-02-23T07:55:07.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:07.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574850 2026-02-23T07:55:07.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:07.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:07.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574850 2026-02-23T07:55:07.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:07.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574850 2026-02-23T07:55:07.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574850' 2026-02-23T07:55:07.291 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574850 2026-02-23T07:55:07.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:07.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574850 -lt 55834574850 2026-02-23T07:55:07.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:07.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:07.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:07.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:07.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:07.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:07.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:07.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:07.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:07.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:07.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:07.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:07.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:07.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:07.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:616: TEST_auto_repair_bluestore_failed: local payload=ABCDEF 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:617: TEST_auto_repair_bluestore_failed: echo ABCDEF 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: seq 1 10 2026-02-23T07:55:08.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:618: TEST_auto_repair_bluestore_failed: for i in $(seq 1 10) 2026-02-23T07:55:08.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:620: TEST_auto_repair_bluestore_failed: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:55:08.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:625: TEST_auto_repair_bluestore_failed: get_not_primary testpool SOMETHING 2026-02-23T07:55:08.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:55:08.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:55:08.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:55:08.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:55:08.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:55:08.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:55:08.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:55:08.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:55:08.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:55:08.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:625: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 0 obj1 remove 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj1 remove 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:55:08.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:55:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:55:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:55:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj1 remove 2026-02-23T07:55:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:55:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:55:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:55:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:55:08.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:55:08.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj1 remove 2026-02-23T07:55:08.935 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-23T07:55:08.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:08.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:55:08.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:55:08.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:55:08.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:55:08.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:08.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:55:08.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:55:08.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:55:08.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:55:08.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:55:09.003 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:09.001+0000 7fc7d0b8c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:09.004 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:09.002+0000 7fc7d0b8c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:09.005 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:09.003+0000 7fc7d0b8c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:09.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:55:09.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:55:09.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:55:09.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:55:09.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:55:09.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:09.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:55:09.157 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:55:09.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:09.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:55:09.223 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:09.220+0000 7fc7d0b8c780 -1 Falling back to public interface 2026-02-23T07:55:09.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:55:09.524 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:09.522+0000 7fc7d0b8c780 -1 osd.0 19 log_to_monitors true 2026-02-23T07:55:10.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:10.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:10.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:10.323 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:10.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:10.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:55:10.490 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 23 up_thru 0 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/828342262,v1:127.0.0.1:6801/828342262] [v2:127.0.0.1:6802/828342262,v1:127.0.0.1:6803/828342262] exists,up b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:55:10.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:10.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:10.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:10.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:10.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:10.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:10.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:10.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:10.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:10.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:10.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:10.727 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:10.727 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:10.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:10.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:10.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247810 2026-02-23T07:55:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247810 2026-02-23T07:55:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810' 2026-02-23T07:55:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:10.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:10.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T07:55:10.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T07:55:10.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-38654705670' 2026-02-23T07:55:10.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:10.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:10.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-23T07:55:10.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-23T07:55:10.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-38654705670 2-55834574852' 2026-02-23T07:55:10.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:10.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247810 2026-02-23T07:55:10.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:10.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:10.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247810 2026-02-23T07:55:10.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:10.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247810 2026-02-23T07:55:10.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247810' 2026-02-23T07:55:10.952 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 98784247810 2026-02-23T07:55:10.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:11.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247810 2026-02-23T07:55:11.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:12.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:12.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:12.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 98784247810 2026-02-23T07:55:12.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:12.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T07:55:12.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:12.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:12.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T07:55:12.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:12.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T07:55:12.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T07:55:12.285 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705670 2026-02-23T07:55:12.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:12.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-23T07:55:12.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:12.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574852 2026-02-23T07:55:12.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:12.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:12.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-23T07:55:12.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:12.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574852 2026-02-23T07:55:12.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-23T07:55:12.450 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574852 2026-02-23T07:55:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:12.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-23T07:55:12.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:12.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:12.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:12.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:12.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:12.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:12.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:12.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:12.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:13.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:13.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:13.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:13.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:627: TEST_auto_repair_bluestore_failed: get_not_primary testpool SOMETHING 2026-02-23T07:55:13.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:55:13.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:55:13.183 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:55:13.183 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:55:13.183 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:55:13.183 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:55:13.183 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:55:13.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:55:13.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:55:13.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:55:13.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:627: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 0 obj2 remove 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj2 remove 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:55:13.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:55:13.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:55:13.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:55:13.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:55:13.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:55:13.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:55:13.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:55:13.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-23T07:55:13.941 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:104778fc:::obj2:head# 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:55:13.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:55:14.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:55:14.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:55:14.001 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:55:14.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:14.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:55:14.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:55:14.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:55:14.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:55:14.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:55:14.014 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:14.012+0000 7f9420213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:14.015 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:14.013+0000 7f9420213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:14.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:14.014+0000 7f9420213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:14.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:55:14.169 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:55:14.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:14.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:55:14.187 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:14.185+0000 7f9420213780 -1 Falling back to public interface 2026-02-23T07:55:14.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:55:14.605 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:14.602+0000 7f9420213780 -1 osd.0 25 log_to_monitors true 2026-02-23T07:55:15.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:15.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:15.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:15.334 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:15.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:15.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:55:15.502 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 26 last_clean_interval [23,25) [v2:127.0.0.1:6800/1779599667,v1:127.0.0.1:6801/1779599667] [v2:127.0.0.1:6802/1779599667,v1:127.0.0.1:6803/1779599667] exists,up b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:55:15.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:15.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:15.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:15.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:55:15.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:15.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:15.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:15.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:15.503 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:15.503 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:15.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:15.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:15.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:15.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:15.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:15.744 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:15.744 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:15.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:15.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:15.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:15.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051586 2026-02-23T07:55:15.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051586 2026-02-23T07:55:15.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586' 2026-02-23T07:55:15.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:15.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:15.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-23T07:55:15.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-23T07:55:15.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-38654705672' 2026-02-23T07:55:15.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:15.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:15.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-23T07:55:15.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-23T07:55:15.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-38654705672 2-55834574854' 2026-02-23T07:55:15.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:15.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051586 2026-02-23T07:55:15.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:15.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:15.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051586 2026-02-23T07:55:15.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:15.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051586 2026-02-23T07:55:15.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051586' 2026-02-23T07:55:15.970 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 124554051586 2026-02-23T07:55:15.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:16.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 124554051586 2026-02-23T07:55:16.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:17.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:17.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:17.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051586 2026-02-23T07:55:17.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:17.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-23T07:55:17.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:17.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:17.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-23T07:55:17.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:17.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-23T07:55:17.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-23T07:55:17.306 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705672 2026-02-23T07:55:17.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:17.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-23T07:55:17.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:17.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574854 2026-02-23T07:55:17.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:17.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:17.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-23T07:55:17.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:17.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574854 2026-02-23T07:55:17.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-23T07:55:17.474 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574854 2026-02-23T07:55:17.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:17.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-23T07:55:17.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:17.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:17.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:17.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:17.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:18.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:18.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:18.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:18.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:628: TEST_auto_repair_bluestore_failed: get_primary testpool SOMETHING 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:55:18.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:628: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:55:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:55:18.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:55:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:55:18.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj2 rm-attr _ 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:55:18.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:55:18.856 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:55:18.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:55:18.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:55:18.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:55:18.858 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:55:18.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:18.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:55:18.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:55:18.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:55:18.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:55:18.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:55:18.867 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:18.865+0000 7f5e1aa7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:18.868 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:18.866+0000 7f5e1aa7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:18.869 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:18.867+0000 7f5e1aa7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:19.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:55:19.024 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:55:19.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:19.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:55:19.056 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:19.054+0000 7f5e1aa7b780 -1 Falling back to public interface 2026-02-23T07:55:19.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:55:19.385 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:19.383+0000 7f5e1aa7b780 -1 osd.1 30 log_to_monitors true 2026-02-23T07:55:20.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:20.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:20.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:20.194 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:20.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:20.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 34 up_thru 34 down_at 31 last_clean_interval [9,30) [v2:127.0.0.1:6810/1750140077,v1:127.0.0.1:6811/1750140077] [v2:127.0.0.1:6812/1750140077,v1:127.0.0.1:6813/1750140077] exists,up 0bea919f-0565-428a-901b-811f86a11cfb 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:20.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:20.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:20.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:20.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:20.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:20.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:20.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:20.601 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:20.601 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:20.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:20.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:20.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:20.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051588 2026-02-23T07:55:20.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051588 2026-02-23T07:55:20.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588' 2026-02-23T07:55:20.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:20.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:20.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888066 2026-02-23T07:55:20.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888066 2026-02-23T07:55:20.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-146028888066' 2026-02-23T07:55:20.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:20.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:20.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574856 2026-02-23T07:55:20.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574856 2026-02-23T07:55:20.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051588 1-146028888066 2-55834574856' 2026-02-23T07:55:20.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:20.824 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051588 2026-02-23T07:55:20.824 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:20.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:20.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051588 2026-02-23T07:55:20.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:20.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051588 2026-02-23T07:55:20.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051588' 2026-02-23T07:55:20.826 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 124554051588 2026-02-23T07:55:20.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:20.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051587 -lt 124554051588 2026-02-23T07:55:20.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:21.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:21.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:22.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051587 -lt 124554051588 2026-02-23T07:55:22.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:23.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:55:23.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:23.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051588 -lt 124554051588 2026-02-23T07:55:23.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:23.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888066 2026-02-23T07:55:23.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:23.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:23.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888066 2026-02-23T07:55:23.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:23.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888066 2026-02-23T07:55:23.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888066' 2026-02-23T07:55:23.330 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 146028888066 2026-02-23T07:55:23.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:23.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888066 -lt 146028888066 2026-02-23T07:55:23.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:23.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574856 2026-02-23T07:55:23.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:23.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:23.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574856 2026-02-23T07:55:23.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:23.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574856 2026-02-23T07:55:23.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2026-02-23T07:55:23.499 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574856 2026-02-23T07:55:23.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:23.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574856 2026-02-23T07:55:23.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:23.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:23.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:24.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:24.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:24.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:24.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:24.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:24.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:24.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:630: TEST_auto_repair_bluestore_failed: get_pg testpool obj1 2026-02-23T07:55:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T07:55:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-23T07:55:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-23T07:55:24.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:55:24.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:630: TEST_auto_repair_bluestore_failed: local pgid=1.0 2026-02-23T07:55:24.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:631: TEST_auto_repair_bluestore_failed: get_primary testpool obj1 2026-02-23T07:55:24.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:55:24.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T07:55:24.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T07:55:24.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:55:24.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:631: TEST_auto_repair_bluestore_failed: local primary=1 2026-02-23T07:55:24.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:632: TEST_auto_repair_bluestore_failed: get_last_scrub_stamp 1.0 2026-02-23T07:55:24.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:24.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:24.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:24.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:24.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:632: TEST_auto_repair_bluestore_failed: local last_scrub_stamp=2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:24.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:633: TEST_auto_repair_bluestore_failed: ceph tell 1.0 schedule-deep-scrub 2026-02-23T07:55:24.798 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:55:24.798 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:55:24.798 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T07:55:24.798 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-12T03:07:14.797676+0000" 2026-02-23T07:55:24.798 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:636: TEST_auto_repair_bluestore_failed: wait_for_scrub 1.0 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:24.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:24.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:02.904493+0000 '>' 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:24.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:25.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:25.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:25.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:25.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:25.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:25.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:25.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:26.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:02.904493+0000 '>' 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:26.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:27.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:27.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:27.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:27.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:27.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:27.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:27.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:27.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:02.904493+0000 '>' 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:27.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:28.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:28.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:28.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:28.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:28.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:28.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:28.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:28.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:02.904493+0000 '>' 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:28.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:29.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:29.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:29.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:29.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:29.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:29.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:29.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:02.904493+0000 '>' 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:29.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:30.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:30.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:30.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:30.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:30.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:30.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:30.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:30.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:26.442353+0000 '>' 2026-02-23T07:55:02.904493+0000 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:637: TEST_auto_repair_bluestore_failed: wait_for_clean 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:30.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:30.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:30.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:30.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:30.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:30.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:30.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:30.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:30.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:31.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:31.051 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:31.051 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:31.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:31.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:31.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:31.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051591 2026-02-23T07:55:31.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051591 2026-02-23T07:55:31.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051591' 2026-02-23T07:55:31.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:31.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:31.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888069 2026-02-23T07:55:31.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888069 2026-02-23T07:55:31.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051591 1-146028888069' 2026-02-23T07:55:31.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:31.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:31.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574859 2026-02-23T07:55:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574859 2026-02-23T07:55:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051591 1-146028888069 2-55834574859' 2026-02-23T07:55:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051591 2026-02-23T07:55:31.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:31.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:31.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051591 2026-02-23T07:55:31.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:31.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051591 2026-02-23T07:55:31.273 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 124554051591 2026-02-23T07:55:31.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051591' 2026-02-23T07:55:31.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:31.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051590 -lt 124554051591 2026-02-23T07:55:31.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:32.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:32.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:32.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051591 -lt 124554051591 2026-02-23T07:55:32.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:32.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888069 2026-02-23T07:55:32.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:32.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:32.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888069 2026-02-23T07:55:32.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:32.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888069 2026-02-23T07:55:32.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888069' 2026-02-23T07:55:32.610 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 146028888069 2026-02-23T07:55:32.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:32.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888069 -lt 146028888069 2026-02-23T07:55:32.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:32.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574859 2026-02-23T07:55:32.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:32.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:32.778 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574859 2026-02-23T07:55:32.778 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:32.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574859 2026-02-23T07:55:32.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574859' 2026-02-23T07:55:32.779 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574859 2026-02-23T07:55:32.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:32.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574859 -lt 55834574859 2026-02-23T07:55:32.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:32.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:32.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:33.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:33.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:33.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:33.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:33.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:33.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:33.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:33.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:33.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:33.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:638: TEST_auto_repair_bluestore_failed: flush_pg_stats 2026-02-23T07:55:33.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:33.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:33.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:33.682 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:33.682 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:33.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:33.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:33.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:33.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051592 2026-02-23T07:55:33.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051592 2026-02-23T07:55:33.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051592' 2026-02-23T07:55:33.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:33.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:33.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888070 2026-02-23T07:55:33.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888070 2026-02-23T07:55:33.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051592 1-146028888070' 2026-02-23T07:55:33.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:33.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:33.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574861 2026-02-23T07:55:33.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574861 2026-02-23T07:55:33.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051592 1-146028888070 2-55834574861' 2026-02-23T07:55:33.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:33.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051592 2026-02-23T07:55:33.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:33.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:33.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051592 2026-02-23T07:55:33.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:33.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051592 2026-02-23T07:55:33.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051592' 2026-02-23T07:55:33.909 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 124554051592 2026-02-23T07:55:33.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:34.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051591 -lt 124554051592 2026-02-23T07:55:34.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:35.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:35.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:35.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051592 -lt 124554051592 2026-02-23T07:55:35.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:35.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888070 2026-02-23T07:55:35.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:35.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:35.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888070 2026-02-23T07:55:35.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:35.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888070 2026-02-23T07:55:35.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888070' 2026-02-23T07:55:35.250 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 146028888070 2026-02-23T07:55:35.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888070 -lt 146028888070 2026-02-23T07:55:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:35.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574861 2026-02-23T07:55:35.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:35.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:35.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574861 2026-02-23T07:55:35.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:35.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574861 2026-02-23T07:55:35.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574861' 2026-02-23T07:55:35.420 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574861 2026-02-23T07:55:35.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574861 -lt 55834574861 2026-02-23T07:55:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:639: TEST_auto_repair_bluestore_failed: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-23T07:55:35.585 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 15 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 5 errors. 2 errors fixed 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 20 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: setting for deep-scrub-after-repair (5 errors. 2 errors fixed) 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 19 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish before flags: CHECK_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 19 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:35.586 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+failed_repair(after-repair)] scrubber: scrub_finish 3 error(s) still present after re-scrub 2026-02-23T07:55:35.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:640: TEST_auto_repair_bluestore_failed: grep -q 'scrub_finish.*still present after re-scrub' td/osd-scrub-repair/osd.1.log 2026-02-23T07:55:35.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:641: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-23T07:55:35.738 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:55:35.739 INFO:tasks.workunit.client.0.trial129.stdout:1.0 10 0 0 0 0 63 0 0 10 0 10 active+clean+inconsistent+failed_repair 2026-02-23T07:55:26.442390+0000 19'10 36:113 [1,0] 1 [1,0] 1 19'10 2026-02-23T07:55:26.442353+0000 19'10 2026-02-23T07:55:26.442353+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:55:26.442353+0000 10 0 2026-02-23T07:55:35.739 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:55:35.739 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:55:35.740 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:55:35.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:642: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-23T07:55:35.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:642: TEST_auto_repair_bluestore_failed: grep -q '^1.0.*+failed_repair' 2026-02-23T07:55:35.902 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:55:35.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:646: TEST_auto_repair_bluestore_failed: get_not_primary testpool obj1 2026-02-23T07:55:35.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:55:35.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-23T07:55:35.915 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool obj1 2026-02-23T07:55:35.915 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:55:35.915 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T07:55:35.915 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T07:55:35.915 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:55:36.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:55:36.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool obj1 2026-02-23T07:55:36.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:55:36.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:646: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 0 obj1 list-attrs 2026-02-23T07:55:36.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj1 list-attrs 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:55:36.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:55:36.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:55:36.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:55:36.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:55:36.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:55:36.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:55:36.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj1 list-attrs 2026-02-23T07:55:36.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:55:36.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:55:36.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:55:36.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:55:36.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:55:36.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj1 list-attrs 2026-02-23T07:55:36.608 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:55:36.609 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:55:36.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:36.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:55:36.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:55:36.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:55:36.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:55:36.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:55:36.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:55:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:36.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:55:36.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:55:36.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:55:36.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:55:36.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:55:36.665 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:36.663+0000 7f706f018780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:36.666 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:36.664+0000 7f706f018780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:36.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:36.665+0000 7f706f018780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:36.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:55:36.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:55:36.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:55:36.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:55:36.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:55:36.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:36.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:55:36.820 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:55:36.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:36.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:55:36.853 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:36.851+0000 7f706f018780 -1 Falling back to public interface 2026-02-23T07:55:36.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:55:37.196 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:37.194+0000 7f706f018780 -1 osd.0 37 log_to_monitors true 2026-02-23T07:55:37.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:37.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:37.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:37.986 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:37.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:37.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:55:38.152 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 40 up_thru 31 down_at 37 last_clean_interval [29,37) [v2:127.0.0.1:6800/3580681262,v1:127.0.0.1:6801/3580681262] [v2:127.0.0.1:6802/3580681262,v1:127.0.0.1:6803/3580681262] exists,up b8fc6821-8f17-45da-ab24-50f632ecdcf2 2026-02-23T07:55:38.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:38.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:38.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:38.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:38.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:38.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:38.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:38.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:38.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:38.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:38.395 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:38.395 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:38.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:38.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:38.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:38.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691842 2026-02-23T07:55:38.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691842 2026-02-23T07:55:38.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691842' 2026-02-23T07:55:38.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:38.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:38.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888072 2026-02-23T07:55:38.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888072 2026-02-23T07:55:38.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691842 1-146028888072' 2026-02-23T07:55:38.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:38.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:38.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574863 2026-02-23T07:55:38.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574863 2026-02-23T07:55:38.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691842 1-146028888072 2-55834574863' 2026-02-23T07:55:38.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:38.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-171798691842 2026-02-23T07:55:38.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:38.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:38.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-171798691842 2026-02-23T07:55:38.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:38.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691842 2026-02-23T07:55:38.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 171798691842' 2026-02-23T07:55:38.619 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 171798691842 2026-02-23T07:55:38.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 171798691842 2026-02-23T07:55:38.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:39.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:39.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:39.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 171798691842 2026-02-23T07:55:39.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:40.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:55:40.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:41.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691842 -lt 171798691842 2026-02-23T07:55:41.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:41.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-146028888072 2026-02-23T07:55:41.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:41.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:41.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-146028888072 2026-02-23T07:55:41.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:41.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888072 2026-02-23T07:55:41.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 146028888072' 2026-02-23T07:55:41.130 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 146028888072 2026-02-23T07:55:41.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:41.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888073 -lt 146028888072 2026-02-23T07:55:41.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:41.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574863 2026-02-23T07:55:41.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:41.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:41.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574863 2026-02-23T07:55:41.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:41.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574863 2026-02-23T07:55:41.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574863' 2026-02-23T07:55:41.295 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574863 2026-02-23T07:55:41.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:41.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574863 -lt 55834574863 2026-02-23T07:55:41.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:41.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:41.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:41.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:41.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:41.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:41.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:41.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:41.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:41.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:41.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:41.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:41.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:41.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:41.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:42.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:42.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:42.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:42.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:647: TEST_auto_repair_bluestore_failed: rados --pool testpool get obj1 td/osd-scrub-repair/COPY 2026-02-23T07:55:42.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:648: TEST_auto_repair_bluestore_failed: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:55:42.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:649: TEST_auto_repair_bluestore_failed: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-23T07:55:42.045 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:55:42.045 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:55:42.045 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 15 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 5 errors. 2 errors fixed 2026-02-23T07:55:42.045 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 20 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: setting for deep-scrub-after-repair (5 errors. 2 errors fixed) 2026-02-23T07:55:42.046 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 19 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:42.046 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish before flags: CHECK_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:55:42.046 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-23T07:55:42.046 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 19 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:42.046 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+failed_repair(after-repair)] scrubber: scrub_finish 3 error(s) still present after re-scrub 2026-02-23T07:55:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:652: TEST_auto_repair_bluestore_failed: get_primary testpool SOMETHING 2026-02-23T07:55:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:55:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:55:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:55:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:55:42.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:652: TEST_auto_repair_bluestore_failed: objectstore_tool td/osd-scrub-repair 1 obj2 remove 2026-02-23T07:55:42.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:55:42.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:55:42.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:55:42.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj2 remove 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:55:42.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:55:42.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:55:42.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj2 remove 2026-02-23T07:55:42.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:55:42.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:55:42.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:55:42.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:55:42.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:55:42.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj2 remove 2026-02-23T07:55:42.646 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:104778fc:::obj2:head#, (61) No data available 2026-02-23T07:55:42.647 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:104778fc:::obj2:head# 2026-02-23T07:55:42.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:42.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:55:42.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:55:42.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:55:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:55:42.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:55:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:55:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:55:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:55:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:55:42.720 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:42.717+0000 7efc9cc08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:42.721 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:42.719+0000 7efc9cc08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:42.722 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:42.720+0000 7efc9cc08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:55:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:42.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:55:42.927 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:42.924+0000 7efc9cc08780 -1 Falling back to public interface 2026-02-23T07:55:43.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:55:43.318 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:55:43.316+0000 7efc9cc08780 -1 osd.1 41 log_to_monitors true 2026-02-23T07:55:44.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:55:44.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:55:44.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:55:44.050 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:44.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:55:44.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:55:44.215 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 42 last_clean_interval [34,41) [v2:127.0.0.1:6810/1493487456,v1:127.0.0.1:6811/1493487456] [v2:127.0.0.1:6812/1493487456,v1:127.0.0.1:6813/1493487456] exists,up 0bea919f-0565-428a-901b-811f86a11cfb 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:55:44.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:55:44.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:55:44.217 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:55:44.218 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:55:44.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:55:44.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:55:44.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:55:44.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:55:44.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:55:44.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:55:44.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:55:44.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:44.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:44.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:44.458 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:44.458 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:44.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:44.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:44.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:44.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691844 2026-02-23T07:55:44.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691844 2026-02-23T07:55:44.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691844' 2026-02-23T07:55:44.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:44.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528322 2026-02-23T07:55:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528322 2026-02-23T07:55:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691844 1-193273528322' 2026-02-23T07:55:44.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:44.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:44.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574865 2026-02-23T07:55:44.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574865 2026-02-23T07:55:44.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691844 1-193273528322 2-55834574865' 2026-02-23T07:55:44.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:44.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-171798691844 2026-02-23T07:55:44.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:44.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:44.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-171798691844 2026-02-23T07:55:44.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:44.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691844 2026-02-23T07:55:44.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 171798691844' 2026-02-23T07:55:44.679 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 171798691844 2026-02-23T07:55:44.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:44.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691843 -lt 171798691844 2026-02-23T07:55:44.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:45.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:45.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:46.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691843 -lt 171798691844 2026-02-23T07:55:46.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:47.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:55:47.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:47.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691844 -lt 171798691844 2026-02-23T07:55:47.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:47.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-193273528322 2026-02-23T07:55:47.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:47.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:47.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-193273528322 2026-02-23T07:55:47.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:47.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528322 2026-02-23T07:55:47.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 193273528322' 2026-02-23T07:55:47.182 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 193273528322 2026-02-23T07:55:47.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:47.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528322 -lt 193273528322 2026-02-23T07:55:47.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:47.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574865 2026-02-23T07:55:47.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:47.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:47.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574865 2026-02-23T07:55:47.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:47.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574865 2026-02-23T07:55:47.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574865' 2026-02-23T07:55:47.349 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574865 2026-02-23T07:55:47.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574865 -lt 55834574865 2026-02-23T07:55:47.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:55:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:47.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:55:47.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:55:47.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:55:47.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:55:47.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:55:47.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:55:47.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:55:47.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:55:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:55:47.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:55:47.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:55:47.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:653: TEST_auto_repair_bluestore_failed: repair 1.0 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:48.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:48.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:48.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:48.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-23T07:55:48.400 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T07:55:48.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:48.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:48.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:48.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:26.442353+0000 '>' 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:48.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:49.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:49.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:49.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:49.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:49.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:49.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:26.442353+0000 '>' 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:49.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:50.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:50.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:50.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:50.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:50.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:50.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:50.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:50.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:26.442353+0000 '>' 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:50.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:51.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:51.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:51.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:51.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:51.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:51.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:51.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:52.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:26.442353+0000 '>' 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:52.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:53.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:53.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:53.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:53.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:53.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:53.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:53.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:53.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:26.442353+0000 '>' 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:53.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:55:54.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:55:54.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:55:54.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:55:54.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:55:54.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:55:54.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:55:54.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:55:54.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:55:49.271678+0000 '>' 2026-02-23T07:55:26.442353+0000 2026-02-23T07:55:54.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:55:54.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:654: TEST_auto_repair_bluestore_failed: sleep 2 2026-02-23T07:55:56.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:656: TEST_auto_repair_bluestore_failed: flush_pg_stats 2026-02-23T07:55:56.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:55:56.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:55:56.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:55:56.570 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:55:56.570 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:55:56.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:55:56.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:56.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:55:56.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691847 2026-02-23T07:55:56.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691847 2026-02-23T07:55:56.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691847' 2026-02-23T07:55:56.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:56.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:55:56.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528325 2026-02-23T07:55:56.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528325 2026-02-23T07:55:56.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691847 1-193273528325' 2026-02-23T07:55:56.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:55:56.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:55:56.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574868 2026-02-23T07:55:56.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574868 2026-02-23T07:55:56.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-171798691847 1-193273528325 2-55834574868' 2026-02-23T07:55:56.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:56.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-171798691847 2026-02-23T07:55:56.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:56.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:55:56.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-171798691847 2026-02-23T07:55:56.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:56.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691847 2026-02-23T07:55:56.794 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 171798691847 2026-02-23T07:55:56.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 171798691847' 2026-02-23T07:55:56.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:56.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691846 -lt 171798691847 2026-02-23T07:55:56.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:57.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:55:57.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:58.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691846 -lt 171798691847 2026-02-23T07:55:58.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:55:59.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:55:59.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:55:59.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691848 -lt 171798691847 2026-02-23T07:55:59.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:59.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-193273528325 2026-02-23T07:55:59.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:59.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:55:59.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-193273528325 2026-02-23T07:55:59.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528325 2026-02-23T07:55:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 193273528325' 2026-02-23T07:55:59.301 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 193273528325 2026-02-23T07:55:59.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:55:59.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528325 -lt 193273528325 2026-02-23T07:55:59.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:55:59.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574868 2026-02-23T07:55:59.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:55:59.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:55:59.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574868 2026-02-23T07:55:59.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:55:59.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574868 2026-02-23T07:55:59.470 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574868 2026-02-23T07:55:59.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574868' 2026-02-23T07:55:59.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:55:59.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574869 -lt 55834574868 2026-02-23T07:55:59.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:657: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-23T07:55:59.788 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:55:59.788 INFO:tasks.workunit.client.0.trial129.stdout:1.0 9 0 0 0 0 63 0 0 10 0 10 active+clean 2026-02-23T07:55:49.271711+0000 19'10 46:152 [1,0] 1 [1,0] 1 19'10 2026-02-23T07:55:49.271678+0000 19'10 2026-02-23T07:55:49.271678+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:55:49.271678+0000 9 0 2026-02-23T07:55:59.788 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:55:59.788 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:55:59.789 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:55:59.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:658: TEST_auto_repair_bluestore_failed: ceph pg dump pgs 2026-02-23T07:55:59.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:658: TEST_auto_repair_bluestore_failed: grep -q -e '^1.0.* active+clean ' -e '^1.0.* active+clean+wait ' 2026-02-23T07:55:59.955 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:55:59.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:659: TEST_auto_repair_bluestore_failed: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-23T07:55:59.968 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 15 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 5 errors. 2 errors fixed 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 20 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: setting for deep-scrub-after-repair (5 errors. 2 errors fixed) 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:25.438+0000 7f5df8cf76c0 19 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish before flags: CHECK_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 19 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent(after-repair,check-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:59.969 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:26.440+0000 7f5df8cf76c0 10 osd.1 pg_epoch: 36 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=34/36 n=10 ec=15/15 lis/c=34/34 les/c/f=36/36/0 sis=34) [1,0] r=0 lpr=34 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+failed_repair(after-repair)] scrubber: scrub_finish 3 error(s) still present after re-scrub 2026-02-23T07:55:59.970 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:49.270+0000 7efc7e2966c0 10 osd.1 pg_epoch: 46 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=45/46 n=10 ec=15/15 lis/c=45/45 les/c/f=46/46/0 sis=45) [1,0] r=0 lpr=45 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: repair. deep_scrub_on_error: 0 2026-02-23T07:55:59.970 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:49.270+0000 7efc7e2966c0 10 osd.1 pg_epoch: 46 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=45/46 n=10 ec=15/15 lis/c=45/45 les/c/f=46/46/0 sis=45) [1,0] r=0 lpr=45 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:55:59.970 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:49.270+0000 7efc7e2966c0 15 osd.1 pg_epoch: 46 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=45/46 n=9 ec=15/15 lis/c=45/45 les/c/f=46/46/0 sis=45) [1,0] r=0 lpr=45 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-23T07:55:59.970 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:49.270+0000 7efc7e2966c0 20 osd.1 pg_epoch: 46 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=45/46 n=9 ec=15/15 lis/c=45/45 les/c/f=46/46/0 sis=45) [1,0] r=0 lpr=45 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish All may be fixed 2026-02-23T07:55:59.970 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:55:49.270+0000 7efc7e2966c0 19 osd.1 pg_epoch: 46 pg[1.0( v 19'10 (0'0,19'10] local-lis/les=45/46 n=9 ec=15/15 lis/c=45/45 les/c/f=46/46/0 sis=45) [1,0] r=0 lpr=45 crt=19'10 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+repair(must-repair,auto-repair)] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:55:59.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:55:59.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:55:59.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:55:59.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:55:59.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:55:59.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:55:59.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:55:59.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:55:59.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:00.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:00.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:56:00.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:56:00.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:56:00.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:56:00.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:56:00.079 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:56:00.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:00.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:56:00.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:56:00.080 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:00.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:56:00.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:56:00.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:56:00.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:56:00.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:00.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:00.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:00.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:00.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:00.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:00.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:56:00.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:56:00.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:56:00.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:56:00.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:56:00.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:56:00.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:00.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:56:00.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:56:00.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:00.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:56:00.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:56:00.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:56:00.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:56:00.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:56:00.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:56:00.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:56:00.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:56:00.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:56:00.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_failed_norecov td/osd-scrub-repair 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:663: TEST_auto_repair_bluestore_failed_norecov: local dir=td/osd-scrub-repair 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:664: TEST_auto_repair_bluestore_failed_norecov: local poolname=testpool 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:667: TEST_auto_repair_bluestore_failed_norecov: run_mon td/osd-scrub-repair a 2026-02-23T07:56:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:56:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:56:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:56:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:56:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:56:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:00.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:56:00.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:56:00.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:56:00.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:56:00.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:56:00.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:56:00.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:56:00.147 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:56:00.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:56:00.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:56:00.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:56:00.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:56:00.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:56:00.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:56:00.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:56:00.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:668: TEST_auto_repair_bluestore_failed_norecov: run_mgr td/osd-scrub-repair x 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:56:00.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:56:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:56:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:00.357 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:00.357 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.358 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:00.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:56:00.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:56:00.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:671: TEST_auto_repair_bluestore_failed_norecov: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:00.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: seq 0 2 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: for id in $(seq 0 2) 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:673: TEST_auto_repair_bluestore_failed_norecov: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:56:00.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:00.377 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:00.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e943cc7f-206b-41f8-af23-152f9bb95ed1 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e943cc7f-206b-41f8-af23-152f9bb95ed1' 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 e943cc7f-206b-41f8-af23-152f9bb95ed1 2026-02-23T07:56:00.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:56:00.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAQCJxpxDjaFhAADMjq2CEEpdaaKyJ60DKZ4Q== 2026-02-23T07:56:00.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAQCJxpxDjaFhAADMjq2CEEpdaaKyJ60DKZ4Q=="}' 2026-02-23T07:56:00.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e943cc7f-206b-41f8-af23-152f9bb95ed1 -i td/osd-scrub-repair/0/new.json 2026-02-23T07:56:00.473 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:00.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:56:00.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAQCJxpxDjaFhAADMjq2CEEpdaaKyJ60DKZ4Q== --osd-uuid e943cc7f-206b-41f8-af23-152f9bb95ed1 2026-02-23T07:56:00.498 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:00.497+0000 7f838d979780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:00.500 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:00.499+0000 7f838d979780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:00.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:00.499+0000 7f838d979780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:00.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:00.500+0000 7f838d979780 -1 bdev(0x55df1203d400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:56:00.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:00.500+0000 7f838d979780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:56:00.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:56:00.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:56:00.937 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:56:00.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:56:00.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:56:01.035 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:56:01.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:56:01.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:01.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:56:01.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:56:01.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:56:01.048 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:01.047+0000 7ff186e7c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:01.049 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:01.048+0000 7ff186e7c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:01.049 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:01.049+0000 7ff186e7c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:01.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:01.131 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:01.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:01.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:01.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:01.266 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:01.265+0000 7ff186e7c780 -1 Falling back to public interface 2026-02-23T07:56:01.705 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:01.704+0000 7ff186e7c780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:56:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:02.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:02.226 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:02.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:02.315 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4183582472,v1:127.0.0.1:6801/4183582472] [v2:127.0.0.1:6802/4183582472,v1:127.0.0.1:6803/4183582472] exists,up e943cc7f-206b-41f8-af23-152f9bb95ed1 2026-02-23T07:56:02.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:02.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: for id in $(seq 0 2) 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:673: TEST_auto_repair_bluestore_failed_norecov: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:02.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:02.322 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:56:02.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:02.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:56:02.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:56:02.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d0bfcfd1-6afe-4b17-ad7b-37a717e703ef 2026-02-23T07:56:02.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 d0bfcfd1-6afe-4b17-ad7b-37a717e703ef' 2026-02-23T07:56:02.324 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 d0bfcfd1-6afe-4b17-ad7b-37a717e703ef 2026-02-23T07:56:02.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:56:02.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQASCJxpB7xxExAANq3I5v3Kr+F6M+E/MG6igQ== 2026-02-23T07:56:02.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQASCJxpB7xxExAANq3I5v3Kr+F6M+E/MG6igQ=="}' 2026-02-23T07:56:02.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d0bfcfd1-6afe-4b17-ad7b-37a717e703ef -i td/osd-scrub-repair/1/new.json 2026-02-23T07:56:02.416 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:56:02.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQASCJxpB7xxExAANq3I5v3Kr+F6M+E/MG6igQ== --osd-uuid d0bfcfd1-6afe-4b17-ad7b-37a717e703ef 2026-02-23T07:56:02.438 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:02.437+0000 7ff18314d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:02.440 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:02.439+0000 7ff18314d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:02.441 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:02.440+0000 7ff18314d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:02.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:02.440+0000 7ff18314d780 -1 bdev(0x5628885ef400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:56:02.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:02.441+0000 7ff18314d780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:56:02.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:56:02.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:56:02.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:56:02.831 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:56:02.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:56:03.043 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:56:03.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:56:03.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:03.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:56:03.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:56:03.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:56:03.056 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:03.055+0000 7fddf134f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:03.058 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:03.057+0000 7fddf134f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:03.058 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:03.057+0000 7fddf134f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:03.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:56:03.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:03.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:56:03.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:03.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:03.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:03.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:03.208 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:03.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:03.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:03.276 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:03.274+0000 7fddf134f780 -1 Falling back to public interface 2026-02-23T07:56:03.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:03.606 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:03.604+0000 7fddf134f780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:56:04.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:04.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:04.371 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:04.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:04.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:04.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:04.535 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1920340268,v1:127.0.0.1:6811/1920340268] [v2:127.0.0.1:6812/1920340268,v1:127.0.0.1:6813/1920340268] exists,up d0bfcfd1-6afe-4b17-ad7b-37a717e703ef 2026-02-23T07:56:04.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:04.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:04.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:672: TEST_auto_repair_bluestore_failed_norecov: for id in $(seq 0 2) 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:673: TEST_auto_repair_bluestore_failed_norecov: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:04.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:04.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:04.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:56:04.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:56:04.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d47e6d3b-5388-4f1a-810d-dc2a3e10da4e 2026-02-23T07:56:04.543 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 d47e6d3b-5388-4f1a-810d-dc2a3e10da4e 2026-02-23T07:56:04.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d47e6d3b-5388-4f1a-810d-dc2a3e10da4e' 2026-02-23T07:56:04.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:56:04.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAUCJxpuSKOIBAAlLw0rG0E/piMfhqU2ER7Gg== 2026-02-23T07:56:04.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAUCJxpuSKOIBAAlLw0rG0E/piMfhqU2ER7Gg=="}' 2026-02-23T07:56:04.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d47e6d3b-5388-4f1a-810d-dc2a3e10da4e -i td/osd-scrub-repair/2/new.json 2026-02-23T07:56:04.704 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:56:04.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:56:04.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAUCJxpuSKOIBAAlLw0rG0E/piMfhqU2ER7Gg== --osd-uuid d47e6d3b-5388-4f1a-810d-dc2a3e10da4e 2026-02-23T07:56:04.730 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:04.729+0000 7fa6b2a13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:04.731 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:04.730+0000 7fa6b2a13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:04.732 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:04.731+0000 7fa6b2a13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:04.732 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:04.731+0000 7fa6b2a13780 -1 bdev(0x55956280f400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:56:04.733 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:04.731+0000 7fa6b2a13780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:56:05.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:56:05.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:56:05.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:56:05.114 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:56:05.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:56:05.324 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:56:05.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:56:05.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:05.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:56:05.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:56:05.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:56:05.336 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:05.335+0000 7f640a78c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:05.338 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:05.337+0000 7f640a78c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:05.338 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:05.337+0000 7f640a78c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:05.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:56:05.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:05.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:56:05.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:05.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:05.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:05.490 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:05.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:05.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:05.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:56:05.536 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:05.534+0000 7f640a78c780 -1 Falling back to public interface 2026-02-23T07:56:05.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:05.830 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:05.829+0000 7f640a78c780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:56:06.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:06.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:06.653 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:06.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:06.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:06.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:56:06.823 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/936715071,v1:127.0.0.1:6819/936715071] [v2:127.0.0.1:6820/936715071,v1:127.0.0.1:6821/936715071] exists,up d47e6d3b-5388-4f1a-810d-dc2a3e10da4e 2026-02-23T07:56:06.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:06.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:06.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:06.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:676: TEST_auto_repair_bluestore_failed_norecov: create_pool testpool 1 1 2026-02-23T07:56:06.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-23T07:56:07.032 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T07:56:07.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:56:08.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:677: TEST_auto_repair_bluestore_failed_norecov: ceph osd pool set testpool size 2 2026-02-23T07:56:08.253 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 2 2026-02-23T07:56:08.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:678: TEST_auto_repair_bluestore_failed_norecov: wait_for_clean 2026-02-23T07:56:08.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:08.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:08.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:08.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:08.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:08.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:08.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:08.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:08.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:08.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:08.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:08.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:08.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:08.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:08.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:08.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:08.511 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:08.511 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:08.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:08.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:08.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:08.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:56:08.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:56:08.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:56:08.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:08.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:08.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T07:56:08.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T07:56:08.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T07:56:08.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:08.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:08.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T07:56:08.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T07:56:08.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-23T07:56:08.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:08.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:56:08.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:08.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:56:08.735 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:08.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:56:08.736 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:56:08.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:56:08.736 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:08.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:56:08.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:09.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:09.903 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:10.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:56:10.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:11.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:56:11.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:56:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:11.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T07:56:11.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:11.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:11.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T07:56:11.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:11.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T07:56:11.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T07:56:11.243 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T07:56:11.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:11.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705667 2026-02-23T07:56:11.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:11.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T07:56:11.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:11.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:11.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T07:56:11.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:11.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T07:56:11.409 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T07:56:11.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T07:56:11.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:11.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-23T07:56:11.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:11.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:11.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:11.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:56:11.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:56:11.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:56:11.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:56:11.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:56:11.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:56:11.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:56:11.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:56:11.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:56:11.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:56:11.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:11.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:12.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:56:12.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:56:12.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:56:12.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:681: TEST_auto_repair_bluestore_failed_norecov: local payload=ABCDEF 2026-02-23T07:56:12.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:682: TEST_auto_repair_bluestore_failed_norecov: echo ABCDEF 2026-02-23T07:56:12.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: seq 1 10 2026-02-23T07:56:12.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:683: TEST_auto_repair_bluestore_failed_norecov: for i in $(seq 1 10) 2026-02-23T07:56:12.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:685: TEST_auto_repair_bluestore_failed_norecov: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:691: TEST_auto_repair_bluestore_failed_norecov: get_not_primary testpool SOMETHING 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:56:12.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:56:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:56:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:56:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:56:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:691: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 0 obj1 remove 2026-02-23T07:56:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:56:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:56:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj1 remove 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj1 remove 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:56:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj1 remove 2026-02-23T07:56:12.855 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-23T07:56:12.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:12.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:12.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:56:12.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:56:12.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:56:12.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:56:12.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:12.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:56:12.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:12.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:56:12.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:56:12.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:56:12.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:56:12.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:56:12.922 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:12.921+0000 7f8aaa27e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:12.924 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:12.923+0000 7f8aaa27e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:12.924 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:12.923+0000 7f8aaa27e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:13.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:56:13.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:13.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:56:13.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:13.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:13.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:13.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:13.079 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:56:13.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:13.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:13.140 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:13.138+0000 7f8aaa27e780 -1 Falling back to public interface 2026-02-23T07:56:13.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:13.484 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:13.483+0000 7f8aaa27e780 -1 osd.0 20 log_to_monitors true 2026-02-23T07:56:14.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:14.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:14.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:14.242 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:14.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:14.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/182919401,v1:127.0.0.1:6801/182919401] [v2:127.0.0.1:6802/182919401,v1:127.0.0.1:6803/182919401] exists,up e943cc7f-206b-41f8-af23-152f9bb95ed1 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:14.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:14.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:14.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:14.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:14.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:14.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:14.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:14.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:14.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:14.654 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:14.654 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:14.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:14.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:14.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:14.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-23T07:56:14.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-23T07:56:14.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-23T07:56:14.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:14.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:14.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T07:56:14.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T07:56:14.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-38654705670' 2026-02-23T07:56:14.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:14.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:14.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T07:56:14.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T07:56:14.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-38654705670 2-60129542148' 2026-02-23T07:56:14.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:14.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-23T07:56:14.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:14.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:14.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-23T07:56:14.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:14.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-23T07:56:14.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-23T07:56:14.877 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215106 2026-02-23T07:56:14.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:15.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T07:56:15.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:16.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:16.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:16.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T07:56:16.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:17.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:56:17.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:17.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-23T07:56:17.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:17.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T07:56:17.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:17.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:17.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T07:56:17.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:17.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T07:56:17.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T07:56:17.379 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705670 2026-02-23T07:56:17.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:17.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-23T07:56:17.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:17.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T07:56:17.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:17.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:17.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T07:56:17.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T07:56:17.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T07:56:17.544 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542148 2026-02-23T07:56:17.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:17.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T07:56:17.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:17.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:17.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:17.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:56:17.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:56:17.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:56:17.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:56:17.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:56:17.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:56:17.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:56:17.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:56:18.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:56:18.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:56:18.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:18.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:18.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:56:18.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:56:18.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:56:18.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:692: TEST_auto_repair_bluestore_failed_norecov: get_primary testpool SOMETHING 2026-02-23T07:56:18.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:56:18.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:56:18.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:56:18.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:692: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 1 obj1 rm-attr _ 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj1 rm-attr _ 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:56:18.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:18.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:18.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj1 rm-attr _ 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:56:18.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj1 rm-attr _ 2026-02-23T07:56:18.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:18.958 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:56:18.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:56:18.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:56:18.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:56:18.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:56:18.968 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:18.967+0000 7f8c3714d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:18.969 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:18.968+0000 7f8c3714d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:18.970 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:18.969+0000 7f8c3714d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:19.183 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:19.182+0000 7f8c3714d780 -1 Falling back to public interface 2026-02-23T07:56:19.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:19.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:19.501+0000 7f8c3714d780 -1 osd.1 26 log_to_monitors true 2026-02-23T07:56:20.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:20.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:20.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:20.288 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:20.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:20.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:20.454 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 30 up_thru 30 down_at 27 last_clean_interval [9,26) [v2:127.0.0.1:6810/3001176852,v1:127.0.0.1:6811/3001176852] [v2:127.0.0.1:6812/3001176852,v1:127.0.0.1:6813/3001176852] exists,up d0bfcfd1-6afe-4b17-ad7b-37a717e703ef 2026-02-23T07:56:20.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:20.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:20.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:20.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:20.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:20.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:20.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:20.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:20.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:20.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:20.696 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:20.697 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:20.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:20.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:20.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:20.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215108 2026-02-23T07:56:20.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215108 2026-02-23T07:56:20.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108' 2026-02-23T07:56:20.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:20.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:20.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-23T07:56:20.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-23T07:56:20.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108 1-128849018882' 2026-02-23T07:56:20.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:20.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:20.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-23T07:56:20.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-23T07:56:20.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108 1-128849018882 2-60129542150' 2026-02-23T07:56:20.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:20.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215108 2026-02-23T07:56:20.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:20.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:20.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215108 2026-02-23T07:56:20.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:20.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215108 2026-02-23T07:56:20.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215108' 2026-02-23T07:56:20.924 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215108 2026-02-23T07:56:20.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:21.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215108 2026-02-23T07:56:21.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:22.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:22.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:22.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215108 2026-02-23T07:56:22.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:23.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:56:23.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:23.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215108 2026-02-23T07:56:23.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:23.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-128849018882 2026-02-23T07:56:23.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:23.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:23.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018882 2026-02-23T07:56:23.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:23.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-23T07:56:23.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 128849018882' 2026-02-23T07:56:23.425 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 128849018882 2026-02-23T07:56:23.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:23.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018882 -lt 128849018882 2026-02-23T07:56:23.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:23.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-23T07:56:23.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:23.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:23.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-23T07:56:23.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:23.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-23T07:56:23.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-23T07:56:23.593 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542150 2026-02-23T07:56:23.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:23.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542150 2026-02-23T07:56:23.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:23.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:23.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:56:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:56:23.965 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:56:24.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:56:24.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:56:24.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:24.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:24.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:56:24.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:56:24.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:56:24.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:694: TEST_auto_repair_bluestore_failed_norecov: get_not_primary testpool SOMETHING 2026-02-23T07:56:24.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:56:24.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:56:24.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:56:24.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:56:24.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:56:24.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:56:24.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:56:24.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:56:24.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:56:24.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:56:24.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:694: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 0 obj2 remove 2026-02-23T07:56:24.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:56:24.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:56:24.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 obj2 remove 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:24.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:24.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:24.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-23T07:56:24.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:56:24.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:56:24.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:56:24.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:56:24.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:56:24.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-23T07:56:24.889 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:104778fc:::obj2:head# 2026-02-23T07:56:24.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:56:24.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:24.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:56:24.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:24.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:56:24.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:56:24.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:56:24.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:56:24.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:56:24.961 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:24.960+0000 7fe27780a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:24.962 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:24.961+0000 7fe27780a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:24.963 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:24.962+0000 7fe27780a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:25.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:25.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:25.162+0000 7fe27780a780 -1 Falling back to public interface 2026-02-23T07:56:25.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:25.551 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:25.549+0000 7fe27780a780 -1 osd.0 31 log_to_monitors true 2026-02-23T07:56:26.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:26.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:26.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:26.282 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:26.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:26.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:26.449 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 35 up_thru 27 down_at 32 last_clean_interval [24,31) [v2:127.0.0.1:6800/785983152,v1:127.0.0.1:6801/785983152] [v2:127.0.0.1:6802/785983152,v1:127.0.0.1:6803/785983152] exists,up e943cc7f-206b-41f8-af23-152f9bb95ed1 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:26.450 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:26.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:26.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:26.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:26.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:26.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:26.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:26.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:26.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:26.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:26.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:26.693 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:26.693 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:26.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:26.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:26.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:26.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855362 2026-02-23T07:56:26.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855362 2026-02-23T07:56:26.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855362' 2026-02-23T07:56:26.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:26.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:26.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-23T07:56:26.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-23T07:56:26.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855362 1-128849018884' 2026-02-23T07:56:26.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:26.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:26.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-23T07:56:26.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-23T07:56:26.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855362 1-128849018884 2-60129542152' 2026-02-23T07:56:26.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:26.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855362 2026-02-23T07:56:26.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:26.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:26.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855362 2026-02-23T07:56:26.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:26.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855362 2026-02-23T07:56:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855362' 2026-02-23T07:56:26.923 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 150323855362 2026-02-23T07:56:26.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:27.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855362 2026-02-23T07:56:27.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:28.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:28.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:28.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855362 2026-02-23T07:56:28.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:29.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:56:29.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855362 2026-02-23T07:56:29.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:29.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-128849018884 2026-02-23T07:56:29.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:29.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018884 2026-02-23T07:56:29.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018884 2026-02-23T07:56:29.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 128849018884' 2026-02-23T07:56:29.428 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 128849018884 2026-02-23T07:56:29.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:29.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-23T07:56:29.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:29.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-23T07:56:29.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:29.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:29.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-23T07:56:29.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:29.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-23T07:56:29.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-23T07:56:29.601 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542152 2026-02-23T07:56:29.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:29.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542152 2026-02-23T07:56:29.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:29.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:29.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:29.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:56:29.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:56:30.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:56:30.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:56:30.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:30.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:30.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:695: TEST_auto_repair_bluestore_failed_norecov: get_primary testpool SOMETHING 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:56:30.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:56:30.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:695: TEST_auto_repair_bluestore_failed_norecov: objectstore_tool td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-23T07:56:30.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:30.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:30.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:30.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:30.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:30.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 obj2 rm-attr _ 2026-02-23T07:56:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:56:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:56:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:56:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:56:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:56:30.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj2 rm-attr _ 2026-02-23T07:56:30.919 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:ff7b1f36:::obj1:head#, (61) No data available 2026-02-23T07:56:30.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:30.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:30.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:56:30.975 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:56:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:56:30.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:56:30.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:56:30.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:56:30.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:56:30.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:56:30.986 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:30.985+0000 7fdd53549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:30.987 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:30.986+0000 7fdd53549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:30.988 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:30.987+0000 7fdd53549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:31.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:56:31.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:31.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:31.150 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:31.149+0000 7fdd53549780 -1 Falling back to public interface 2026-02-23T07:56:31.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:31.524 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:31.523+0000 7fdd53549780 -1 osd.1 36 log_to_monitors true 2026-02-23T07:56:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:32.308 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:32.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:32.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:32.474 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 40 up_thru 40 down_at 37 last_clean_interval [30,36) [v2:127.0.0.1:6810/3034552469,v1:127.0.0.1:6811/3034552469] [v2:127.0.0.1:6812/3034552469,v1:127.0.0.1:6813/3034552469] exists,up d0bfcfd1-6afe-4b17-ad7b-37a717e703ef 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:32.475 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:32.476 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:32.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:32.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:32.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:32.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:32.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:32.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:32.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:32.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:32.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:32.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:32.720 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:32.720 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:32.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:32.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:32.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:32.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-23T07:56:32.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-23T07:56:32.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855364' 2026-02-23T07:56:32.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:32.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:32.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691842 2026-02-23T07:56:32.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691842 2026-02-23T07:56:32.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855364 1-171798691842' 2026-02-23T07:56:32.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:32.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:32.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-23T07:56:32.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-23T07:56:32.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855364 1-171798691842 2-60129542155' 2026-02-23T07:56:32.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:32.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855364 2026-02-23T07:56:32.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:32.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:32.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855364 2026-02-23T07:56:32.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:32.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855364 2026-02-23T07:56:32.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855364' 2026-02-23T07:56:32.946 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 150323855364 2026-02-23T07:56:32.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:33.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855364 2026-02-23T07:56:33.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:34.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:34.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:34.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855364 2026-02-23T07:56:34.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:35.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:56:35.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:35.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-23T07:56:35.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:35.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-171798691842 2026-02-23T07:56:35.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:35.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:35.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-171798691842 2026-02-23T07:56:35.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:35.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691842 2026-02-23T07:56:35.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 171798691842' 2026-02-23T07:56:35.444 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 171798691842 2026-02-23T07:56:35.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:35.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691842 -lt 171798691842 2026-02-23T07:56:35.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:35.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-23T07:56:35.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:35.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:35.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-23T07:56:35.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:35.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-23T07:56:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-23T07:56:35.611 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542155 2026-02-23T07:56:35.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:35.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-23T07:56:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:35.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:56:35.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:56:35.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:56:35.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:56:35.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:56:35.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:56:35.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:56:35.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:56:36.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:56:36.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:56:36.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:36.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:36.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:56:36.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:56:36.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:56:36.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:696: TEST_auto_repair_bluestore_failed_norecov: ceph tell 'osd.*' config set osd_scrub_auto_repair true 2026-02-23T07:56:36.424 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T07:56:36.425 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T07:56:36.425 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:56:36.432 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T07:56:36.432 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_auto_repair = '' (not observed, change may require restart) osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T07:56:36.432 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:56:36.439 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T07:56:36.439 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_auto_repair = '' (not observed, change may require restart) " 2026-02-23T07:56:36.439 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:56:36.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:698: TEST_auto_repair_bluestore_failed_norecov: get_pg testpool obj1 2026-02-23T07:56:36.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T07:56:36.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-23T07:56:36.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-23T07:56:36.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:56:36.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:698: TEST_auto_repair_bluestore_failed_norecov: local pgid=1.0 2026-02-23T07:56:36.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:699: TEST_auto_repair_bluestore_failed_norecov: get_primary testpool obj1 2026-02-23T07:56:36.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:56:36.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T07:56:36.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T07:56:36.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:56:36.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:699: TEST_auto_repair_bluestore_failed_norecov: local primary=1 2026-02-23T07:56:36.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:700: TEST_auto_repair_bluestore_failed_norecov: get_last_scrub_stamp 1.0 2026-02-23T07:56:36.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:36.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:36.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:36.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:36.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:700: TEST_auto_repair_bluestore_failed_norecov: local last_scrub_stamp=2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:36.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:701: TEST_auto_repair_bluestore_failed_norecov: ceph tell 1.0 schedule-deep-scrub 2026-02-23T07:56:37.007 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:56:37.007 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T07:56:37.007 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T07:56:37.007 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-12T03:08:27.006072+0000" 2026-02-23T07:56:37.007 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:56:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:704: TEST_auto_repair_bluestore_failed_norecov: wait_for_scrub 1.0 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T07:56:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:37.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:37.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:07.031378+0000 '>' 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:37.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:56:38.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:56:38.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:56:38.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:56:38.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:38.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:38.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:38.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:38.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:07.031378+0000 '>' 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:38.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:56:39.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:56:39.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:56:39.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:56:39.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:39.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:39.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:39.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:39.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:07.031378+0000 '>' 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:39.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:56:40.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:56:40.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:56:40.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:56:40.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:40.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:40.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:40.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:40.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:07.031378+0000 '>' 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:40.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:56:41.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:56:41.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:56:41.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:56:41.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:41.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:41.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:41.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:41.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:07.031378+0000 '>' 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:41.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:56:42.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:56:42.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:56:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:56:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:56:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:56:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:56:42.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:40.532742+0000 '>' 2026-02-23T07:56:07.031378+0000 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:705: TEST_auto_repair_bluestore_failed_norecov: wait_for_clean 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:43.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:43.018 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:43.018 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:43.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:43.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:43.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:43.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:43.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:43.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:43.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:43.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:43.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:43.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:43.261 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:43.261 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:43.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:43.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:43.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855367 2026-02-23T07:56:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855367 2026-02-23T07:56:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855367' 2026-02-23T07:56:43.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:43.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691845 2026-02-23T07:56:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691845 2026-02-23T07:56:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855367 1-171798691845' 2026-02-23T07:56:43.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:43.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:43.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542158 2026-02-23T07:56:43.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542158 2026-02-23T07:56:43.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855367 1-171798691845 2-60129542158' 2026-02-23T07:56:43.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:43.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855367 2026-02-23T07:56:43.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:43.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:43.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855367 2026-02-23T07:56:43.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855367 2026-02-23T07:56:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855367' 2026-02-23T07:56:43.488 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 150323855367 2026-02-23T07:56:43.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:43.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855366 -lt 150323855367 2026-02-23T07:56:43.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:44.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:44.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855367 -lt 150323855367 2026-02-23T07:56:44.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:44.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-171798691845 2026-02-23T07:56:44.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:44.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:44.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-171798691845 2026-02-23T07:56:44.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:44.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691845 2026-02-23T07:56:44.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 171798691845' 2026-02-23T07:56:44.828 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 171798691845 2026-02-23T07:56:44.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:44.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691845 -lt 171798691845 2026-02-23T07:56:44.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:44.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542158 2026-02-23T07:56:44.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:44.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:44.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542158 2026-02-23T07:56:44.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:44.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542158 2026-02-23T07:56:44.995 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542158 2026-02-23T07:56:44.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542158' 2026-02-23T07:56:44.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:45.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542158 -lt 60129542158 2026-02-23T07:56:45.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:45.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:45.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:56:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:56:45.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:56:45.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:56:45.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:56:45.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:56:45.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:56:45.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:56:45.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:56:45.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:56:45.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:45.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:56:45.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:56:45.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:56:45.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:56:45.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:706: TEST_auto_repair_bluestore_failed_norecov: flush_pg_stats 2026-02-23T07:56:45.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:45.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:45.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:45.898 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:45.898 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:45.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:45.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:45.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:45.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855369 2026-02-23T07:56:45.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855369 2026-02-23T07:56:45.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855369' 2026-02-23T07:56:45.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:45.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:46.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691846 2026-02-23T07:56:46.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691846 2026-02-23T07:56:46.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855369 1-171798691846' 2026-02-23T07:56:46.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:46.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:46.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542159 2026-02-23T07:56:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542159 2026-02-23T07:56:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855369 1-171798691846 2-60129542159' 2026-02-23T07:56:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:46.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855369 2026-02-23T07:56:46.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:46.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:46.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855369 2026-02-23T07:56:46.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:46.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855369 2026-02-23T07:56:46.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855369' 2026-02-23T07:56:46.123 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 150323855369 2026-02-23T07:56:46.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:46.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855367 -lt 150323855369 2026-02-23T07:56:46.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:47.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:47.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855369 -lt 150323855369 2026-02-23T07:56:47.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:47.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-171798691846 2026-02-23T07:56:47.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:47.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:47.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-171798691846 2026-02-23T07:56:47.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:47.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691846 2026-02-23T07:56:47.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 171798691846' 2026-02-23T07:56:47.460 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 171798691846 2026-02-23T07:56:47.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:47.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691846 -lt 171798691846 2026-02-23T07:56:47.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:47.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542159 2026-02-23T07:56:47.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:47.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:47.627 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542159 2026-02-23T07:56:47.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:47.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542159 2026-02-23T07:56:47.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542159' 2026-02-23T07:56:47.629 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542159 2026-02-23T07:56:47.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542159 -lt 60129542159 2026-02-23T07:56:47.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:707: TEST_auto_repair_bluestore_failed_norecov: grep -q 'scrub_finish.*present with no repair possible' td/osd-scrub-repair/osd.1.log 2026-02-23T07:56:47.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:708: TEST_auto_repair_bluestore_failed_norecov: ceph pg dump pgs 2026-02-23T07:56:47.948 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:56:47.948 INFO:tasks.workunit.client.0.trial129.stdout:1.0 10 0 0 0 0 56 0 0 10 0 10 active+clean+inconsistent+failed_repair 2026-02-23T07:56:40.532781+0000 20'10 41:110 [1,0] 1 [1,0] 1 20'10 2026-02-23T07:56:40.532742+0000 20'10 2026-02-23T07:56:40.532742+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:56:40.532742+0000 10 0 2026-02-23T07:56:47.948 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:56:47.948 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:56:47.948 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:56:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:709: TEST_auto_repair_bluestore_failed_norecov: ceph pg dump pgs 2026-02-23T07:56:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:709: TEST_auto_repair_bluestore_failed_norecov: grep -q '^1.0.*+failed_repair' 2026-02-23T07:56:48.110 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:56:48.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:56:48.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:56:48.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:56:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:48.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:48.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:48.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:48.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:48.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:56:48.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:56:48.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:56:48.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:56:48.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:56:48.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:56:48.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:48.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:56:48.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:56:48.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:48.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:56:48.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:56:48.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:56:48.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:56:48.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:56:48.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:56:48.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:56:48.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:56:48.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:56:48.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:56:48.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:56:48.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:56:48.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:56:48.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:56:48.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:56:48.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:48.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:56:48.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:56:48.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:56:48.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:56:48.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:56:48.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:56:48.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:56:48.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:56:48.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:56:48.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:56:48.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:56:48.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:56:48.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:56:48.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_scrub td/osd-scrub-repair 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:542: TEST_auto_repair_bluestore_scrub: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:543: TEST_auto_repair_bluestore_scrub: local poolname=testpool 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:546: TEST_auto_repair_bluestore_scrub: run_mon td/osd-scrub-repair a 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:56:48.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:56:48.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:56:48.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:56:48.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:56:48.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:56:48.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:48.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:48.276 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:48.276 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.277 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:48.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:56:48.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:56:48.298 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:56:48.299 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.299 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.299 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:56:48.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:56:48.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:56:48.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:56:48.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:56:48.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:56:48.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.358 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:56:48.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:56:48.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:56:48.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:547: TEST_auto_repair_bluestore_scrub: run_mgr td/osd-scrub-repair x 2026-02-23T07:56:48.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:56:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:56:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:56:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:56:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:56:48.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:56:48.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:48.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:48.509 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:48.509 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.509 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:48.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:56:48.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:56:48.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:551: TEST_auto_repair_bluestore_scrub: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-23T07:56:48.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: seq 0 2 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: for id in $(seq 0 2) 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:553: TEST_auto_repair_bluestore_scrub: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:48.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:48.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:56:48.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:56:48.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c804e7e6-7086-45b1-bac7-028f9c1b5650 2026-02-23T07:56:48.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c804e7e6-7086-45b1-bac7-028f9c1b5650' 2026-02-23T07:56:48.529 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 c804e7e6-7086-45b1-bac7-028f9c1b5650 2026-02-23T07:56:48.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:56:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBACJxp9OAFIBAAjzQuKCjz53Mem5yazghgBg== 2026-02-23T07:56:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBACJxp9OAFIBAAjzQuKCjz53Mem5yazghgBg=="}' 2026-02-23T07:56:48.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c804e7e6-7086-45b1-bac7-028f9c1b5650 -i td/osd-scrub-repair/0/new.json 2026-02-23T07:56:48.627 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:48.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:56:48.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 --mkfs --key AQBACJxp9OAFIBAAjzQuKCjz53Mem5yazghgBg== --osd-uuid c804e7e6-7086-45b1-bac7-028f9c1b5650 2026-02-23T07:56:48.652 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:48.650+0000 7f7a00386780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:48.653 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:48.652+0000 7f7a00386780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:48.653 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:48.652+0000 7f7a00386780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:48.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:48.653+0000 7f7a00386780 -1 bdev(0x55747bef3400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:56:48.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:48.653+0000 7f7a00386780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:56:49.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:56:49.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:56:49.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:56:49.097 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:56:49.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:56:49.193 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:56:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:56:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:56:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:56:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:56:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:56:49.207 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:49.205+0000 7f73ac16f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:49.208 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:49.207+0000 7f73ac16f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:49.209 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:49.207+0000 7f73ac16f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:49.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:49.289 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:49.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:49.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:49.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:49.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:49.408+0000 7f73ac16f780 -1 Falling back to public interface 2026-02-23T07:56:49.724 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:49.723+0000 7f73ac16f780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:56:50.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:50.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:50.380 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:50.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:56:50.473 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3733587342,v1:127.0.0.1:6801/3733587342] [v2:127.0.0.1:6802/3733587342,v1:127.0.0.1:6803/3733587342] exists,up c804e7e6-7086-45b1-bac7-028f9c1b5650 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: for id in $(seq 0 2) 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:553: TEST_auto_repair_bluestore_scrub: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:56:50.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:56:50.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:50.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f8905d55-cfdd-436a-9066-1b63e953708a 2026-02-23T07:56:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f8905d55-cfdd-436a-9066-1b63e953708a' 2026-02-23T07:56:50.482 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 f8905d55-cfdd-436a-9066-1b63e953708a 2026-02-23T07:56:50.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:56:50.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBCCJxpgxPkHBAAtkWYXd1hVzYf2n77XatI6A== 2026-02-23T07:56:50.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBCCJxpgxPkHBAAtkWYXd1hVzYf2n77XatI6A=="}' 2026-02-23T07:56:50.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f8905d55-cfdd-436a-9066-1b63e953708a -i td/osd-scrub-repair/1/new.json 2026-02-23T07:56:50.573 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:50.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:56:50.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 --mkfs --key AQBCCJxpgxPkHBAAtkWYXd1hVzYf2n77XatI6A== --osd-uuid f8905d55-cfdd-436a-9066-1b63e953708a 2026-02-23T07:56:50.597 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:50.596+0000 7f6475614780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:50.599 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:50.598+0000 7f6475614780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:50.600 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:50.599+0000 7f6475614780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:50.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:50.600+0000 7f6475614780 -1 bdev(0x564ea5539400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:56:50.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:50.600+0000 7f6475614780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:56:51.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:56:51.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:56:51.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:56:51.035 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:56:51.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:56:51.241 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:56:51.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:56:51.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:56:51.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:56:51.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:56:51.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:56:51.254 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:51.253+0000 7fe7840a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:51.256 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:51.255+0000 7fe7840a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:51.257 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:51.256+0000 7fe7840a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:56:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:56:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:51.409 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:51.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:51.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:51.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:51.462 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:51.461+0000 7fe7840a0780 -1 Falling back to public interface 2026-02-23T07:56:51.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:51.845 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:51.844+0000 7fe7840a0780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:56:52.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:52.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:52.572 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:52.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:52.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:52.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:56:52.740 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2973595623,v1:127.0.0.1:6811/2973595623] [v2:127.0.0.1:6812/2973595623,v1:127.0.0.1:6813/2973595623] exists,up f8905d55-cfdd-436a-9066-1b63e953708a 2026-02-23T07:56:52.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:52.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:52.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:52.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:552: TEST_auto_repair_bluestore_scrub: for id in $(seq 0 2) 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:553: TEST_auto_repair_bluestore_scrub: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:56:52.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:52.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-23T07:56:52.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:56:52.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:56:52.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2ee07e86-e19b-4531-8bdf-1a26fb841b2f 2026-02-23T07:56:52.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 2ee07e86-e19b-4531-8bdf-1a26fb841b2f' 2026-02-23T07:56:52.748 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 2ee07e86-e19b-4531-8bdf-1a26fb841b2f 2026-02-23T07:56:52.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:56:52.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBECJxpbnfTLBAAT70ZGVQDrejXzMk3QxtuUg== 2026-02-23T07:56:52.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBECJxpbnfTLBAAT70ZGVQDrejXzMk3QxtuUg=="}' 2026-02-23T07:56:52.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2ee07e86-e19b-4531-8bdf-1a26fb841b2f -i td/osd-scrub-repair/2/new.json 2026-02-23T07:56:52.912 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:56:52.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:56:52.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 --mkfs --key AQBECJxpbnfTLBAAT70ZGVQDrejXzMk3QxtuUg== --osd-uuid 2ee07e86-e19b-4531-8bdf-1a26fb841b2f 2026-02-23T07:56:52.939 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:52.938+0000 7fabaa207780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:52.940 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:52.939+0000 7fabaa207780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:52.941 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:52.940+0000 7fabaa207780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:52.941 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:52.940+0000 7fabaa207780 -1 bdev(0x56185ba5b400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:56:52.942 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:52.940+0000 7fabaa207780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:56:53.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:56:53.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:56:53.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:56:53.369 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:56:53.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:56:53.575 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:56:53.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:56:53.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:56:53.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:56:53.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:56:53.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:56:53.589 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:53.588+0000 7ff410f54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:53.590 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:53.589+0000 7ff410f54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:53.591 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:53.590+0000 7ff410f54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:56:53.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:53.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:56:53.782 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:53.781+0000 7ff410f54780 -1 Falling back to public interface 2026-02-23T07:56:53.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:56:54.154 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:56:54.153+0000 7ff410f54780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:56:54.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:56:54.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:56:54.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:56:54.909 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:56:54.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:56:54.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:56:55.072 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/90085093,v1:127.0.0.1:6819/90085093] [v2:127.0.0.1:6820/90085093,v1:127.0.0.1:6821/90085093] exists,up 2ee07e86-e19b-4531-8bdf-1a26fb841b2f 2026-02-23T07:56:55.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:56:55.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:56:55.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:56:55.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:556: TEST_auto_repair_bluestore_scrub: create_pool testpool 1 1 2026-02-23T07:56:55.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-23T07:56:55.317 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T07:56:55.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:56:56.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:557: TEST_auto_repair_bluestore_scrub: ceph osd pool set testpool size 2 2026-02-23T07:56:56.539 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 2 2026-02-23T07:56:56.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:558: TEST_auto_repair_bluestore_scrub: wait_for_clean 2026-02-23T07:56:56.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:56:56.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:56:56.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:56:56.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:56:56.553 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:56:56.553 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:56:56.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:56:56.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:56:56.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:56:56.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:56:56.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:56:56.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:56:56.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:56:56.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:56:56.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:56:56.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:56:56.795 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:56:56.795 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:56:56.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:56:56.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:56.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:56:56.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:56:56.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:56:56.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:56:56.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:56.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:56:56.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-23T07:56:56.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-23T07:56:56.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666' 2026-02-23T07:56:56.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:56:56.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:56:57.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574850 2026-02-23T07:56:57.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574850 2026-02-23T07:56:57.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666 2-55834574850' 2026-02-23T07:56:57.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:57.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:56:57.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:57.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:56:57.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:56:57.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:57.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:56:57.019 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:56:57.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:56:57.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:57.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:56:57.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:58.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:56:58.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:58.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:56:58.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:56:59.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:56:59.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:56:59.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:56:59.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:59.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-23T07:56:59.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:59.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:56:59.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-23T07:56:59.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:59.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-23T07:56:59.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-23T07:56:59.518 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705666 2026-02-23T07:56:59.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:56:59.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705666 2026-02-23T07:56:59.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:56:59.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574850 2026-02-23T07:56:59.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:56:59.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:56:59.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574850 2026-02-23T07:56:59.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:56:59.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574850 2026-02-23T07:56:59.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574850' 2026-02-23T07:56:59.691 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574850 2026-02-23T07:56:59.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:56:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574850 -lt 55834574850 2026-02-23T07:56:59.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:56:59.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:56:59.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:00.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:57:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:57:00.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:57:00.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:57:00.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:00.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:57:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:57:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:57:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:561: TEST_auto_repair_bluestore_scrub: local payload=ABCDEF 2026-02-23T07:57:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:562: TEST_auto_repair_bluestore_scrub: echo ABCDEF 2026-02-23T07:57:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:563: TEST_auto_repair_bluestore_scrub: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:57:00.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:567: TEST_auto_repair_bluestore_scrub: get_not_primary testpool SOMETHING 2026-02-23T07:57:00.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:57:00.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:57:00.458 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:57:00.458 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:57:00.458 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:57:00.459 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:00.459 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:57:00.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:57:00.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:00.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:57:00.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:567: TEST_auto_repair_bluestore_scrub: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:57:00.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:57:00.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:57:00.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:57:00.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:57:00.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:57:01.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:57:01.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:57:01.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:57:01.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:57:01.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:57:01.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:57:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T07:57:01.215 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-23T07:57:01.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:01.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:57:01.274 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:57:01.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:57:01.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:57:01.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:57:01.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:57:01.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:57:01.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:57:01.284 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:01.283+0000 7ffb1c67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:01.286 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:01.285+0000 7ffb1c67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:01.287 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:01.285+0000 7ffb1c67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:01.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:57:01.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:01.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:01.457 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:01.456+0000 7ffb1c67e780 -1 Falling back to public interface 2026-02-23T07:57:01.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:01.815 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:01.814+0000 7ffb1c67e780 -1 osd.0 19 log_to_monitors true 2026-02-23T07:57:02.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:57:02.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:02.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:57:02.604 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:02.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:02.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 23 up_thru 0 down_at 20 last_clean_interval [5,19) [v2:127.0.0.1:6800/1370253563,v1:127.0.0.1:6801/1370253563] [v2:127.0.0.1:6802/1370253563,v1:127.0.0.1:6803/1370253563] exists,up c804e7e6-7086-45b1-bac7-028f9c1b5650 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:57:02.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:57:02.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:57:02.767 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:57:02.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:57:02.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:57:02.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:57:02.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:57:02.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:57:02.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:57:02.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:57:02.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:57:02.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:02.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:03.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:03.009 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:03.009 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:03.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:03.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:03.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:03.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247810 2026-02-23T07:57:03.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247810 2026-02-23T07:57:03.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810' 2026-02-23T07:57:03.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:03.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:03.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-23T07:57:03.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-23T07:57:03.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-38654705669' 2026-02-23T07:57:03.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:03.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:03.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-23T07:57:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-23T07:57:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247810 1-38654705669 2-55834574852' 2026-02-23T07:57:03.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:03.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247810 2026-02-23T07:57:03.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:03.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:03.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247810 2026-02-23T07:57:03.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:03.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247810 2026-02-23T07:57:03.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247810' 2026-02-23T07:57:03.235 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 98784247810 2026-02-23T07:57:03.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:03.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 98784247810 2026-02-23T07:57:03.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:04.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:04.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:04.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 98784247810 2026-02-23T07:57:04.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:04.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-23T07:57:04.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:04.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:04.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-23T07:57:04.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:04.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-23T07:57:04.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-23T07:57:04.577 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705669 2026-02-23T07:57:04.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:04.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-23T07:57:04.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:04.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574852 2026-02-23T07:57:04.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:04.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:04.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-23T07:57:04.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:04.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574852 2026-02-23T07:57:04.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-23T07:57:04.751 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574852 2026-02-23T07:57:04.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:04.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-23T07:57:04.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:57:04.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:04.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:05.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:57:05.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:57:05.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:57:05.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:57:05.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:05.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:05.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:569: TEST_auto_repair_bluestore_scrub: get_pg testpool SOMETHING 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:05.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:57:05.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:569: TEST_auto_repair_bluestore_scrub: local pgid=1.0 2026-02-23T07:57:05.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:570: TEST_auto_repair_bluestore_scrub: get_primary testpool SOMETHING 2026-02-23T07:57:05.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:57:05.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:57:05.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:05.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:57:05.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:570: TEST_auto_repair_bluestore_scrub: local primary=1 2026-02-23T07:57:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:571: TEST_auto_repair_bluestore_scrub: get_last_scrub_stamp 1.0 2026-02-23T07:57:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:57:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:57:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:57:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:57:05.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:571: TEST_auto_repair_bluestore_scrub: local last_scrub_stamp=2026-02-23T07:56:55.313497+0000 2026-02-23T07:57:05.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:572: TEST_auto_repair_bluestore_scrub: ceph tell 1.0 schedule-scrub 2026-02-23T07:57:06.044 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T07:57:06.044 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T07:57:06.044 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T07:57:06.045 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T07:57:06.043583+0000" 2026-02-23T07:57:06.045 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:575: TEST_auto_repair_bluestore_scrub: wait_for_scrub 1.0 2026-02-23T07:56:55.313497+0000 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:56:55.313497+0000 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:57:06.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:57:06.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:57:06.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:57:06.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:57:06.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:57:06.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:55.313497+0000 '>' 2026-02-23T07:56:55.313497+0000 2026-02-23T07:57:06.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:57:07.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:57:07.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:57:07.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:57:07.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:57:07.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:57:07.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:57:07.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:57:07.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:56:55.313497+0000 '>' 2026-02-23T07:56:55.313497+0000 2026-02-23T07:57:07.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:57:08.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:57:08.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:57:08.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T07:57:08.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:57:08.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:57:08.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:57:08.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:57:08.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:57:07.750940+0000 '>' 2026-02-23T07:56:55.313497+0000 2026-02-23T07:57:08.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:57:08.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:576: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-23T07:57:08.707 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:57:08.707 INFO:tasks.workunit.client.0.trial129.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-23T07:57:07.752284+0000 19'1 25:71 [1,0] 1 [1,0] 1 19'1 2026-02-23T07:57:07.750940+0000 19'1 2026-02-23T07:57:07.750940+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:57:07.750940+0000 1 0 2026-02-23T07:57:08.707 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:57:08.707 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:57:08.707 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:57:08.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:578: TEST_auto_repair_bluestore_scrub: sleep 2 2026-02-23T07:57:10.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:579: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-23T07:57:10.874 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:57:10.874 INFO:tasks.workunit.client.0.trial129.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-23T07:57:07.752284+0000 19'1 25:71 [1,0] 1 [1,0] 1 19'1 2026-02-23T07:57:07.750940+0000 19'1 2026-02-23T07:57:07.750940+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:57:07.750940+0000 1 0 2026-02-23T07:57:10.874 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:57:10.874 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:57:10.875 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:57:10.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:580: TEST_auto_repair_bluestore_scrub: sleep 2 2026-02-23T07:57:12.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:581: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-23T07:57:13.044 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:57:13.044 INFO:tasks.workunit.client.0.trial129.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-23T07:57:07.752284+0000 19'1 25:71 [1,0] 1 [1,0] 1 19'1 2026-02-23T07:57:07.750940+0000 19'1 2026-02-23T07:57:07.750940+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:57:07.750940+0000 1 0 2026-02-23T07:57:13.044 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:57:13.044 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:57:13.044 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:57:13.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:582: TEST_auto_repair_bluestore_scrub: sleep 5 2026-02-23T07:57:18.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:583: TEST_auto_repair_bluestore_scrub: wait_for_clean 2026-02-23T07:57:18.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:57:18.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:57:18.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:57:18.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:57:18.058 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:57:18.058 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:57:18.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:57:18.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:57:18.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:57:18.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:57:18.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:57:18.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:57:18.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:57:18.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:18.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:18.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:18.306 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:18.306 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:18.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:18.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:18.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247814 2026-02-23T07:57:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247814 2026-02-23T07:57:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247814' 2026-02-23T07:57:18.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:18.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:18.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-23T07:57:18.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-23T07:57:18.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247814 1-38654705673' 2026-02-23T07:57:18.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:18.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:18.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574856 2026-02-23T07:57:18.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574856 2026-02-23T07:57:18.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-98784247814 1-38654705673 2-55834574856' 2026-02-23T07:57:18.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:18.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-98784247814 2026-02-23T07:57:18.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:18.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:18.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-98784247814 2026-02-23T07:57:18.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:18.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247814 2026-02-23T07:57:18.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 98784247814' 2026-02-23T07:57:18.530 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 98784247814 2026-02-23T07:57:18.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:18.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247814 -lt 98784247814 2026-02-23T07:57:18.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:18.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705673 2026-02-23T07:57:18.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:18.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:18.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-23T07:57:18.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:18.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705673 2026-02-23T07:57:18.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-23T07:57:18.702 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705673 2026-02-23T07:57:18.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:18.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-23T07:57:18.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:18.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574856 2026-02-23T07:57:18.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:18.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:18.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574856 2026-02-23T07:57:18.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574856 2026-02-23T07:57:18.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2026-02-23T07:57:18.870 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574856 2026-02-23T07:57:18.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:19.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574856 2026-02-23T07:57:19.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:20.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:20.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:20.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574856 2026-02-23T07:57:20.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:21.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:57:21.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:21.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574857 -lt 55834574856 2026-02-23T07:57:21.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:57:21.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:21.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:21.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:57:21.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:57:21.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:57:21.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:57:21.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:57:21.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:57:21.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:57:21.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:57:21.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:57:21.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:57:21.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:21.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:57:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:57:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:57:21.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:584: TEST_auto_repair_bluestore_scrub: ceph pg dump pgs 2026-02-23T07:57:22.108 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:57:22.109 INFO:tasks.workunit.client.0.trial129.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean 2026-02-23T07:57:07.752284+0000 19'1 25:71 [1,0] 1 [1,0] 1 19'1 2026-02-23T07:57:07.750940+0000 19'1 2026-02-23T07:57:07.750940+0000 0 1 periodic scrub scheduled @ 2026-02-24T07:57:07.750940+0000 1 0 2026-02-23T07:57:22.109 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:57:22.109 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:57:22.109 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:57:22.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:587: TEST_auto_repair_bluestore_scrub: get_not_primary testpool SOMETHING 2026-02-23T07:57:22.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:57:22.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:57:22.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:57:22.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:57:22.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:57:22.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:22.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:57:22.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:57:22.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:22.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:57:22.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:587: TEST_auto_repair_bluestore_scrub: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:57:22.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:57:22.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:57:22.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:57:22.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:57:22.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:57:22.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:57:22.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:57:22.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:57:22.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:57:22.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:57:22.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:22.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-23T07:57:22.815 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:57:22.815 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:57:22.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:57:22.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:22.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:22.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0' 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-scrub-backoff-ratio=0 2026-02-23T07:57:22.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:57:22.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:57:22.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:57:22.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:57:22.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:57:22.884 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:22.883+0000 7fe2ae094780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:22.885 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:22.884+0000 7fe2ae094780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:22.886 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:22.885+0000 7fe2ae094780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:23.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:57:23.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:23.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:23.057 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:23.056+0000 7fe2ae094780 -1 Falling back to public interface 2026-02-23T07:57:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:23.434 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:23.433+0000 7fe2ae094780 -1 osd.0 25 log_to_monitors true 2026-02-23T07:57:24.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:57:24.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:24.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:57:24.205 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:24.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:24.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:24.369 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 26 last_clean_interval [23,25) [v2:127.0.0.1:6800/1907189502,v1:127.0.0.1:6801/1907189502] [v2:127.0.0.1:6802/1907189502,v1:127.0.0.1:6803/1907189502] exists,up c804e7e6-7086-45b1-bac7-028f9c1b5650 2026-02-23T07:57:24.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:57:24.370 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:57:24.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:57:24.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:57:24.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:57:24.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:57:24.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:57:24.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:57:24.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:57:24.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:24.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:24.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:24.614 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:24.614 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:24.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:24.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:24.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:24.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051586 2026-02-23T07:57:24.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051586 2026-02-23T07:57:24.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586' 2026-02-23T07:57:24.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:24.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705675 2026-02-23T07:57:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705675 2026-02-23T07:57:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-38654705675' 2026-02-23T07:57:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:24.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:24.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-23T07:57:24.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-23T07:57:24.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-38654705675 2-55834574858' 2026-02-23T07:57:24.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:24.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051586 2026-02-23T07:57:24.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:24.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:24.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051586 2026-02-23T07:57:24.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:24.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051586 2026-02-23T07:57:24.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051586' 2026-02-23T07:57:24.839 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 124554051586 2026-02-23T07:57:24.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:25.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 124554051586 2026-02-23T07:57:25.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:26.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:26.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:26.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 124554051586 2026-02-23T07:57:26.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:27.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:57:27.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:27.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051586 2026-02-23T07:57:27.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:27.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705675 2026-02-23T07:57:27.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:27.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:27.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705675 2026-02-23T07:57:27.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:27.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705675 2026-02-23T07:57:27.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705675' 2026-02-23T07:57:27.343 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705675 2026-02-23T07:57:27.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:27.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705675 -lt 38654705675 2026-02-23T07:57:27.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:27.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-23T07:57:27.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:27.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:27.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-23T07:57:27.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:27.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-23T07:57:27.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-23T07:57:27.513 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574858 2026-02-23T07:57:27.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:27.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574859 -lt 55834574858 2026-02-23T07:57:27.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:57:27.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:27.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:27.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:57:27.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:57:28.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:57:28.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:57:28.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:28.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:28.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:57:28.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:57:28.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:57:28.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:588: TEST_auto_repair_bluestore_scrub: rados --pool testpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T07:57:28.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:589: TEST_auto_repair_bluestore_scrub: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:57:28.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:590: TEST_auto_repair_bluestore_scrub: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:06.745+0000 7fe7663396c0 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing(periodic-regular,deep-scrub-on-error)] scrubber: scrub_finish before flags: DEEP_SCRUB_ON_ERROR. repair state: no-repair. deep_scrub_on_error: 1 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:06.745+0000 7fe7663396c0 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing(periodic-regular,deep-scrub-on-error)] scrubber: scrub_finish: will initiate a deep scrub to fix 1 errors 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:06.745+0000 7fe7663396c0 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing(periodic-regular)] scrubber: _scrub_finish info stats: valid m_is_repair: 0 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:07.750+0000 7fe7663396c0 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+repair(repairing,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: repair. deep_scrub_on_error: 0 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:07.750+0000 7fe7663396c0 10 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep+inconsistent+repair(repairing,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:07.750+0000 7fe7663396c0 15 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+inconsistent+repair(repairing,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:07.750+0000 7fe7663396c0 20 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+inconsistent+repair(repairing,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish All may be fixed 2026-02-23T07:57:28.266 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:07.750+0000 7fe7663396c0 19 osd.1 pg_epoch: 25 pg[1.0( v 19'1 (0'0,19'1] local-lis/les=23/24 n=1 ec=15/15 lis/c=23/23 les/c/f=24/24/0 sis=23) [1,0] r=0 lpr=23 crt=19'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+inconsistent+repair(repairing,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:57:28.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:593: TEST_auto_repair_bluestore_scrub: ceph pg 1.0 query 2026-02-23T07:57:28.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:593: TEST_auto_repair_bluestore_scrub: jq .info.stats.stat_sum.num_objects_repaired 2026-02-23T07:57:28.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:593: TEST_auto_repair_bluestore_scrub: COUNT=1 2026-02-23T07:57:28.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:594: TEST_auto_repair_bluestore_scrub: test 1 = 1 2026-02-23T07:57:28.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:57:28.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:57:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:57:28.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:57:28.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:57:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:57:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:57:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:57:28.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:57:28.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:57:28.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:57:28.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:57:28.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:57:28.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:57:28.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:57:28.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:57:28.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:57:28.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:57:28.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:57:28.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:57:28.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:57:28.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:57:28.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:57:28.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:57:28.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:57:28.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:57:28.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:57:28.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:57:28.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:57:28.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:57:28.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:57:28.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:57:28.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:57:28.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:57:28.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:57:28.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:57:28.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:57:28.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:57:28.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:57:28.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:57:28.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:57:28.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:57:28.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:57:28.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:57:28.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:57:28.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:57:28.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:57:28.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:57:28.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_bluestore_tag td/osd-scrub-repair 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:443: TEST_auto_repair_bluestore_tag: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:444: TEST_auto_repair_bluestore_tag: local poolname=testpool 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:447: TEST_auto_repair_bluestore_tag: run_mon td/osd-scrub-repair a 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:57:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:57:28.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:57:28.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:28.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:28.497 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:28.497 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.498 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:28.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:57:28.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:57:28.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:57:28.520 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.521 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.521 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:57:28.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:57:28.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:57:28.578 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:57:28.579 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.579 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.579 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:57:28.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:57:28.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:448: TEST_auto_repair_bluestore_tag: run_mgr td/osd-scrub-repair x 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:57:28.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:57:28.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:57:28.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:28.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:28.731 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:28.732 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.732 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:28.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:57:28.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:57:28.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:455: TEST_auto_repair_bluestore_tag: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:57:28.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: seq 0 2 2026-02-23T07:57:28.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: for id in $(seq 0 2) 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:457: TEST_auto_repair_bluestore_tag: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:28.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:28.753 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:57:28.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 46ca8b89-4abe-4442-9e59-aa7a04c70309' 2026-02-23T07:57:28.756 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:57:28.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:57:28.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBoCJxpoxEpLRAAFjskmqt+0oBIWQnbFYqTlQ== 2026-02-23T07:57:28.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBoCJxpoxEpLRAAFjskmqt+0oBIWQnbFYqTlQ=="}' 2026-02-23T07:57:28.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 46ca8b89-4abe-4442-9e59-aa7a04c70309 -i td/osd-scrub-repair/0/new.json 2026-02-23T07:57:28.847 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:57:28.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:57:28.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq --mkfs --key AQBoCJxpoxEpLRAAFjskmqt+0oBIWQnbFYqTlQ== --osd-uuid 46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:57:28.872 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:28.870+0000 7f7847cc1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:28.873 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:28.871+0000 7f7847cc1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:28.874 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:28.872+0000 7f7847cc1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:28.875 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:28.872+0000 7f7847cc1780 -1 bdev(0x555b725e3400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:57:28.875 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:28.872+0000 7f7847cc1780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:57:29.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:57:29.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:57:29.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:57:29.337 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:57:29.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:57:29.435 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:57:29.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:57:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:57:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:57:29.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:57:29.449 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:29.447+0000 7f2c8a2a4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:29.450 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:29.448+0000 7f2c8a2a4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:29.451 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:29.449+0000 7f2c8a2a4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:29.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:57:29.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:29.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:57:29.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:29.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:29.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:29.529 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:57:29.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:29.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:29.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:29.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:29.668 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:29.665+0000 7f2c8a2a4780 -1 Falling back to public interface 2026-02-23T07:57:30.018 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:30.016+0000 7f2c8a2a4780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:57:30.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:57:30.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:30.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:57:30.620 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:57:30.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:30.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2328814395,v1:127.0.0.1:6801/2328814395] [v2:127.0.0.1:6802/2328814395,v1:127.0.0.1:6803/2328814395] exists,up 46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: for id in $(seq 0 2) 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:457: TEST_auto_repair_bluestore_tag: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:30.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:57:30.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:57:30.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:57:30.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dc32a17c-495b-4941-9284-5f8c73863067 2026-02-23T07:57:30.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 dc32a17c-495b-4941-9284-5f8c73863067' 2026-02-23T07:57:30.713 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 dc32a17c-495b-4941-9284-5f8c73863067 2026-02-23T07:57:30.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:57:30.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBqCJxpxbb+KhAAhTNFcn0d8RXCTYF3vyj88w== 2026-02-23T07:57:30.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBqCJxpxbb+KhAAhTNFcn0d8RXCTYF3vyj88w=="}' 2026-02-23T07:57:30.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dc32a17c-495b-4941-9284-5f8c73863067 -i td/osd-scrub-repair/1/new.json 2026-02-23T07:57:30.809 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:57:30.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:57:30.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq --mkfs --key AQBqCJxpxbb+KhAAhTNFcn0d8RXCTYF3vyj88w== --osd-uuid dc32a17c-495b-4941-9284-5f8c73863067 2026-02-23T07:57:30.833 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:30.831+0000 7f4647350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:30.834 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:30.832+0000 7f4647350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:30.835 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:30.833+0000 7f4647350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:30.835 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:30.833+0000 7f4647350780 -1 bdev(0x5570ee7e9400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:57:30.835 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:30.834+0000 7f4647350780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:57:31.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:57:31.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:57:31.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:57:31.219 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:57:31.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:57:31.427 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:57:31.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:57:31.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:31.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:57:31.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:57:31.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:57:31.440 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:31.438+0000 7f1956a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:31.441 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:31.439+0000 7f1956a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:31.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:31.440+0000 7f1956a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:31.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:31.592 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:57:31.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:31.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:57:31.658 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:31.655+0000 7f1956a11780 -1 Falling back to public interface 2026-02-23T07:57:31.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:31.976 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:31.974+0000 7f1956a11780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:57:32.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:57:32.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:32.754 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:57:32.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:57:32.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:32.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:57:32.919 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4159329623,v1:127.0.0.1:6811/4159329623] [v2:127.0.0.1:6812/4159329623,v1:127.0.0.1:6813/4159329623] exists,up dc32a17c-495b-4941-9284-5f8c73863067 2026-02-23T07:57:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:57:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:57:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:57:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:456: TEST_auto_repair_bluestore_tag: for id in $(seq 0 2) 2026-02-23T07:57:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:457: TEST_auto_repair_bluestore_tag: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:32.920 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:57:32.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:57:32.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d4077c9a-a850-4210-bceb-cc20fc399c16 2026-02-23T07:57:32.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 d4077c9a-a850-4210-bceb-cc20fc399c16' 2026-02-23T07:57:32.922 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 d4077c9a-a850-4210-bceb-cc20fc399c16 2026-02-23T07:57:32.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:57:32.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBsCJxp/o9zNxAAxuZtcp+mbYCxh0ydVXqp+g== 2026-02-23T07:57:32.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBsCJxp/o9zNxAAxuZtcp+mbYCxh0ydVXqp+g=="}' 2026-02-23T07:57:32.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d4077c9a-a850-4210-bceb-cc20fc399c16 -i td/osd-scrub-repair/2/new.json 2026-02-23T07:57:33.091 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:57:33.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:57:33.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq --mkfs --key AQBsCJxp/o9zNxAAxuZtcp+mbYCxh0ydVXqp+g== --osd-uuid d4077c9a-a850-4210-bceb-cc20fc399c16 2026-02-23T07:57:33.117 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.115+0000 7fa6b6c7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:33.118 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.116+0000 7fa6b6c7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:33.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.117+0000 7fa6b6c7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:33.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.117+0000 7fa6b6c7e780 -1 bdev(0x56187a3f3400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:57:33.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.118+0000 7fa6b6c7e780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:57:33.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:57:33.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:57:33.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:57:33.554 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:57:33.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:57:33.761 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:57:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:57:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:57:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:57:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:57:33.774 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.772+0000 7ffbf7c12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:33.775 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.773+0000 7ffbf7c12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:33.776 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.774+0000 7ffbf7c12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:33.909 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:33.906+0000 7ffbf7c12780 -1 Falling back to public interface 2026-02-23T07:57:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:57:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:57:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:33.927 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:57:33.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:33.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:33.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:57:34.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:34.320 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:34.318+0000 7ffbf7c12780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:57:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:57:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:35.093 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:57:35.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:57:35.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:35.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:57:35.262 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1316451294,v1:127.0.0.1:6819/1316451294] [v2:127.0.0.1:6820/1316451294,v1:127.0.0.1:6821/1316451294] exists,up d4077c9a-a850-4210-bceb-cc20fc399c16 2026-02-23T07:57:35.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:57:35.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:57:35.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:57:35.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:460: TEST_auto_repair_bluestore_tag: create_pool testpool 1 1 2026-02-23T07:57:35.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-23T07:57:35.504 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T07:57:35.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:57:36.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:461: TEST_auto_repair_bluestore_tag: ceph osd pool set testpool size 2 2026-02-23T07:57:36.724 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 2 2026-02-23T07:57:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:462: TEST_auto_repair_bluestore_tag: wait_for_clean 2026-02-23T07:57:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:57:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:57:36.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:57:36.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:57:36.737 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:57:36.738 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:57:36.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:57:36.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:57:36.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:57:36.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:57:36.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:57:36.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:57:36.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:57:36.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:36.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:36.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:36.980 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:36.980 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:36.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:36.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:36.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:37.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:57:37.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:57:37.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:57:37.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:37.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:37.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T07:57:37.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T07:57:37.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T07:57:37.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:37.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:37.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T07:57:37.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T07:57:37.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-23T07:57:37.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:37.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:57:37.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:37.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:37.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:57:37.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:37.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:57:37.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:57:37.209 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:57:37.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:37.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:57:37.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:38.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:38.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:38.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:57:38.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:39.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:57:39.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:39.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:57:39.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:39.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T07:57:39.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:39.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:39.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T07:57:39.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:39.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T07:57:39.708 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T07:57:39.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T07:57:39.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705667 2026-02-23T07:57:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:39.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T07:57:39.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:39.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T07:57:39.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T07:57:39.874 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T07:57:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T07:57:39.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:40.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-23T07:57:40.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:57:40.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:40.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:40.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:57:40.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:57:40.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:57:40.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:57:40.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:57:40.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:57:40.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:57:40.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:57:40.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:57:40.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:57:40.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:40.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:40.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:57:40.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:57:40.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:57:40.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:465: TEST_auto_repair_bluestore_tag: local payload=ABCDEF 2026-02-23T07:57:40.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:466: TEST_auto_repair_bluestore_tag: echo ABCDEF 2026-02-23T07:57:40.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:467: TEST_auto_repair_bluestore_tag: rados --pool testpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:471: TEST_auto_repair_bluestore_tag: get_not_primary testpool SOMETHING 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:40.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:57:40.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:57:40.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:40.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:57:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:471: TEST_auto_repair_bluestore_tag: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:57:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:57:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:57:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:57:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:57:40.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:57:40.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:57:41.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:41.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T07:57:41.377 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-23T07:57:41.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:41.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:57:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:41.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:41.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:57:41.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:57:41.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:57:41.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:57:41.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:57:41.446 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:41.444+0000 7fcddf150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:41.447 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:41.445+0000 7fcddf150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:41.448 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:41.446+0000 7fcddf150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:41.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:41.600 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:57:41.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:41.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:41.662 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:41.660+0000 7fcddf150780 -1 Falling back to public interface 2026-02-23T07:57:41.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:41.930 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:41.928+0000 7fcddf150780 -1 osd.0 20 log_to_monitors true 2026-02-23T07:57:42.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:57:42.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:42.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:57:42.764 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:42.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:42.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:42.931 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/276658674,v1:127.0.0.1:6801/276658674] [v2:127.0.0.1:6802/276658674,v1:127.0.0.1:6803/276658674] exists,up 46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:57:42.932 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:57:42.933 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:57:42.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:57:42.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:57:42.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:57:43.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:57:43.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:57:43.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:57:43.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:57:43.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:43.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:43.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:43.174 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:43.174 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:43.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:43.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:43.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:43.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-23T07:57:43.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-23T07:57:43.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-23T07:57:43.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:43.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:43.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T07:57:43.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T07:57:43.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-38654705670' 2026-02-23T07:57:43.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:43.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:43.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T07:57:43.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T07:57:43.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-38654705670 2-60129542148' 2026-02-23T07:57:43.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:43.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-23T07:57:43.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:43.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:43.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-23T07:57:43.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:43.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-23T07:57:43.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-23T07:57:43.398 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215106 2026-02-23T07:57:43.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:43.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T07:57:43.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:44.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:44.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:44.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T07:57:44.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:45.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:57:45.735 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:45.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-23T07:57:45.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:45.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T07:57:45.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:45.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:45.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T07:57:45.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:45.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T07:57:45.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T07:57:45.904 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705670 2026-02-23T07:57:45.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:46.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-23T07:57:46.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:46.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T07:57:46.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:46.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:46.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T07:57:46.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T07:57:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T07:57:46.073 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542148 2026-02-23T07:57:46.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:46.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T07:57:46.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:57:46.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:46.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:57:46.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:57:46.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:57:46.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:57:46.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:57:46.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:57:46.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:473: TEST_auto_repair_bluestore_tag: get_pg testpool SOMETHING 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:46.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:57:46.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:473: TEST_auto_repair_bluestore_tag: local pgid=1.0 2026-02-23T07:57:46.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:474: TEST_auto_repair_bluestore_tag: get_primary testpool SOMETHING 2026-02-23T07:57:46.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:57:46.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:57:46.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:46.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:57:47.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:474: TEST_auto_repair_bluestore_tag: local primary=1 2026-02-23T07:57:47.143 INFO:tasks.workunit.client.0.trial129.stdout:Affected PG 1.0 w/ primary 1 2026-02-23T07:57:47.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:475: TEST_auto_repair_bluestore_tag: echo 'Affected PG ' 1.0 ' w/ primary ' 1 2026-02-23T07:57:47.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:476: TEST_auto_repair_bluestore_tag: get_last_scrub_stamp 1.0 2026-02-23T07:57:47.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:57:47.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:57:47.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:57:47.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:57:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:476: TEST_auto_repair_bluestore_tag: local last_scrub_stamp=2026-02-23T07:57:35.502933+0000 2026-02-23T07:57:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:477: TEST_auto_repair_bluestore_tag: initiate_and_fetch_state 1 1.0 3.0 2026-02-23T07:57:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:382: initiate_and_fetch_state: local the_osd=osd.1 2026-02-23T07:57:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:383: initiate_and_fetch_state: local pgid=1.0 2026-02-23T07:57:47.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:384: initiate_and_fetch_state: get_last_scrub_stamp 1.0 2026-02-23T07:57:47.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T07:57:47.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:57:47.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:57:47.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:384: initiate_and_fetch_state: local last_scrub=2026-02-23T07:57:35.502933+0000 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:386: initiate_and_fetch_state: set_config osd 1 osd_scrub_sleep 3.0 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=osd_scrub_sleep 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=3.0 2026-02-23T07:57:47.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T07:57:47.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set osd_scrub_sleep 3.0 2026-02-23T07:57:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T07:57:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:387: initiate_and_fetch_state: set_config osd 1 osd_scrub_auto_repair true 2026-02-23T07:57:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T07:57:47.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T07:57:47.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=osd_scrub_auto_repair 2026-02-23T07:57:47.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T07:57:47.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T07:57:47.535 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T07:57:47.535 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T07:57:47.535 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T07:57:47.535 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:57:47.536 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:47.536 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:47.536 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T07:57:47.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set osd_scrub_auto_repair true 2026-02-23T07:57:47.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T07:57:47.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:389: initiate_and_fetch_state: flush_pg_stats 2026-02-23T07:57:47.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:47.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:47.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:47.764 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:47.764 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:47.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:47.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:47.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:47.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215108 2026-02-23T07:57:47.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215108 2026-02-23T07:57:47.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108' 2026-02-23T07:57:47.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:47.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:47.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-23T07:57:47.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-23T07:57:47.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108 1-38654705671' 2026-02-23T07:57:47.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:47.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-23T07:57:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-23T07:57:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108 1-38654705671 2-60129542150' 2026-02-23T07:57:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:47.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215108 2026-02-23T07:57:47.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:47.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:47.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215108 2026-02-23T07:57:47.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:47.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215108 2026-02-23T07:57:47.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215108' 2026-02-23T07:57:47.991 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215108 2026-02-23T07:57:47.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:48.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215108 2026-02-23T07:57:48.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:49.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:49.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215108 2026-02-23T07:57:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:49.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-23T07:57:49.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:49.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:49.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-23T07:57:49.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:49.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-23T07:57:49.331 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705671 2026-02-23T07:57:49.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-23T07:57:49.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:49.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705671 2026-02-23T07:57:49.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:49.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-23T07:57:49.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:49.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:49.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-23T07:57:49.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:49.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-23T07:57:49.501 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542150 2026-02-23T07:57:49.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-23T07:57:49.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:49.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-23T07:57:49.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:390: initiate_and_fetch_state: date --rfc-3339=ns 2026-02-23T07:57:49.665 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23 07:57:49.665169517+00:00 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:393: initiate_and_fetch_state: get_asok_path osd.1 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T07:57:49.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:393: initiate_and_fetch_state: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok schedule-deep-scrub 1.0 2026-02-23T07:57:49.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i=0 )) 2026-02-23T07:57:49.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:49.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:49.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:49.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:49.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 0 ') state now: ' '"active+clean"' 2026-02-23T07:57:49.804 INFO:tasks.workunit.client.0.trial129.stdout:{"deep":true,"must":false,"stamp":"2026-02-12T03:09:39.723927+0000"}0 ) state now: "active+clean" 2026-02-23T07:57:49.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:49.805 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:49.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:49.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 0 == 4 ']' 2026-02-23T07:57:49.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:50.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:50.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:50.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:50.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:50.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:50.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 1 ') state now: ' '"active+clean"' 2026-02-23T07:57:50.181 INFO:tasks.workunit.client.0.trial129.stdout:1 ) state now: "active+clean" 2026-02-23T07:57:50.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:50.182 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 1 == 4 ']' 2026-02-23T07:57:50.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:50.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:50.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:50.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:50.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:50.557 INFO:tasks.workunit.client.0.trial129.stdout:2 ) state now: "active+clean" 2026-02-23T07:57:50.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 2 ') state now: ' '"active+clean"' 2026-02-23T07:57:50.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:50.558 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 2 == 4 ']' 2026-02-23T07:57:50.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:50.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:50.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:50.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:50.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:50.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:50.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 3 ') state now: ' '"active+clean"' 2026-02-23T07:57:50.935 INFO:tasks.workunit.client.0.trial129.stdout:3 ) state now: "active+clean" 2026-02-23T07:57:50.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:50.935 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 3 == 4 ']' 2026-02-23T07:57:50.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:51.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:51.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:51.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:51.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:51.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:51.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 4 ') state now: ' '"active+clean"' 2026-02-23T07:57:51.309 INFO:tasks.workunit.client.0.trial129.stdout:4 ) state now: "active+clean" 2026-02-23T07:57:51.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:51.309 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:51.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:51.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 4 == 4 ']' 2026-02-23T07:57:51.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:410: initiate_and_fetch_state: echo 'loop --------> ' 4 2026-02-23T07:57:51.310 INFO:tasks.workunit.client.0.trial129.stdout:loop --------> 4 2026-02-23T07:57:51.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:51.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:51.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:51.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:51.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:51.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:51.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 5 ') state now: ' '"active+clean"' 2026-02-23T07:57:51.688 INFO:tasks.workunit.client.0.trial129.stdout:5 ) state now: "active+clean" 2026-02-23T07:57:51.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:51.689 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:51.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:51.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 5 == 4 ']' 2026-02-23T07:57:51.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:51.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:51.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:51.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:51.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:52.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:52.062 INFO:tasks.workunit.client.0.trial129.stdout:6 ) state now: "active+clean" 2026-02-23T07:57:52.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 6 ') state now: ' '"active+clean"' 2026-02-23T07:57:52.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:52.063 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:52.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:52.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 6 == 4 ']' 2026-02-23T07:57:52.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:52.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:52.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:52.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:52.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:52.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:52.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 7 ') state now: ' '"active+clean"' 2026-02-23T07:57:52.435 INFO:tasks.workunit.client.0.trial129.stdout:7 ) state now: "active+clean" 2026-02-23T07:57:52.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:52.435 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:52.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:52.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 7 == 4 ']' 2026-02-23T07:57:52.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:52.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:52.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:52.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:52.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:52.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:52.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 8 ') state now: ' '"active+clean"' 2026-02-23T07:57:52.810 INFO:tasks.workunit.client.0.trial129.stdout:8 ) state now: "active+clean" 2026-02-23T07:57:52.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:52.811 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:52.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:52.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 8 == 4 ']' 2026-02-23T07:57:52.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:53.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:53.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:53.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:53.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 9 ') state now: ' '"active+clean"' 2026-02-23T07:57:53.191 INFO:tasks.workunit.client.0.trial129.stdout:9 ) state now: "active+clean" 2026-02-23T07:57:53.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:53.192 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:53.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:53.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 9 == 4 ']' 2026-02-23T07:57:53.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:53.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:53.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:53.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:53.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:53.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:53.567 INFO:tasks.workunit.client.0.trial129.stdout:10 ) state now: "active+clean" 2026-02-23T07:57:53.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 10 ') state now: ' '"active+clean"' 2026-02-23T07:57:53.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:53.568 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:53.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:53.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 0 == 4 ']' 2026-02-23T07:57:53.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:53.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:53.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:53.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:53.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:53.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean"' 2026-02-23T07:57:53.943 INFO:tasks.workunit.client.0.trial129.stdout:11 ) state now: "active+clean" 2026-02-23T07:57:53.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 11 ') state now: ' '"active+clean"' 2026-02-23T07:57:53.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:53.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:406: initiate_and_fetch_state: echo '"active+clean"' 2026-02-23T07:57:53.944 INFO:tasks.workunit.client.0.trial129.stdout:"active+clean" 2026-02-23T07:57:53.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:409: initiate_and_fetch_state: '[' 1 == 4 ']' 2026-02-23T07:57:53.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:412: initiate_and_fetch_state: sleep 0.3 2026-02-23T07:57:54.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i++ )) 2026-02-23T07:57:54.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:396: initiate_and_fetch_state: (( i < 80 )) 2026-02-23T07:57:54.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: ceph pg 1.0 query --format json 2026-02-23T07:57:54.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: jq .state 2026-02-23T07:57:54.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:398: initiate_and_fetch_state: st='"active+clean+scrubbing+deep"' 2026-02-23T07:57:54.319 INFO:tasks.workunit.client.0.trial129.stdout:12 ) state now: "active+clean+scrubbing+deep" 2026-02-23T07:57:54.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:399: initiate_and_fetch_state: echo 12 ') state now: ' '"active+clean+scrubbing+deep"' 2026-02-23T07:57:54.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:401: initiate_and_fetch_state: case "$st" in 2026-02-23T07:57:54.320 INFO:tasks.workunit.client.0.trial129.stdout:found scrub 2026-02-23T07:57:54.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:403: initiate_and_fetch_state: echo 'found scrub' 2026-02-23T07:57:54.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:403: initiate_and_fetch_state: return 0 2026-02-23T07:57:54.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:478: TEST_auto_repair_bluestore_tag: r=0 2026-02-23T07:57:54.321 INFO:tasks.workunit.client.0.trial129.stdout:initiate_and_fetch_state ret: 0 2026-02-23T07:57:54.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:479: TEST_auto_repair_bluestore_tag: echo 'initiate_and_fetch_state ret: ' 0 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:480: TEST_auto_repair_bluestore_tag: set_config osd td/osd-scrub-repair osd_scrub_sleep 0 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=td/osd-scrub-repair 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=osd_scrub_sleep 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=0 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.td/osd-scrub-repair 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.td/osd-scrub-repair 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.td/osd-scrub-repair ']' 2026-02-23T07:57:54.323 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:57:54.324 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:54.324 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:54.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.td/osd-scrub-repair.asok 2026-02-23T07:57:54.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.td/osd-scrub-repair.asok config set osd_scrub_sleep 0 2026-02-23T07:57:54.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test == true 2026-02-23T07:57:54.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh: line 1159: test: ==: unary operator expected 2026-02-23T07:57:54.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:481: TEST_auto_repair_bluestore_tag: '[' 0 -ne 0 ']' 2026-02-23T07:57:54.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:485: TEST_auto_repair_bluestore_tag: wait_end_of_scrub 1 1.0 2026-02-23T07:57:54.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:420: wait_end_of_scrub: local the_osd=osd.1 2026-02-23T07:57:54.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:421: wait_end_of_scrub: local pgid=1.0 2026-02-23T07:57:54.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i=0 )) 2026-02-23T07:57:54.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-23T07:57:54.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-23T07:57:54.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-23T07:57:54.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-23T07:57:54.440 INFO:tasks.workunit.client.0.trial129.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-23T07:57:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-23T07:57:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 0 == 4 ']' 2026-02-23T07:57:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-23T07:57:54.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-23T07:57:54.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-23T07:57:54.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-23T07:57:54.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-23T07:57:54.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-23T07:57:54.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-23T07:57:54.820 INFO:tasks.workunit.client.0.trial129.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-23T07:57:54.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:54.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 1 == 4 ']' 2026-02-23T07:57:54.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-23T07:57:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-23T07:57:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-23T07:57:55.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-23T07:57:55.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-23T07:57:55.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-23T07:57:55.200 INFO:tasks.workunit.client.0.trial129.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-23T07:57:55.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-23T07:57:55.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:55.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 2 == 4 ']' 2026-02-23T07:57:55.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-23T07:57:55.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-23T07:57:55.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-23T07:57:55.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-23T07:57:55.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-23T07:57:55.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-23T07:57:55.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-23T07:57:55.580 INFO:tasks.workunit.client.0.trial129.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-23T07:57:55.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:55.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 3 == 4 ']' 2026-02-23T07:57:55.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-23T07:57:55.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-23T07:57:55.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-23T07:57:55.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-23T07:57:55.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-23T07:57:55.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean+scrubbing+deep"' 2026-02-23T07:57:55.957 INFO:tasks.workunit.client.0.trial129.stdout:wait-scrub-end state now: "active+clean+scrubbing+deep" 2026-02-23T07:57:55.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean+scrubbing+deep"' 2026-02-23T07:57:55.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean+scrubbing+deep" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:55.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:427: wait_end_of_scrub: '[' 4 == 4 ']' 2026-02-23T07:57:55.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:428: wait_end_of_scrub: flush_pg_stats 2026-02-23T07:57:55.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:57:55.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:57:56.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:57:56.123 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:57:56.123 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:57:56.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:57:56.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:56.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:57:56.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215110 2026-02-23T07:57:56.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215110 2026-02-23T07:57:56.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110' 2026-02-23T07:57:56.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:56.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:57:56.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-23T07:57:56.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-23T07:57:56.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110 1-38654705674' 2026-02-23T07:57:56.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:57:56.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:57:56.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T07:57:56.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T07:57:56.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110 1-38654705674 2-60129542153' 2026-02-23T07:57:56.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:56.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215110 2026-02-23T07:57:56.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:56.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:57:56.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215110 2026-02-23T07:57:56.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:56.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215110 2026-02-23T07:57:56.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215110' 2026-02-23T07:57:56.345 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215110 2026-02-23T07:57:56.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:56.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215110 2026-02-23T07:57:56.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:57:57.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:57:57.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:57:57.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215110 -lt 103079215110 2026-02-23T07:57:57.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:57.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-23T07:57:57.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:57.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:57:57.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-23T07:57:57.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:57.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-23T07:57:57.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-23T07:57:57.680 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705674 2026-02-23T07:57:57.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:57:57.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-23T07:57:57.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:57:57.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T07:57:57.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:57:57.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:57:57.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T07:57:57.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:57:57.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T07:57:57.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T07:57:57.854 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542153 2026-02-23T07:57:57.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:57:58.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-23T07:57:58.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:430: wait_end_of_scrub: sleep 0.3 2026-02-23T07:57:58.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i++ )) 2026-02-23T07:57:58.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:423: wait_end_of_scrub: (( i < 40 )) 2026-02-23T07:57:58.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: ceph pg 1.0 query --format json 2026-02-23T07:57:58.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: jq .state 2026-02-23T07:57:58.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:424: wait_end_of_scrub: st='"active+clean"' 2026-02-23T07:57:58.396 INFO:tasks.workunit.client.0.trial129.stdout:wait-scrub-end state now: "active+clean" 2026-02-23T07:57:58.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:425: wait_end_of_scrub: echo 'wait-scrub-end state now: ' '"active+clean"' 2026-02-23T07:57:58.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: [[ "active+clean" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:58.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:426: wait_end_of_scrub: break 2026-02-23T07:57:58.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:433: wait_end_of_scrub: [[ "active+clean" =~ (.*scrubbing.*) ]] 2026-02-23T07:57:58.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:438: wait_end_of_scrub: return 0 2026-02-23T07:57:58.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:486: TEST_auto_repair_bluestore_tag: ceph pg dump pgs 2026-02-23T07:57:58.548 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T07:57:58.549 INFO:tasks.workunit.client.0.trial129.stdout:1.0 1 0 0 0 0 7 0 0 1 0 1 active+clean+scrubbing+deep 2026-02-23T07:57:54.033541+0000 20'1 26:54 [1,0] 1 [1,0] 1 0'0 2026-02-23T07:57:35.502933+0000 0'0 2026-02-12T03:09:39.723927+0000 0 0 deep scrubbing for 3s 0 0 2026-02-23T07:57:58.549 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T07:57:58.549 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T07:57:58.549 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T07:57:58.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:490: TEST_auto_repair_bluestore_tag: get_not_primary testpool SOMETHING 2026-02-23T07:57:58.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:57:58.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:57:58.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:57:58.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:57:58.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:57:58.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:58.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:57:58.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:57:58.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:57:58.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:490: TEST_auto_repair_bluestore_tag: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:57:58.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:57:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:57:59.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:57:59.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T07:57:59.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:57:59.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:57:59.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:57:59.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:57:59.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:59.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-23T07:57:59.250 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:57:59.250 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:57:59.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:59.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:57:59.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:57:59.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:57:59.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:57:59.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:57:59.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:57:59.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:57:59.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:57:59.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:57:59.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:57:59.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:57:59.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:57:59.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:57:59.332 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:59.330+0000 7f4195ec3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:59.333 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:59.331+0000 7f4195ec3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:59.334 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:59.332+0000 7f4195ec3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:57:59.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:57:59.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:57:59.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:57:59.547 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:59.545+0000 7f4195ec3780 -1 Falling back to public interface 2026-02-23T07:57:59.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:57:59.919 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:57:59.917+0000 7f4195ec3780 -1 osd.0 26 log_to_monitors true 2026-02-23T07:58:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:00.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:00.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:00.650 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:00.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:00.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:00.815 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 30 up_thru 0 down_at 27 last_clean_interval [24,26) [v2:127.0.0.1:6800/3618524668,v1:127.0.0.1:6801/3618524668] [v2:127.0.0.1:6802/3618524668,v1:127.0.0.1:6803/3618524668] exists,up 46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:58:00.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:00.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:00.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:00.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:00.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:00.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:01.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:01.058 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:01.058 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:01.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:01.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:01.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:01.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-23T07:58:01.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-23T07:58:01.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882' 2026-02-23T07:58:01.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:01.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:01.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-23T07:58:01.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-23T07:58:01.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882 1-38654705676' 2026-02-23T07:58:01.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:01.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:01.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-23T07:58:01.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-23T07:58:01.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-128849018882 1-38654705676 2-60129542155' 2026-02-23T07:58:01.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:01.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-128849018882 2026-02-23T07:58:01.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:01.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:01.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-128849018882 2026-02-23T07:58:01.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:01.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-23T07:58:01.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 128849018882' 2026-02-23T07:58:01.284 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 128849018882 2026-02-23T07:58:01.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:01.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 128849018882 2026-02-23T07:58:01.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:02.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:02.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 128849018882 2026-02-23T07:58:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:03.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:03.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:03.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018882 -lt 128849018882 2026-02-23T07:58:03.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:03.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705676 2026-02-23T07:58:03.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:03.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:03.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-23T07:58:03.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:03.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705676 2026-02-23T07:58:03.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-23T07:58:03.794 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705676 2026-02-23T07:58:03.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:03.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-23T07:58:03.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:03.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-23T07:58:03.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:03.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:03.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-23T07:58:03.965 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-23T07:58:03.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-23T07:58:03.966 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542155 2026-02-23T07:58:03.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:04.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-23T07:58:04.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:04.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:04.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:04.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:04.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:04.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:58:04.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:04.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:04.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:04.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:491: TEST_auto_repair_bluestore_tag: get_not_primary testpool SOMETHING 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool SOMETHING 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T07:58:04.712 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:58:04.713 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:58:04.713 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:58:04.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T07:58:04.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool SOMETHING 2026-02-23T07:58:04.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T07:58:05.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:491: TEST_auto_repair_bluestore_tag: objectstore_tool td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T07:58:05.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:58:05.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T07:58:05.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:05.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:05.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:05.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:05.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:05.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:58:05.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING get-bytes td/osd-scrub-repair/COPY 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:05.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq' 2026-02-23T07:58:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:58:05.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T07:58:05.244 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T07:58:05.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --osd-op-queue=wpq 2026-02-23T07:58:05.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T07:58:05.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T07:58:05.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:58:05.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:58:05.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:58:05.257 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:05.255+0000 7f7d22b50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:05.259 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:05.257+0000 7f7d22b50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:05.259 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:05.258+0000 7f7d22b50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:05.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:05.411 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:58:05.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:05.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:05.430 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:05.427+0000 7f7d22b50780 -1 Falling back to public interface 2026-02-23T07:58:05.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:05.720 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:05.718+0000 7f7d22b50780 -1 osd.0 31 log_to_monitors true 2026-02-23T07:58:06.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:06.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:06.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:06.575 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:06.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:06.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:06.742 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 35 up_thru 0 down_at 32 last_clean_interval [30,31) [v2:127.0.0.1:6800/1314584740,v1:127.0.0.1:6801/1314584740] [v2:127.0.0.1:6802/1314584740,v1:127.0.0.1:6803/1314584740] exists,up 46ca8b89-4abe-4442-9e59-aa7a04c70309 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:06.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:06.744 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:06.744 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:06.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:06.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:06.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:06.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:06.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:06.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:06.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:06.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:06.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:06.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:06.989 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:06.989 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:06.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:06.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:06.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:07.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855362 2026-02-23T07:58:07.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855362 2026-02-23T07:58:07.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855362' 2026-02-23T07:58:07.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:07.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:07.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705678 2026-02-23T07:58:07.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705678 2026-02-23T07:58:07.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855362 1-38654705678' 2026-02-23T07:58:07.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:07.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:07.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-23T07:58:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-23T07:58:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855362 1-38654705678 2-60129542157' 2026-02-23T07:58:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:07.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855362 2026-02-23T07:58:07.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:07.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:07.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855362 2026-02-23T07:58:07.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:07.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855362 2026-02-23T07:58:07.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855362' 2026-02-23T07:58:07.212 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 150323855362 2026-02-23T07:58:07.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:07.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855362 2026-02-23T07:58:07.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:08.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:08.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:08.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855362 2026-02-23T07:58:08.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:09.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:09.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:09.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855362 -lt 150323855362 2026-02-23T07:58:09.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:09.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705678 2026-02-23T07:58:09.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:09.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:09.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705678 2026-02-23T07:58:09.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:09.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705678 2026-02-23T07:58:09.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705678' 2026-02-23T07:58:09.722 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705678 2026-02-23T07:58:09.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:09.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705679 -lt 38654705678 2026-02-23T07:58:09.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:09.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-23T07:58:09.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:09.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:09.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-23T07:58:09.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:09.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-23T07:58:09.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-23T07:58:09.891 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542157 2026-02-23T07:58:09.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:10.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542157 -lt 60129542157 2026-02-23T07:58:10.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:10.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:10.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:10.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T07:58:10.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:10.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:10.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:10.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:10.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:10.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:10.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:10.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T07:58:10.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:10.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:10.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:10.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T07:58:10.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:10.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:10.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:492: TEST_auto_repair_bluestore_tag: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:58:10.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:493: TEST_auto_repair_bluestore_tag: grep scrub_finish td/osd-scrub-repair/osd.1.log 2026-02-23T07:58:10.633 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:57.033+0000 7f19380cc6c0 10 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: scrub_finish before flags: AUTO_REPAIR. repair state: no-repair. deep_scrub_on_error: 0 2026-02-23T07:58:10.634 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:57.033+0000 7f19380cc6c0 10 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+clean+scrubbing+deep(periodic-regular,auto-repair)] scrubber: _scrub_finish info stats: valid m_is_repair: 1 2026-02-23T07:58:10.634 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:57.033+0000 7f19380cc6c0 15 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish: 1 errors. 1 errors fixed 2026-02-23T07:58:10.634 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:57.033+0000 7f19380cc6c0 20 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish All may be fixed 2026-02-23T07:58:10.634 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T07:57:57.033+0000 7f19380cc6c0 19 osd.1 pg_epoch: 26 pg[1.0( v 20'1 (0'0,20'1] local-lis/les=24/25 n=1 ec=16/16 lis/c=24/24 les/c/f=25/25/0 sis=24) [1,0] r=0 lpr=24 crt=20'1 lcod 0'0 mlcod 0'0 active+scrubbing+deep+repair(periodic-regular,auto-repair) mbc={255={(1+0)=1}}] scrubber: scrub_finish shard 1 num_omap_bytes = 0 num_omap_keys = 0 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:10.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:10.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:10.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:10.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:10.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:58:10.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:58:10.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:58:10.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:58:10.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:58:10.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:58:10.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:10.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:58:10.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:58:10.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:10.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:58:10.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:58:10.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:58:10.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:58:10.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:10.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:10.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:58:10.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:58:10.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:10.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:10.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:10.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:58:10.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:58:10.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:58:10.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:58:10.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:58:10.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:58:10.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:10.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:58:10.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:58:10.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:10.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:58:10.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:58:10.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:58:10.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:58:10.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:10.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:10.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:58:10.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:58:10.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:58:10.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:58:10.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:58:10.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:10.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:10.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:58:10.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:58:10.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:58:10.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:58:10.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_erasure_coded_appends td/osd-scrub-repair 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:369: TEST_auto_repair_erasure_coded_appends: auto_repair_erasure_coded td/osd-scrub-repair false 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:328: auto_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:329: auto_repair_erasure_coded: local allow_overwrites=false 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:330: auto_repair_erasure_coded: local poolname=ecpool 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:333: auto_repair_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:58:10.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:10.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:10.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:58:10.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:58:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:58:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:58:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:58:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:58:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:58:10.813 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:58:10.813 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:58:10.813 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:58:10.813 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:58:10.813 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:10.813 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:10.814 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:58:10.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:58:10.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:58:10.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:58:10.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:58:10.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:58:10.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:58:10.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:58:10.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:58:10.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:58:10.871 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:58:10.872 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:58:10.872 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:10.872 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:10.872 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:58:10.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:58:10.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:58:10.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:334: auto_repair_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-23T07:58:10.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:58:10.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:58:10.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:58:10.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:58:10.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:58:10.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:58:11.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:58:11.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:11.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:11.026 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:11.026 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:11.026 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:11.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:11.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:58:11.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:58:11.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:339: auto_repair_erasure_coded: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:11.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: seq 0 2 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:58:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:11.047 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:58:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:11.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:58:11.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:58:11.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e2e824eb-17e0-428d-be65-b469f469b66c 2026-02-23T07:58:11.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e2e824eb-17e0-428d-be65-b469f469b66c' 2026-02-23T07:58:11.049 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 e2e824eb-17e0-428d-be65-b469f469b66c 2026-02-23T07:58:11.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:58:11.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCTCJxpPYtCAxAAub19QL2ehYqfbA4PaR6/AQ== 2026-02-23T07:58:11.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCTCJxpPYtCAxAAub19QL2ehYqfbA4PaR6/AQ=="}' 2026-02-23T07:58:11.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e2e824eb-17e0-428d-be65-b469f469b66c -i td/osd-scrub-repair/0/new.json 2026-02-23T07:58:11.145 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:11.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:58:11.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCTCJxpPYtCAxAAub19QL2ehYqfbA4PaR6/AQ== --osd-uuid e2e824eb-17e0-428d-be65-b469f469b66c 2026-02-23T07:58:11.170 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.168+0000 7fa0fb94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:11.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.169+0000 7fa0fb94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:11.172 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.170+0000 7fa0fb94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:11.172 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.170+0000 7fa0fb94f780 -1 bdev(0x5558bbbdf400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:58:11.173 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.170+0000 7fa0fb94f780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:58:11.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:58:11.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:58:11.625 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:58:11.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:58:11.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:58:11.721 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:58:11.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:58:11.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:11.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:58:11.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:58:11.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:58:11.735 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.732+0000 7f93d9c0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:11.736 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.734+0000 7f93d9c0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:11.737 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.735+0000 7f93d9c0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:11.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:58:11.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:11.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:58:11.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:11.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:11.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:11.815 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:11.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:11.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:11.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:11.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:11.967 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:11.964+0000 7f93d9c0a780 -1 Falling back to public interface 2026-02-23T07:58:12.366 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:12.364+0000 7f93d9c0a780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:58:12.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:12.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:12.908 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:12.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:12.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:12.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:13.000 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2278275836,v1:127.0.0.1:6801/2278275836] [v2:127.0.0.1:6802/2278275836,v1:127.0.0.1:6803/2278275836] exists,up e2e824eb-17e0-428d-be65-b469f469b66c 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:58:13.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:13.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0' 2026-02-23T07:58:13.007 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 2026-02-23T07:58:13.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:58:13.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCVCJxpj2qlABAAhKfYW5lniyx2gJ7NbxeMlg== 2026-02-23T07:58:13.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCVCJxpj2qlABAAhKfYW5lniyx2gJ7NbxeMlg=="}' 2026-02-23T07:58:13.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 -i td/osd-scrub-repair/1/new.json 2026-02-23T07:58:13.100 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:13.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:58:13.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCVCJxpj2qlABAAhKfYW5lniyx2gJ7NbxeMlg== --osd-uuid 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 2026-02-23T07:58:13.123 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.121+0000 7f3926406780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:13.124 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.122+0000 7f3926406780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:13.125 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.123+0000 7f3926406780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:13.126 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.124+0000 7f3926406780 -1 bdev(0x5610cb7b5400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:58:13.126 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.124+0000 7f3926406780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:58:13.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:58:13.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:58:13.567 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:58:13.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:58:13.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:58:13.777 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:58:13.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:58:13.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:13.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:58:13.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:58:13.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:58:13.790 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.788+0000 7f3c2de14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:13.792 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.790+0000 7f3c2de14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:13.792 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:13.790+0000 7f3c2de14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:13.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:58:13.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:13.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:58:13.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:13.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:13.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:13.941 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:13.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:13.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:13.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:14.013 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:14.011+0000 7f3c2de14780 -1 Falling back to public interface 2026-02-23T07:58:14.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:14.358 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:14.355+0000 7f3c2de14780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:58:15.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:15.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:15.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:15.107 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:15.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:15.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:15.268 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1259300190,v1:127.0.0.1:6811/1259300190] [v2:127.0.0.1:6812/1259300190,v1:127.0.0.1:6813/1259300190] exists,up 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 2026-02-23T07:58:15.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:58:15.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:15.274 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:15.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:58:15.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:15.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:58:15.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:58:15.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=124a5207-b487-4fed-93f9-84e07bece68f 2026-02-23T07:58:15.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 124a5207-b487-4fed-93f9-84e07bece68f' 2026-02-23T07:58:15.276 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 124a5207-b487-4fed-93f9-84e07bece68f 2026-02-23T07:58:15.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:58:15.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCXCJxpPmWzEBAAz6UhlGtNDA4Om8L4adXh5g== 2026-02-23T07:58:15.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCXCJxpPmWzEBAAz6UhlGtNDA4Om8L4adXh5g=="}' 2026-02-23T07:58:15.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 124a5207-b487-4fed-93f9-84e07bece68f -i td/osd-scrub-repair/2/new.json 2026-02-23T07:58:15.439 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:58:15.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:58:15.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQCXCJxpPmWzEBAAz6UhlGtNDA4Om8L4adXh5g== --osd-uuid 124a5207-b487-4fed-93f9-84e07bece68f 2026-02-23T07:58:15.465 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:15.463+0000 7fc6e9d50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:15.466 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:15.464+0000 7fc6e9d50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:15.467 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:15.465+0000 7fc6e9d50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:15.468 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:15.466+0000 7fc6e9d50780 -1 bdev(0x561cdd9c5400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:58:15.468 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:15.466+0000 7fc6e9d50780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:58:15.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:58:15.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:58:15.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:58:15.907 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:58:15.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:58:16.118 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:58:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:58:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:58:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:58:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:58:16.131 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:16.129+0000 7fc080809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:16.133 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:16.131+0000 7fc080809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:16.133 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:16.132+0000 7fc080809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:16.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:58:16.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:16.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:58:16.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:16.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:16.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:16.282 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:16.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:16.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:16.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:58:16.352 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:16.350+0000 7fc080809780 -1 Falling back to public interface 2026-02-23T07:58:16.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:16.738 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:16.735+0000 7fc080809780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:58:17.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:17.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:17.447 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:17.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:17.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:17.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:58:17.612 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/425649744,v1:127.0.0.1:6819/425649744] [v2:127.0.0.1:6820/425649744,v1:127.0.0.1:6821/425649744] exists,up 124a5207-b487-4fed-93f9-84e07bece68f 2026-02-23T07:58:17.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:17.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:17.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:17.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: auto_repair_erasure_coded: create_rbd_pool 2026-02-23T07:58:17.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T07:58:17.767 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T07:58:17.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T07:58:17.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T07:58:17.987 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T07:58:17.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:58:19.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T07:58:19.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: auto_repair_erasure_coded: wait_for_clean 2026-02-23T07:58:19.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:19.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:19.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:19.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:19.280 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:19.280 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:19.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:19.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:19.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:19.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:19.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:19.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:19.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:19.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:19.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:19.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:19.525 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:19.525 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:19.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:19.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:19.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:19.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:58:19.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:58:19.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:58:19.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:19.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:19.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-23T07:58:19.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-23T07:58:19.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962' 2026-02-23T07:58:19.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:19.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:19.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T07:58:19.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T07:58:19.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672962 2-60129542146' 2026-02-23T07:58:19.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:19.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:58:19.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:19.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:19.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:58:19.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:19.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:58:19.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:58:19.750 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:58:19.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:19.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:58:19.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:20.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:20.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:21.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:58:21.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:22.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:22.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:22.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:58:22.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:22.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-23T07:58:22.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:22.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:22.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-23T07:58:22.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:22.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-23T07:58:22.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-23T07:58:22.254 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672962 2026-02-23T07:58:22.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:22.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672962 2026-02-23T07:58:22.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:22.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T07:58:22.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:22.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:22.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T07:58:22.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:22.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T07:58:22.420 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T07:58:22.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T07:58:22.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:22.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-23T07:58:22.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:22.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:22.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:22.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:58:22.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:22.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:22.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:22.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:22.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:22.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:22.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:22.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:58:22.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:22.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:22.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:23.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:347: auto_repair_erasure_coded: create_ec_pool ecpool false k=2 m=1 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T07:58:23.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-23T07:58:23.362 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T07:58:23.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T07:58:23.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T07:58:23.667 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T07:58:23.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:58:24.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T07:58:24.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T07:58:24.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:24.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:24.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:24.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:24.684 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:24.684 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:24.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:24.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:24.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:24.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:24.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:24.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:24.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:24.928 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:24.928 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:24.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:24.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:24.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:25.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T07:58:25.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T07:58:25.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T07:58:25.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:25.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:25.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T07:58:25.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T07:58:25.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-23T07:58:25.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:25.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:25.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T07:58:25.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T07:58:25.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964 2-60129542148' 2026-02-23T07:58:25.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:25.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T07:58:25.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:25.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:25.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T07:58:25.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:25.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T07:58:25.157 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T07:58:25.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T07:58:25.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:25.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T07:58:25.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:25.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T07:58:25.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:25.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:25.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T07:58:25.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:25.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T07:58:25.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T07:58:25.328 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T07:58:25.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:25.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672964 2026-02-23T07:58:25.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:26.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:26.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:26.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672963 -lt 42949672964 2026-02-23T07:58:26.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:27.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:27.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:27.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672964 2026-02-23T07:58:27.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:27.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T07:58:27.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:27.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:27.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T07:58:27.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:27.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T07:58:27.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T07:58:27.828 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542148 2026-02-23T07:58:27.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:27.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T07:58:27.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:27.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:27.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:28.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:28.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:58:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:350: auto_repair_erasure_coded: local payload=ABCDEF 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:351: auto_repair_erasure_coded: echo ABCDEF 2026-02-23T07:58:28.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:352: auto_repair_erasure_coded: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:58:28.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-23T07:58:28.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-23T07:58:28.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:58:28.584 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-23T07:58:28.584 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T07:58:28.584 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:58:28.584 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:58:28.584 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:58:28.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-23T07:58:28.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:58:28.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-23T07:58:28.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:58:28.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:58:28.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:28.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:28.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:28.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:28.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:29.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:29.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:58:29.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:58:29.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:58:29.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:58:29.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:58:29.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:58:29.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T07:58:29.150 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T07:58:29.150 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T07:58:29.150 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-23T07:58:29.151 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-23T07:58:29.151 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T07:58:29.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:29.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:29.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:58:29.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:58:29.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:29.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:29.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:58:29.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:58:29.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:58:29.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:58:29.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:58:29.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:29.209+0000 7fe58154f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:29.212 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:29.210+0000 7fe58154f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:29.213 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:29.211+0000 7fe58154f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:29.366 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:58:29.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:29.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:29.407 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:29.405+0000 7fe58154f780 -1 Falling back to public interface 2026-02-23T07:58:29.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:29.708 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:29.706+0000 7fe58154f780 -1 osd.1 28 log_to_monitors true 2026-02-23T07:58:30.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:30.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:30.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:30.534 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:30.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:30.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:30.702 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 32 up_thru 32 down_at 29 last_clean_interval [10,28) [v2:127.0.0.1:6810/1159962395,v1:127.0.0.1:6811/1159962395] [v2:127.0.0.1:6812/1159962395,v1:127.0.0.1:6813/1159962395] exists,up 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 2026-02-23T07:58:30.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:30.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:30.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:30.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:30.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:30.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:30.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:30.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:30.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:30.945 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:30.945 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:30.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:30.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:30.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:31.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T07:58:31.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T07:58:31.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T07:58:31.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:31.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:31.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953474 2026-02-23T07:58:31.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953474 2026-02-23T07:58:31.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474' 2026-02-23T07:58:31.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:31.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:31.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-23T07:58:31.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-23T07:58:31.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474 2-60129542150' 2026-02-23T07:58:31.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:31.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T07:58:31.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:31.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:31.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T07:58:31.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:31.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T07:58:31.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T07:58:31.177 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T07:58:31.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:31.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T07:58:31.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:31.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953474 2026-02-23T07:58:31.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:31.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:31.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953474 2026-02-23T07:58:31.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:31.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953474 2026-02-23T07:58:31.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953474' 2026-02-23T07:58:31.347 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 137438953474 2026-02-23T07:58:31.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:31.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 137438953474 2026-02-23T07:58:31.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:32.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:32.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:32.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 137438953474 2026-02-23T07:58:32.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:33.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:33.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:33.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953474 -lt 137438953474 2026-02-23T07:58:33.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:33.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-23T07:58:33.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:33.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:33.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-23T07:58:33.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:33.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-23T07:58:33.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-23T07:58:33.852 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542150 2026-02-23T07:58:33.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:34.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542150 2026-02-23T07:58:34.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:34.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:34.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:34.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:34.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:34.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:58:34.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:34.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:34.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: get_pg ecpool SOMETHING 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:58:34.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:58:34.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: local pgid=2.0 2026-02-23T07:58:34.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: get_last_scrub_stamp 2.0 2026-02-23T07:58:34.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:58:34.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:58:34.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:58:34.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:58:34.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: wait_for_scrub 2.0 2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:34.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T07:58:34.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:58:34.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:58:35.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:58:32.637324+0000 '>' 2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:35.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:58:36.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:58:36.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:58:36.080 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:58:36.080 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:58:36.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:58:36.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:58:36.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:58:36.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:58:32.637324+0000 '>' 2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:36.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:58:37.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:58:37.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:58:37.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:58:37.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:58:37.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:58:37.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:58:37.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:58:37.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:58:32.637324+0000 '>' 2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:37.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:58:38.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:58:38.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:58:38.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:58:38.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:58:38.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:58:38.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:58:38.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:58:38.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:58:32.637324+0000 '>' 2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:38.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:58:39.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:58:39.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:58:39.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:58:39.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:58:39.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:58:39.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:58:39.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:58:33.657256+0000 '>' 2026-02-23T07:58:32.637324+0000 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:360: auto_repair_erasure_coded: wait_for_clean 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:39.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:39.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:39.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:39.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:39.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:39.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:39.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:39.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:39.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:39.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:39.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:39.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:39.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:39.995 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:39.995 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:39.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:39.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:39.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:40.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-23T07:58:40.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-23T07:58:40.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-23T07:58:40.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:40.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:40.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953477 2026-02-23T07:58:40.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953477 2026-02-23T07:58:40.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-137438953477' 2026-02-23T07:58:40.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:40.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:40.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T07:58:40.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T07:58:40.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-137438953477 2-60129542153' 2026-02-23T07:58:40.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:40.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-23T07:58:40.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:40.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:40.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-23T07:58:40.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:40.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-23T07:58:40.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-23T07:58:40.220 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836490 2026-02-23T07:58:40.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:40.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836490 2026-02-23T07:58:40.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:41.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:41.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:41.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-23T07:58:41.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:41.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953477 2026-02-23T07:58:41.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:41.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:41.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953477 2026-02-23T07:58:41.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:41.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953477 2026-02-23T07:58:41.557 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 137438953477 2026-02-23T07:58:41.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953477' 2026-02-23T07:58:41.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:41.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953477 -lt 137438953477 2026-02-23T07:58:41.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:41.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T07:58:41.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:41.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:41.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T07:58:41.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:41.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T07:58:41.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T07:58:41.727 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542153 2026-02-23T07:58:41.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:41.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-23T07:58:41.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:41.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:41.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:42.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:58:42.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:42.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:42.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:42.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:42.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:42.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:42.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:42.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:58:42.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:42.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:42.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:42.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:58:42.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:42.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:42.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-23T07:58:42.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-23T07:58:42.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:58:42.465 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-23T07:58:42.465 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T07:58:42.465 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:58:42.465 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:58:42.465 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:58:42.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-23T07:58:42.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:58:42.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:58:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:42.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:58:43.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T07:58:43.152 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:43.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:43.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:43.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:58:43.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:58:43.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:58:43.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:58:43.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:58:43.217 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:43.215+0000 7fedd2957780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:43.218 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:43.217+0000 7fedd2957780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:43.219 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:43.217+0000 7fedd2957780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:58:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:58:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:43.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:43.383 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:58:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:43.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:43.415 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:43.413+0000 7fedd2957780 -1 Falling back to public interface 2026-02-23T07:58:43.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:43.732 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:43.730+0000 7fedd2957780 -1 osd.1 35 log_to_monitors true 2026-02-23T07:58:44.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:44.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:44.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:44.550 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:44.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:44.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:44.719 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [32,35) [v2:127.0.0.1:6810/3827037136,v1:127.0.0.1:6811/3827037136] [v2:127.0.0.1:6812/3827037136,v1:127.0.0.1:6813/3827037136] exists,up 2fc6194e-4c35-4f49-ae95-3c0207e7c6a0 2026-02-23T07:58:44.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:44.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:44.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:44.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:44.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:44.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:44.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:44.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:44.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:44.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:44.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:44.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:44.962 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:44.962 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:44.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:44.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:44.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:45.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-23T07:58:45.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-23T07:58:45.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-23T07:58:45.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:45.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:45.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-23T07:58:45.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-23T07:58:45.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-167503724546' 2026-02-23T07:58:45.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:45.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:45.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-23T07:58:45.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-23T07:58:45.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-167503724546 2-60129542155' 2026-02-23T07:58:45.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:45.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-23T07:58:45.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:45.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-23T07:58:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-23T07:58:45.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-23T07:58:45.185 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836492 2026-02-23T07:58:45.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T07:58:45.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:46.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:46.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:46.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T07:58:46.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:47.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:47.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:47.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-23T07:58:47.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:47.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724546 2026-02-23T07:58:47.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:47.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:58:47.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724546 2026-02-23T07:58:47.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:47.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-23T07:58:47.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724546' 2026-02-23T07:58:47.690 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 167503724546 2026-02-23T07:58:47.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:58:47.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-23T07:58:47.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:47.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-23T07:58:47.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:47.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:58:47.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-23T07:58:47.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:47.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-23T07:58:47.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-23T07:58:47.860 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542155 2026-02-23T07:58:47.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:58:48.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-23T07:58:48.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:58:48.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:48.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:48.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:58:48.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:58:48.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:58:48.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:58:48.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:58:48.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:58:48.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:58:48.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:58:48.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:58:48.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:58:48.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:58:48.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:58:48.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:58:48.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:58:48.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:58:48.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:364: auto_repair_erasure_coded: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T07:58:48.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:365: auto_repair_erasure_coded: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:58:48.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:58:48.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:58:48.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:58:48.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:58:48.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:48.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:48.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:48.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:48.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:48.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:48.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:58:48.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:58:48.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:58:48.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:58:48.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:58:48.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:58:48.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:48.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:58:48.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:58:48.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:48.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:58:48.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:58:48.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:58:48.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:58:48.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:48.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:48.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:58:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:58:48.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:58:48.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:58:48.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:58:48.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:58:48.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:58:48.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:58:48.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:58:48.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:58:48.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:58:48.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:58:48.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:58:48.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:58:48.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:48.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:58:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:58:48.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:58:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:58:48.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:58:48.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:58:48.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:58:48.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:48.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:58:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:58:48.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:58:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:58:48.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:58:48.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:48.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:48.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:58:48.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_auto_repair_erasure_coded_overwrites td/osd-scrub-repair 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:373: TEST_auto_repair_erasure_coded_overwrites: '[' true = true ']' 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:374: TEST_auto_repair_erasure_coded_overwrites: auto_repair_erasure_coded td/osd-scrub-repair true 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:328: auto_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:329: auto_repair_erasure_coded: local allow_overwrites=true 2026-02-23T07:58:48.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:330: auto_repair_erasure_coded: local poolname=ecpool 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:333: auto_repair_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:58:48.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:48.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:58:48.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:58:48.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:58:48.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:58:48.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:58:48.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:58:48.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:58:48.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:58:48.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:58:48.858 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:58:48.859 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:58:48.859 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:48.859 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:48.860 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:58:48.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:58:48.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:58:48.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:334: auto_repair_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-23T07:58:48.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:58:48.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:58:48.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:58:48.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:58:48.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:58:48.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:58:49.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:58:49.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:49.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:49.011 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:49.011 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:49.011 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:49.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:49.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:58:49.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:58:49.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:339: auto_repair_erasure_coded: local 'ceph_osd_args=--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:49.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: seq 0 2 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 0 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:58:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:49.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:58:49.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:58:49.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:58:49.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e93db2d8-8acb-4505-9eb1-7cc176b747b4 2026-02-23T07:58:49.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e93db2d8-8acb-4505-9eb1-7cc176b747b4' 2026-02-23T07:58:49.034 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 e93db2d8-8acb-4505-9eb1-7cc176b747b4 2026-02-23T07:58:49.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:58:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC5CJxpvTFXAhAAxyzwEgIg03GhEjh/e3XJlA== 2026-02-23T07:58:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC5CJxpvTFXAhAAxyzwEgIg03GhEjh/e3XJlA=="}' 2026-02-23T07:58:49.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e93db2d8-8acb-4505-9eb1-7cc176b747b4 -i td/osd-scrub-repair/0/new.json 2026-02-23T07:58:49.129 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:49.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:58:49.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQC5CJxpvTFXAhAAxyzwEgIg03GhEjh/e3XJlA== --osd-uuid e93db2d8-8acb-4505-9eb1-7cc176b747b4 2026-02-23T07:58:49.155 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.153+0000 7f6e62169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:49.156 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.154+0000 7f6e62169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:49.157 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.155+0000 7f6e62169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:49.158 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.155+0000 7f6e62169780 -1 bdev(0x55c3dc66d400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:58:49.158 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.155+0000 7f6e62169780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:58:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:58:49.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:58:49.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:58:49.580 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:58:49.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:58:49.675 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:58:49.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:58:49.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:49.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:58:49.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:58:49.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:58:49.690 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.688+0000 7fb706c08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:49.691 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.689+0000 7fb706c08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:49.692 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.690+0000 7fb706c08780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:49.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:49.769 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:49.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:49.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:49.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:49.871 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:49.869+0000 7fb706c08780 -1 Falling back to public interface 2026-02-23T07:58:50.288 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:50.286+0000 7fb706c08780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:58:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:50.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:50.864 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:50.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:58:50.955 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2490664221,v1:127.0.0.1:6801/2490664221] [v2:127.0.0.1:6802/2490664221,v1:127.0.0.1:6803/2490664221] exists,up e93db2d8-8acb-4505-9eb1-7cc176b747b4 2026-02-23T07:58:50.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:50.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:50.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:50.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-23T07:58:50.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:58:50.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:50.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:58:50.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:58:50.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c3333f63-5433-496f-a188-d574fc40abe9 2026-02-23T07:58:50.963 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 c3333f63-5433-496f-a188-d574fc40abe9 2026-02-23T07:58:50.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 c3333f63-5433-496f-a188-d574fc40abe9' 2026-02-23T07:58:50.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:58:50.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC6CJxp97aXORAAmpHTWAoWKtz+CjSQJTba7Q== 2026-02-23T07:58:50.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC6CJxp97aXORAAmpHTWAoWKtz+CjSQJTba7Q=="}' 2026-02-23T07:58:50.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c3333f63-5433-496f-a188-d574fc40abe9 -i td/osd-scrub-repair/1/new.json 2026-02-23T07:58:51.056 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:51.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:58:51.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQC6CJxp97aXORAAmpHTWAoWKtz+CjSQJTba7Q== --osd-uuid c3333f63-5433-496f-a188-d574fc40abe9 2026-02-23T07:58:51.081 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.079+0000 7f7043d57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:51.083 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.081+0000 7f7043d57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:51.084 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.081+0000 7f7043d57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:51.084 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.082+0000 7f7043d57780 -1 bdev(0x55a4e1541400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:58:51.084 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.082+0000 7f7043d57780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:58:51.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:58:51.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:58:51.520 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:58:51.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:58:51.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:58:51.724 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:58:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:58:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:58:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:58:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:58:51.738 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.736+0000 7f137380a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:51.739 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.737+0000 7f137380a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:51.739 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.738+0000 7f137380a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:58:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:58:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:51.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:51.891 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:51.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:51.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:51.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:51.962 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:51.959+0000 7f137380a780 -1 Falling back to public interface 2026-02-23T07:58:52.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:52.329 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:52.327+0000 7f137380a780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:58:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:53.052 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:58:53.216 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2046030798,v1:127.0.0.1:6811/2046030798] [v2:127.0.0.1:6812/2046030798,v1:127.0.0.1:6813/2046030798] exists,up c3333f63-5433-496f-a188-d574fc40abe9 2026-02-23T07:58:53.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:340: auto_repair_erasure_coded: for id in $(seq 0 2) 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:341: auto_repair_erasure_coded: run_osd td/osd-scrub-repair 2 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:58:53.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:58:53.222 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:58:53.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=449fda5e-015d-4a1b-936e-52b59f2e0b42 2026-02-23T07:58:53.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 449fda5e-015d-4a1b-936e-52b59f2e0b42' 2026-02-23T07:58:53.225 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 449fda5e-015d-4a1b-936e-52b59f2e0b42 2026-02-23T07:58:53.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:58:53.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC9CJxp1xCdDRAA4Hon4rUw6+SaqH73UucJLQ== 2026-02-23T07:58:53.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC9CJxp1xCdDRAA4Hon4rUw6+SaqH73UucJLQ=="}' 2026-02-23T07:58:53.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 449fda5e-015d-4a1b-936e-52b59f2e0b42 -i td/osd-scrub-repair/2/new.json 2026-02-23T07:58:53.387 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:58:53.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:58:53.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQC9CJxp1xCdDRAA4Hon4rUw6+SaqH73UucJLQ== --osd-uuid 449fda5e-015d-4a1b-936e-52b59f2e0b42 2026-02-23T07:58:53.412 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:53.410+0000 7f74662c3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:53.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:53.411+0000 7f74662c3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:53.414 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:53.412+0000 7f74662c3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:53.414 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:53.412+0000 7f74662c3780 -1 bdev(0x565280b73400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:58:53.415 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:53.412+0000 7f74662c3780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:58:53.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:58:53.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:58:53.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:58:53.827 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:58:53.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:58:54.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:58:54.030 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:58:54.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:58:54.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:58:54.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:58:54.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:58:54.043 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:54.041+0000 7f79f0f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:54.044 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:54.042+0000 7f79f0f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:54.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:54.043+0000 7f79f0f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:58:54.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:58:54.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:58:54.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:58:54.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:58:54.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:58:54.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:54.196 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:58:54.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:58:54.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:54.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:58:54.285 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:54.283+0000 7f79f0f4f780 -1 Falling back to public interface 2026-02-23T07:58:54.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:58:54.611 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:58:54.609+0000 7f79f0f4f780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:58:55.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:58:55.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:58:55.358 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:58:55.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:58:55.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:58:55.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:58:55.521 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1944978915,v1:127.0.0.1:6819/1944978915] [v2:127.0.0.1:6820/1944978915,v1:127.0.0.1:6821/1944978915] exists,up 449fda5e-015d-4a1b-936e-52b59f2e0b42 2026-02-23T07:58:55.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:58:55.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:58:55.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:58:55.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:343: auto_repair_erasure_coded: create_rbd_pool 2026-02-23T07:58:55.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T07:58:55.674 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T07:58:55.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T07:58:55.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T07:58:55.892 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T07:58:55.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:58:56.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T07:58:57.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:344: auto_repair_erasure_coded: wait_for_clean 2026-02-23T07:58:57.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:58:57.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:58:57.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:58:57.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:58:57.184 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:58:57.184 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:58:57.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:58:57.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:58:57.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:58:57.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:58:57.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:58:57.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:58:57.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:58:57.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:58:57.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:58:57.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:58:57.425 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:58:57.425 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:58:57.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:58:57.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:57.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:58:57.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:58:57.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:58:57.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:58:57.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:57.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:58:57.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-23T07:58:57.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-23T07:58:57.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666' 2026-02-23T07:58:57.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:58:57.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:58:57.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574850 2026-02-23T07:58:57.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574850 2026-02-23T07:58:57.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666 2-55834574850' 2026-02-23T07:58:57.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:58:57.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:58:57.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:58:57.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:58:57.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:58:57.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:58:57.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:58:57.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:58:57.647 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:58:57.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:57.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:58:57.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:58.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:58:58.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:58:58.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:58:58.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:58:59.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:58:59.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:00.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:59:00.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:00.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-23T07:59:00.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:00.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:00.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-23T07:59:00.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:00.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-23T07:59:00.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-23T07:59:00.147 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705666 2026-02-23T07:59:00.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:00.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705666 2026-02-23T07:59:00.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:00.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574850 2026-02-23T07:59:00.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:00.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:00.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574850 2026-02-23T07:59:00.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:00.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574850 2026-02-23T07:59:00.314 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574850 2026-02-23T07:59:00.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574850' 2026-02-23T07:59:00.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:00.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574850 -lt 55834574850 2026-02-23T07:59:00.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:00.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:00.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:00.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:00.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:59:00.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:00.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:00.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:347: auto_repair_erasure_coded: create_ec_pool ecpool true k=2 m=1 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T07:59:01.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-23T07:59:01.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T07:59:01.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-23T07:59:01.259 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T07:59:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T07:59:01.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T07:59:01.565 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T07:59:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:59:02.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-23T07:59:02.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-23T07:59:02.787 INFO:tasks.workunit.client.0.trial129.stderr:set pool 2 allow_ec_overwrites to true 2026-02-23T07:59:02.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T07:59:02.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:02.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:02.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:02.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:02.800 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:02.800 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:02.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:02.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:02.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:02.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:02.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:02.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:02.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:02.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:02.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:03.040 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:03.040 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:59:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:03.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:03.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:03.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T07:59:03.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T07:59:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T07:59:03.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:03.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:03.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T07:59:03.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T07:59:03.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-23T07:59:03.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:03.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:03.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-23T07:59:03.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-23T07:59:03.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574852' 2026-02-23T07:59:03.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:03.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T07:59:03.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:03.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:03.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T07:59:03.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:03.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T07:59:03.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T07:59:03.265 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T07:59:03.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:03.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T07:59:03.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:04.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:04.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:04.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T07:59:04.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:05.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:59:05.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:05.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T07:59:05.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:05.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T07:59:05.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:05.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:05.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T07:59:05.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:05.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T07:59:05.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T07:59:05.765 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T07:59:05.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:05.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705668 2026-02-23T07:59:05.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:05.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574852 2026-02-23T07:59:05.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:05.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:05.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-23T07:59:05.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:05.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574852 2026-02-23T07:59:05.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-23T07:59:05.932 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574852 2026-02-23T07:59:05.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:06.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-23T07:59:06.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:06.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:06.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:06.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:06.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:06.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:06.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:06.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:06.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:350: auto_repair_erasure_coded: local payload=ABCDEF 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:351: auto_repair_erasure_coded: echo ABCDEF 2026-02-23T07:59:06.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:352: auto_repair_erasure_coded: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:59:06.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-23T07:59:06.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-23T07:59:06.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:59:06.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-23T07:59:06.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T07:59:06.683 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:59:06.683 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:06.683 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:59:06.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-23T07:59:06.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:06.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-23T07:59:07.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:356: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:59:07.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:59:07.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:59:07.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:07.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:07.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:07.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:07.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:07.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:07.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:59:07.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:59:07.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:59:07.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:59:07.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:59:07.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:07.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T07:59:07.442 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T07:59:07.443 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T07:59:07.443 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-23T07:59:07.443 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-23T07:59:07.444 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T07:59:07.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:59:07.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:07.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:59:07.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:59:07.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:59:07.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:07.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:59:07.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:59:07.522 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:07.520+0000 7f6a6218b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:07.524 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:07.522+0000 7f6a6218b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:07.524 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:07.522+0000 7f6a6218b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:07.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:59:07.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:07.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:07.722 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:07.719+0000 7f6a6218b780 -1 Falling back to public interface 2026-02-23T07:59:07.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:08.112 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:08.109+0000 7f6a6218b780 -1 osd.1 28 log_to_monitors true 2026-02-23T07:59:08.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:08.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:08.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:08.843 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:08.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:08.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:09.010 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 32 up_thru 32 down_at 29 last_clean_interval [9,28) [v2:127.0.0.1:6810/3300391193,v1:127.0.0.1:6811/3300391193] [v2:127.0.0.1:6812/3300391193,v1:127.0.0.1:6813/3300391193] exists,up c3333f63-5433-496f-a188-d574fc40abe9 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:09.011 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:09.012 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:09.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:09.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:09.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:09.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:09.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:09.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:09.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:09.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:09.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:09.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:09.252 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:09.252 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:59:09.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:09.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:09.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:09.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T07:59:09.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T07:59:09.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T07:59:09.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:09.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:09.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953474 2026-02-23T07:59:09.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953474 2026-02-23T07:59:09.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474' 2026-02-23T07:59:09.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:09.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:09.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-23T07:59:09.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-23T07:59:09.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-137438953474 2-55834574854' 2026-02-23T07:59:09.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:09.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T07:59:09.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:09.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:09.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T07:59:09.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:09.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T07:59:09.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T07:59:09.475 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T07:59:09.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:09.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T07:59:09.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:10.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:10.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:10.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T07:59:10.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:11.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:59:11.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:11.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T07:59:11.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:11.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953474 2026-02-23T07:59:11.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:11.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:11.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953474 2026-02-23T07:59:11.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:11.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953474 2026-02-23T07:59:11.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953474' 2026-02-23T07:59:11.984 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 137438953474 2026-02-23T07:59:11.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:12.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953474 -lt 137438953474 2026-02-23T07:59:12.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:12.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574854 2026-02-23T07:59:12.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:12.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:12.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-23T07:59:12.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:12.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574854 2026-02-23T07:59:12.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-23T07:59:12.155 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574854 2026-02-23T07:59:12.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:12.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574855 -lt 55834574854 2026-02-23T07:59:12.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:12.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:12.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:12.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:12.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:12.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:12.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:12.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:12.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:12.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:12.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:12.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: get_pg ecpool SOMETHING 2026-02-23T07:59:12.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T07:59:12.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:59:12.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:12.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:59:13.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:358: auto_repair_erasure_coded: local pgid=2.0 2026-02-23T07:59:13.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: get_last_scrub_stamp 2.0 2026-02-23T07:59:13.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:13.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:13.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:13.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:13.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:359: auto_repair_erasure_coded: wait_for_scrub 2.0 2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:13.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T07:59:13.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:13.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:59:13.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:59:13.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:13.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:13.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:13.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:13.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:13.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:13.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:06.675355+0000 '>' 2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:13.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:59:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:59:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:14.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:14.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:14.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:14.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:14.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:14.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:06.675355+0000 '>' 2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:14.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:59:15.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:59:15.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:15.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:15.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:15.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:15.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:15.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:15.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:06.675355+0000 '>' 2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:15.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:59:16.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:59:16.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:16.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:16.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:16.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:16.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:16.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:16.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:06.675355+0000 '>' 2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:16.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:59:17.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:59:17.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:17.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:17.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:17.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:17.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:17.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:18.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:15.688028+0000 '>' 2026-02-23T07:59:06.675355+0000 2026-02-23T07:59:18.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:59:18.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:360: auto_repair_erasure_coded: wait_for_clean 2026-02-23T07:59:18.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:18.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:18.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:18.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:18.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:18.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:18.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:18.318 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:18.318 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:59:18.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:18.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:18.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-23T07:59:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-23T07:59:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-23T07:59:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:18.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:18.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953477 2026-02-23T07:59:18.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953477 2026-02-23T07:59:18.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-137438953477' 2026-02-23T07:59:18.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:18.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:18.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-23T07:59:18.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-23T07:59:18.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-137438953477 2-55834574857' 2026-02-23T07:59:18.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:18.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-23T07:59:18.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:18.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:18.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-23T07:59:18.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:18.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-23T07:59:18.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-23T07:59:18.544 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836490 2026-02-23T07:59:18.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:18.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836490 2026-02-23T07:59:18.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:19.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:19.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:19.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-23T07:59:19.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:19.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-137438953477 2026-02-23T07:59:19.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:19.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:19.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-137438953477 2026-02-23T07:59:19.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:19.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953477 2026-02-23T07:59:19.881 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 137438953477 2026-02-23T07:59:19.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 137438953477' 2026-02-23T07:59:19.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:20.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953477 -lt 137438953477 2026-02-23T07:59:20.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:20.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574857 2026-02-23T07:59:20.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:20.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:20.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-23T07:59:20.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574857 2026-02-23T07:59:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-23T07:59:20.051 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574857 2026-02-23T07:59:20.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:20.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-23T07:59:20.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:20.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:20.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:20.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:20.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:20.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:20.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:20.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:20.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:20.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: get_not_primary ecpool SOMETHING 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=ecpool 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary ecpool SOMETHING 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T07:59:20.794 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:59:20.795 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:20.795 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:59:20.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=2 2026-02-23T07:59:20.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:20.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 2)) | .[0]' 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:363: auto_repair_erasure_coded: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:59:21.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:21.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T07:59:21.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T07:59:21.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T07:59:21.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::deep_scrub_1.0:head#, (61) No data available 2026-02-23T07:59:21.497 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#-3:00000000:::scrub_1.0:head#, (61) No data available 2026-02-23T07:59:21.498 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:59:21.498 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T07:59:21.498 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:59:21.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:59:21.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:21.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:59:21.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:59:21.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:21.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:21.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-auto-repair=true --osd-deep-scrub-interval=5 --osd-scrub-max-interval=5 --osd-scrub-min-interval=5 --osd-scrub-interval-randomize-ratio=0 2026-02-23T07:59:21.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:59:21.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:59:21.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:59:21.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:59:21.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:59:21.557 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:21.556+0000 7f6e0078a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:21.558 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:21.557+0000 7f6e0078a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:21.559 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:21.558+0000 7f6e0078a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:21.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:59:21.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:21.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:21.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:21.723 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:21.722+0000 7f6e0078a780 -1 Falling back to public interface 2026-02-23T07:59:21.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:22.060 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:22.059+0000 7f6e0078a780 -1 osd.1 35 log_to_monitors true 2026-02-23T07:59:22.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:22.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:22.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:22.878 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:22.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:22.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:23.043 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 39 up_thru 39 down_at 36 last_clean_interval [32,35) [v2:127.0.0.1:6810/3534415986,v1:127.0.0.1:6811/3534415986] [v2:127.0.0.1:6812/3534415986,v1:127.0.0.1:6813/3534415986] exists,up c3333f63-5433-496f-a188-d574fc40abe9 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:23.044 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:23.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:23.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:23.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:23.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:23.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:23.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:23.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:23.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:23.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:23.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:23.290 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:23.290 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T07:59:23.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:23.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:23.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:23.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-23T07:59:23.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-23T07:59:23.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-23T07:59:23.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:23.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:23.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-23T07:59:23.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-23T07:59:23.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-167503724546' 2026-02-23T07:59:23.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:23.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574859 2026-02-23T07:59:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574859 2026-02-23T07:59:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-167503724546 2-55834574859' 2026-02-23T07:59:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:23.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-23T07:59:23.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:23.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:23.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-23T07:59:23.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:23.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-23T07:59:23.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-23T07:59:23.514 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836492 2026-02-23T07:59:23.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:23.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T07:59:23.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:24.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:24.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:24.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T07:59:24.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:25.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T07:59:25.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:26.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-23T07:59:26.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:26.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-167503724546 2026-02-23T07:59:26.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:26.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:26.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-167503724546 2026-02-23T07:59:26.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:26.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-23T07:59:26.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 167503724546' 2026-02-23T07:59:26.017 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 167503724546 2026-02-23T07:59:26.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:26.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-23T07:59:26.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:26.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574859 2026-02-23T07:59:26.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:26.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:26.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574859 2026-02-23T07:59:26.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:26.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574859 2026-02-23T07:59:26.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574859' 2026-02-23T07:59:26.187 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574859 2026-02-23T07:59:26.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:26.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574859 -lt 55834574859 2026-02-23T07:59:26.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:26.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:26.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:26.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:26.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:26.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:26.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:26.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:26.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:26.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:26.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:26.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:26.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:26.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:26.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:364: auto_repair_erasure_coded: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T07:59:26.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:365: auto_repair_erasure_coded: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:59:26.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T07:59:26.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:59:26.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:59:26.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:59:26.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:26.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:26.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:26.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:26.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:27.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:27.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:59:27.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:59:27.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:59:27.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:59:27.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:59:27.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:59:27.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:59:27.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:59:27.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:59:27.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:59:27.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:59:27.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:59:27.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:59:27.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:59:27.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:59:27.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:59:27.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:59:27.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T07:59:27.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:27.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:27.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:27.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T07:59:27.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T07:59:27.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T07:59:27.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T07:59:27.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T07:59:27.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T07:59:27.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:59:27.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T07:59:27.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T07:59:27.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T07:59:27.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T07:59:27.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T07:59:27.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T07:59:27.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T07:59:27.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T07:59:27.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T07:59:27.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T07:59:27.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T07:59:27.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T07:59:27.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T07:59:27.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T07:59:27.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T07:59:27.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T07:59:27.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_jerasure_appends td/osd-scrub-repair 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:874: TEST_corrupt_and_repair_jerasure_appends: corrupt_and_repair_jerasure td/osd-scrub-repair false 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:857: corrupt_and_repair_jerasure: local dir=td/osd-scrub-repair 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:858: corrupt_and_repair_jerasure: local allow_overwrites=false 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:859: corrupt_and_repair_jerasure: local poolname=ecpool 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:861: corrupt_and_repair_jerasure: run_mon td/osd-scrub-repair a 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T07:59:27.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T07:59:27.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T07:59:27.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T07:59:27.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:27.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:27.095 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:27.095 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.095 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:27.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T07:59:27.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T07:59:27.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T07:59:27.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:59:27.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T07:59:27.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T07:59:27.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T07:59:27.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T07:59:27.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T07:59:27.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.177 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T07:59:27.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T07:59:27.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T07:59:27.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:862: corrupt_and_repair_jerasure: run_mgr td/osd-scrub-repair x 2026-02-23T07:59:27.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T07:59:27.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T07:59:27.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T07:59:27.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T07:59:27.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T07:59:27.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T07:59:27.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T07:59:27.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:27.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:27.328 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:27.328 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.328 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:27.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:59:27.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T07:59:27.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: seq 0 3 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 0 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:27.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:27.348 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:27.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:59:27.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T07:59:27.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T07:59:27.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:59:27.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5ca80c5b-9ea3-4bfd-a738-4f6f9063248e 2026-02-23T07:59:27.350 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 5ca80c5b-9ea3-4bfd-a738-4f6f9063248e 2026-02-23T07:59:27.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5ca80c5b-9ea3-4bfd-a738-4f6f9063248e' 2026-02-23T07:59:27.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:59:27.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDfCJxp0ZQuFRAAPcBQVfpAG8DQ0/rzHXrKhw== 2026-02-23T07:59:27.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDfCJxp0ZQuFRAAPcBQVfpAG8DQ0/rzHXrKhw=="}' 2026-02-23T07:59:27.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5ca80c5b-9ea3-4bfd-a738-4f6f9063248e -i td/osd-scrub-repair/0/new.json 2026-02-23T07:59:27.444 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:59:27.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T07:59:27.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDfCJxp0ZQuFRAAPcBQVfpAG8DQ0/rzHXrKhw== --osd-uuid 5ca80c5b-9ea3-4bfd-a738-4f6f9063248e 2026-02-23T07:59:27.468 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:27.467+0000 7f30ca60a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:27.470 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:27.469+0000 7f30ca60a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:27.470 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:27.469+0000 7f30ca60a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:27.471 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:27.469+0000 7f30ca60a780 -1 bdev(0x561679b45400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T07:59:27.471 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:27.470+0000 7f30ca60a780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T07:59:27.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T07:59:27.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:59:27.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T07:59:27.933 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T07:59:27.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:59:28.030 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T07:59:28.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T07:59:28.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:28.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:59:28.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:59:28.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:59:28.043 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:28.042+0000 7efd7d00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:28.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:28.044+0000 7efd7d00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:28.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:28.045+0000 7efd7d00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:28.124 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:59:28.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:28.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:28.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:59:28.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:28.276 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:28.275+0000 7efd7d00f780 -1 Falling back to public interface 2026-02-23T07:59:28.627 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:28.625+0000 7efd7d00f780 -1 osd.0 0 log_to_monitors true 2026-02-23T07:59:29.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:29.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:29.218 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:59:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:29.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T07:59:29.310 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/126778739,v1:127.0.0.1:6801/126778739] [v2:127.0.0.1:6802/126778739,v1:127.0.0.1:6803/126778739] exists,up 5ca80c5b-9ea3-4bfd-a738-4f6f9063248e 2026-02-23T07:59:29.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 1 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:29.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:29.316 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:29.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 bef3305e-980b-4f8e-9826-71bd040e0dbe' 2026-02-23T07:59:29.318 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T07:59:29.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:59:29.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDhCJxpGtgqExAAZ3/CW8CmMNuFnRZozi2gqw== 2026-02-23T07:59:29.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDhCJxpGtgqExAAZ3/CW8CmMNuFnRZozi2gqw=="}' 2026-02-23T07:59:29.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bef3305e-980b-4f8e-9826-71bd040e0dbe -i td/osd-scrub-repair/1/new.json 2026-02-23T07:59:29.410 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:59:29.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T07:59:29.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDhCJxpGtgqExAAZ3/CW8CmMNuFnRZozi2gqw== --osd-uuid bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T07:59:29.433 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:29.432+0000 7f0fa7752780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:29.434 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:29.433+0000 7f0fa7752780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:29.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:29.434+0000 7f0fa7752780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:29.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:29.434+0000 7f0fa7752780 -1 bdev(0x5565fc757400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T07:59:29.436 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:29.434+0000 7f0fa7752780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T07:59:29.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T07:59:29.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:59:29.854 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T07:59:29.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T07:59:29.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:59:30.059 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T07:59:30.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T07:59:30.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:30.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:59:30.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:59:30.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:59:30.071 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:30.070+0000 7fce8bc06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:30.072 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:30.072+0000 7fce8bc06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:30.073 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:30.072+0000 7fce8bc06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:30.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:30.244 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:30.243+0000 7fce8bc06780 -1 Falling back to public interface 2026-02-23T07:59:30.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:30.616 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:30.615+0000 7fce8bc06780 -1 osd.1 0 log_to_monitors true 2026-02-23T07:59:31.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:31.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:31.393 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:59:31.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:31.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:31.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:31.558 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4268554479,v1:127.0.0.1:6811/4268554479] [v2:127.0.0.1:6812/4268554479,v1:127.0.0.1:6813/4268554479] exists,up bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T07:59:31.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:31.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:31.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:31.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 2 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T07:59:31.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T07:59:31.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:59:31.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=621b9b28-fe3b-4b10-9ea9-9f403474c61d 2026-02-23T07:59:31.566 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 621b9b28-fe3b-4b10-9ea9-9f403474c61d 2026-02-23T07:59:31.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 621b9b28-fe3b-4b10-9ea9-9f403474c61d' 2026-02-23T07:59:31.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:59:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDjCJxpNj3qIRAAWRCPgh1MVFbUjcw364N3lw== 2026-02-23T07:59:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDjCJxpNj3qIRAAWRCPgh1MVFbUjcw364N3lw=="}' 2026-02-23T07:59:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 621b9b28-fe3b-4b10-9ea9-9f403474c61d -i td/osd-scrub-repair/2/new.json 2026-02-23T07:59:31.734 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T07:59:31.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T07:59:31.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDjCJxpNj3qIRAAWRCPgh1MVFbUjcw364N3lw== --osd-uuid 621b9b28-fe3b-4b10-9ea9-9f403474c61d 2026-02-23T07:59:31.757 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:31.756+0000 7f028654f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:31.759 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:31.757+0000 7f028654f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:31.759 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:31.758+0000 7f028654f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:31.760 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:31.759+0000 7f028654f780 -1 bdev(0x55588ee03400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T07:59:31.760 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:31.759+0000 7f028654f780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T07:59:32.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T07:59:32.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:59:32.143 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T07:59:32.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T07:59:32.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:59:32.349 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T07:59:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T07:59:32.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:59:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:59:32.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:59:32.361 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:32.360+0000 7f189ad71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:32.363 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:32.362+0000 7f189ad71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:32.364 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:32.362+0000 7f189ad71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:32.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:59:32.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:32.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:59:32.569 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:32.567+0000 7f189ad71780 -1 Falling back to public interface 2026-02-23T07:59:32.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:32.900 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:32.899+0000 7f189ad71780 -1 osd.2 0 log_to_monitors true 2026-02-23T07:59:33.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:33.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:33.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:33.678 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:59:33.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:33.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T07:59:33.840 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2065399198,v1:127.0.0.1:6819/2065399198] [v2:127.0.0.1:6820/2065399198,v1:127.0.0.1:6821/2065399198] exists,up 621b9b28-fe3b-4b10-9ea9-9f403474c61d 2026-02-23T07:59:33.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:33.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:33.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 3 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:33.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:33.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T07:59:33.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T07:59:33.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T07:59:33.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T07:59:33.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T07:59:33.848 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T07:59:33.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 19501243-6e2d-4998-9e3a-a1c25cc2c9fc' 2026-02-23T07:59:33.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T07:59:33.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlCJxpOXG/MhAAJVos/JCJKlR/IRFXBxYQjw== 2026-02-23T07:59:33.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlCJxpOXG/MhAAJVos/JCJKlR/IRFXBxYQjw=="}' 2026-02-23T07:59:33.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 19501243-6e2d-4998-9e3a-a1c25cc2c9fc -i td/osd-scrub-repair/3/new.json 2026-02-23T07:59:34.013 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T07:59:34.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-23T07:59:34.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlCJxpOXG/MhAAJVos/JCJKlR/IRFXBxYQjw== --osd-uuid 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T07:59:34.037 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.036+0000 7f2af3610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:34.038 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.037+0000 7f2af3610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:34.039 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.038+0000 7f2af3610780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:34.039 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.038+0000 7f2af3610780 -1 bdev(0x56264c593400 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-23T07:59:34.039 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.038+0000 7f2af3610780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-23T07:59:34.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-23T07:59:34.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T07:59:34.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T07:59:34.451 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T07:59:34.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T07:59:34.655 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T07:59:34.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T07:59:34.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:34.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T07:59:34.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T07:59:34.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T07:59:34.667 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.666+0000 7f318b58c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:34.668 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.667+0000 7f318b58c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:34.669 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.668+0000 7f318b58c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:34.821 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T07:59:34.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:34.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:59:34.829 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:34.828+0000 7f318b58c780 -1 Falling back to public interface 2026-02-23T07:59:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:35.222 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:35.221+0000 7f318b58c780 -1 osd.3 0 log_to_monitors true 2026-02-23T07:59:35.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:35.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:35.984 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T07:59:35.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:35.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:35.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:59:36.150 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1575185815,v1:127.0.0.1:6827/1575185815] [v2:127.0.0.1:6828/1575185815,v1:127.0.0.1:6829/1575185815] exists,up 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T07:59:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:866: corrupt_and_repair_jerasure: create_rbd_pool 2026-02-23T07:59:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T07:59:36.307 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T07:59:36.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T07:59:36.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T07:59:36.525 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T07:59:36.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:59:37.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:867: corrupt_and_repair_jerasure: wait_for_clean 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:37.780 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:37.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:37.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:37.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:37.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:37.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:37.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:37.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:38.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T07:59:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T07:59:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T07:59:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:38.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:38.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T07:59:38.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T07:59:38.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672964' 2026-02-23T07:59:38.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:38.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:38.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T07:59:38.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T07:59:38.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672964 2-60129542146' 2026-02-23T07:59:38.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:38.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T07:59:38.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378626 2026-02-23T07:59:38.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378626 2026-02-23T07:59:38.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672964 2-60129542146 3-81604378626' 2026-02-23T07:59:38.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:38.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T07:59:38.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:38.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:38.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T07:59:38.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:38.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T07:59:38.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T07:59:38.318 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T07:59:38.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:38.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T07:59:38.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:39.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:39.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:39.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T07:59:39.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:39.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T07:59:39.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:39.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:39.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T07:59:39.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:39.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T07:59:39.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T07:59:39.650 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T07:59:39.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:39.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-23T07:59:39.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:39.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T07:59:39.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:39.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:39.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T07:59:39.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:39.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T07:59:39.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T07:59:39.819 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T07:59:39.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:39.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-23T07:59:39.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:39.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378626 2026-02-23T07:59:39.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:39.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T07:59:39.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378626 2026-02-23T07:59:39.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:39.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378626 2026-02-23T07:59:39.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378626' 2026-02-23T07:59:39.985 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 81604378626 2026-02-23T07:59:39.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T07:59:40.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378626 -lt 81604378626 2026-02-23T07:59:40.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:40.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:40.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:40.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T07:59:40.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:40.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:40.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:40.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:40.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:40.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:40.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:40.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T07:59:40.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:40.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:40.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:40.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:869: corrupt_and_repair_jerasure: create_ec_pool ecpool false k=2 m=2 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T07:59:40.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-23T07:59:40.936 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T07:59:40.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T07:59:40.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T07:59:41.243 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T07:59:41.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T07:59:42.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T07:59:42.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T07:59:42.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:42.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:42.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:42.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:42.256 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:42.256 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:42.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:42.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:42.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:42.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:42.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:42.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:42.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:42.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:42.502 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:42.502 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:59:42.502 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T07:59:42.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:42.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:42.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:42.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T07:59:42.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T07:59:42.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T07:59:42.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:42.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:42.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-23T07:59:42.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-23T07:59:42.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672966' 2026-02-23T07:59:42.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:42.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:42.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T07:59:42.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T07:59:42.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672966 2-60129542148' 2026-02-23T07:59:42.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:42.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T07:59:42.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378628 2026-02-23T07:59:42.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378628 2026-02-23T07:59:42.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672966 2-60129542148 3-81604378628' 2026-02-23T07:59:42.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:42.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T07:59:42.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:42.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:42.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T07:59:42.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:42.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T07:59:42.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T07:59:42.799 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T07:59:42.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:42.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T07:59:42.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:43.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:43.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:44.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T07:59:44.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:44.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-23T07:59:44.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:44.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:44.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-23T07:59:44.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:44.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-23T07:59:44.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-23T07:59:44.136 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672966 2026-02-23T07:59:44.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:44.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-23T07:59:44.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:44.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T07:59:44.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:44.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:44.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T07:59:44.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:44.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T07:59:44.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T07:59:44.305 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542148 2026-02-23T07:59:44.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:44.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T07:59:44.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:44.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378628 2026-02-23T07:59:44.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:44.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T07:59:44.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378628 2026-02-23T07:59:44.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:44.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378628 2026-02-23T07:59:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378628' 2026-02-23T07:59:44.475 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 81604378628 2026-02-23T07:59:44.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T07:59:44.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378628 -lt 81604378628 2026-02-23T07:59:44.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:44.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:44.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:44.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:44.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:45.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:45.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:45.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:45.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:870: corrupt_and_repair_jerasure: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-23T07:59:45.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-23T07:59:45.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T07:59:45.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T07:59:45.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T07:59:45.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T07:59:45.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T07:59:45.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T07:59:45.463 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T07:59:45.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T07:59:45.664 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T07:59:45.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T07:59:45.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T07:59:45.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T07:59:45.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-23T07:59:45.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T07:59:45.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T07:59:45.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:45.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T07:59:45.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-23T07:59:45.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-23T07:59:45.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T07:59:45.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-23T07:59:45.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-23T07:59:45.859 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:45.859 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T07:59:46.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-23T07:59:46.023 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:46.024 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:59:46.024 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T07:59:46.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 0 2026-02-23T07:59:46.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('1' '2' '0') 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=1 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=2 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:59:46.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:46.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:46.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:46.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T07:59:46.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:59:46.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:59:46.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T07:59:46.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:59:46.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T07:59:46.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T07:59:46.445 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T07:59:46.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:46.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T07:59:46.491 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T07:59:46.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:46.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T07:59:46.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T07:59:46.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:59:46.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:59:46.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:59:46.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:46.500+0000 7f3196179780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:46.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:46.501+0000 7f3196179780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:46.503 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:46.502+0000 7f3196179780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:46.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:46.656 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:59:46.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:46.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:59:46.721 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:46.719+0000 7f3196179780 -1 Falling back to public interface 2026-02-23T07:59:46.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:47.050 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:47.048+0000 7f3196179780 -1 osd.3 34 log_to_monitors true 2026-02-23T07:59:47.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:47.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:47.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:47.821 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:47.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:47.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:59:47.987 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 38 up_thru 38 down_at 35 last_clean_interval [19,34) [v2:127.0.0.1:6826/1439796340,v1:127.0.0.1:6827/1439796340] [v2:127.0.0.1:6828/1439796340,v1:127.0.0.1:6829/1439796340] exists,up 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:47.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:47.989 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:47.989 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:47.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:47.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:47.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:48.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:48.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:48.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:48.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:48.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:48.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:48.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:48.232 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:48.232 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:59:48.232 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T07:59:48.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:48.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:48.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:48.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T07:59:48.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T07:59:48.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T07:59:48.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:48.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672968 2026-02-23T07:59:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672968 2026-02-23T07:59:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968' 2026-02-23T07:59:48.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:48.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:48.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-23T07:59:48.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-23T07:59:48.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968 2-60129542150' 2026-02-23T07:59:48.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:48.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T07:59:48.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757250 2026-02-23T07:59:48.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757250 2026-02-23T07:59:48.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968 2-60129542150 3-163208757250' 2026-02-23T07:59:48.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:48.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T07:59:48.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:48.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:48.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T07:59:48.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:48.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T07:59:48.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T07:59:48.532 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T07:59:48.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:48.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T07:59:48.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:49.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:49.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:49.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T07:59:49.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:49.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672968 2026-02-23T07:59:49.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:49.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:49.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672968 2026-02-23T07:59:49.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:49.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672968 2026-02-23T07:59:49.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2026-02-23T07:59:49.865 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672968 2026-02-23T07:59:49.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:50.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672968 -lt 42949672968 2026-02-23T07:59:50.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:50.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-23T07:59:50.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:50.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:50.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-23T07:59:50.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:50.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-23T07:59:50.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-23T07:59:50.031 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542150 2026-02-23T07:59:50.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:50.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542150 2026-02-23T07:59:50.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:50.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-163208757250 2026-02-23T07:59:50.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T07:59:50.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-163208757250 2026-02-23T07:59:50.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:50.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757250 2026-02-23T07:59:50.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 163208757250' 2026-02-23T07:59:50.203 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 163208757250 2026-02-23T07:59:50.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T07:59:50.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757250 -lt 163208757250 2026-02-23T07:59:50.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:50.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:50.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:50.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:50.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:50.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:50.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:50.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T07:59:50.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T07:59:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T07:59:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T07:59:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T07:59:51.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T07:59:51.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:51.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:51.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:51.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:51.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T07:59:41.240417+0000 2026-02-23T07:59:51.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T07:59:51.426 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T07:59:41.240417+0000 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:59:41.240417+0000 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:51.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:51.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:51.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:41.240417+0000 '>' 2026-02-23T07:59:41.240417+0000 2026-02-23T07:59:51.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:41.240417+0000 '>' 2026-02-23T07:59:41.240417+0000 2026-02-23T07:59:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T07:59:53.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T07:59:53.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T07:59:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T07:59:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T07:59:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T07:59:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T07:59:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:51.968627+0000 '>' 2026-02-23T07:59:41.240417+0000 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:54.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:54.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T07:59:54.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:59:54.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:59:54.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T07:59:54.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:59:54.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T07:59:54.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T07:59:54.310 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T07:59:54.310 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T07:59:54.311 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T07:59:54.311 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T07:59:54.311 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T07:59:54.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T07:59:54.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:54.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:54.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:54.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:54.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T07:59:54.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T07:59:54.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:59:54.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:59:54.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:59:54.384 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:54.383+0000 7f2de8808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:54.385 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:54.384+0000 7f2de8808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:54.386 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:54.385+0000 7f2de8808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:54.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:59:54.572 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:54.571+0000 7f2de8808780 -1 Falling back to public interface 2026-02-23T07:59:54.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:54.938 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:54.936+0000 7f2de8808780 -1 osd.3 41 log_to_monitors true 2026-02-23T07:59:55.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T07:59:55.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:55.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T07:59:55.701 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:55.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:55.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 45 up_thru 45 down_at 42 last_clean_interval [38,41) [v2:127.0.0.1:6826/1914471011,v1:127.0.0.1:6827/1914471011] [v2:127.0.0.1:6828/1914471011,v1:127.0.0.1:6829/1914471011] exists,up 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T07:59:55.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T07:59:55.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T07:59:55.868 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T07:59:55.868 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T07:59:55.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T07:59:55.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T07:59:55.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T07:59:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T07:59:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T07:59:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T07:59:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T07:59:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T07:59:55.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T07:59:56.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T07:59:56.117 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T07:59:56.117 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T07:59:56.117 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T07:59:56.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T07:59:56.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:56.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T07:59:56.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-23T07:59:56.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-23T07:59:56.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-23T07:59:56.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:56.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T07:59:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-23T07:59:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-23T07:59:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970' 2026-02-23T07:59:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:56.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T07:59:56.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T07:59:56.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T07:59:56.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153' 2026-02-23T07:59:56.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T07:59:56.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T07:59:56.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528322 2026-02-23T07:59:56.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528322 2026-02-23T07:59:56.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153 3-193273528322' 2026-02-23T07:59:56.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:56.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-23T07:59:56.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:56.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T07:59:56.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-23T07:59:56.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:56.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-23T07:59:56.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-23T07:59:56.417 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836490 2026-02-23T07:59:56.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:56.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836490 2026-02-23T07:59:56.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T07:59:57.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T07:59:57.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T07:59:57.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-23T07:59:57.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:57.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-23T07:59:57.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:57.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T07:59:57.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-23T07:59:57.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:57.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-23T07:59:57.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-23T07:59:57.756 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672970 2026-02-23T07:59:57.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T07:59:57.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672971 -lt 42949672970 2026-02-23T07:59:57.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:57.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T07:59:57.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:57.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T07:59:57.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T07:59:57.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:57.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T07:59:57.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T07:59:57.927 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542153 2026-02-23T07:59:57.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T07:59:58.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-23T07:59:58.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T07:59:58.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-193273528322 2026-02-23T07:59:58.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T07:59:58.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T07:59:58.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-193273528322 2026-02-23T07:59:58.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T07:59:58.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528322 2026-02-23T07:59:58.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 193273528322' 2026-02-23T07:59:58.093 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 193273528322 2026-02-23T07:59:58.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T07:59:58.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528322 -lt 193273528322 2026-02-23T07:59:58.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T07:59:58.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:58.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:58.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T07:59:58.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T07:59:58.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T07:59:58.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T07:59:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T07:59:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T07:59:58.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T07:59:58.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T07:59:58.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T07:59:58.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T07:59:58.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T07:59:58.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 1 2026-02-23T07:59:58.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T07:59:58.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T07:59:58.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=1 2026-02-23T07:59:58.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T07:59:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T07:59:59.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T07:59:59.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T07:59:59.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T07:59:59.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T07:59:59.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T07:59:59.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T07:59:59.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:59.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T07:59:59.247 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T07:59:59.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T07:59:59.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T07:59:59.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T07:59:59.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T07:59:59.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T07:59:59.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T07:59:59.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T07:59:59.310 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:59.309+0000 7f5ba394b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:59.311 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:59.310+0000 7f5ba394b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:59.312 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:59.311+0000 7f5ba394b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T07:59:59.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T07:59:59.473 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:59.472+0000 7f5ba394b780 -1 Falling back to public interface 2026-02-23T07:59:59.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T07:59:59.849 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T07:59:59.848+0000 7f5ba394b780 -1 osd.1 46 log_to_monitors true 2026-02-23T08:00:00.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:00.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:00.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:00.635 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:00:00.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:00.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 47 last_clean_interval [10,46) [v2:127.0.0.1:6810/4038878563,v1:127.0.0.1:6811/4038878563] [v2:127.0.0.1:6812/4038878563,v1:127.0.0.1:6813/4038878563] exists,up bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:00.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:00.807 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:00.807 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:00.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:00.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:00.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:00.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:00.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:00.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:00.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:00.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:00.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:01.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:01.049 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:00:01.049 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:00:01.049 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:00:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:01.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:01.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-23T08:00:01.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-23T08:00:01.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-23T08:00:01.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:01.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364802 2026-02-23T08:00:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364802 2026-02-23T08:00:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-214748364802' 2026-02-23T08:00:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:01.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:01.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-23T08:00:01.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-23T08:00:01.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-214748364802 2-60129542155' 2026-02-23T08:00:01.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:01.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:01.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528324 2026-02-23T08:00:01.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528324 2026-02-23T08:00:01.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-214748364802 2-60129542155 3-193273528324' 2026-02-23T08:00:01.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:01.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-23T08:00:01.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:01.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:01.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-23T08:00:01.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:01.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-23T08:00:01.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-23T08:00:01.349 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836492 2026-02-23T08:00:01.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:01.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-23T08:00:01.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:01.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-214748364802 2026-02-23T08:00:01.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:01.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364802 2026-02-23T08:00:01.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:01.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=214748364802 2026-02-23T08:00:01.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 214748364802' 2026-02-23T08:00:01.514 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 214748364802 2026-02-23T08:00:01.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:01.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364802 -lt 214748364802 2026-02-23T08:00:01.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:01.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-23T08:00:01.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:01.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:01.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-23T08:00:01.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:01.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-23T08:00:01.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-23T08:00:01.681 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542155 2026-02-23T08:00:01.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:01.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-23T08:00:01.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:01.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-193273528324 2026-02-23T08:00:01.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:01.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:01.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-193273528324 2026-02-23T08:00:01.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:01.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528324 2026-02-23T08:00:01.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 193273528324' 2026-02-23T08:00:01.849 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 193273528324 2026-02-23T08:00:01.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528323 -lt 193273528324 2026-02-23T08:00:02.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:03.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:03.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:03.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528323 -lt 193273528324 2026-02-23T08:00:03.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:04.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:00:04.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:04.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528324 -lt 193273528324 2026-02-23T08:00:04.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:04.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:04.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:04.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:04.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:04.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:04.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:04.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:04.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:04.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:04.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:04.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:04.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:04.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:04.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:04.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:04.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:04.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:04.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:00:04.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:00:04.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:00:04.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:00:04.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:00:05.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:00:05.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:00:05.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:00:05.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:00:05.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:05.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:05.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:05.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:05.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:05.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:00:05.414 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:05.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:05.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:05.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:05.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:51.968627+0000 '>' 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:05.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:06.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:06.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:06.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:06.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:06.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:06.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:06.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:06.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:51.968627+0000 '>' 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:06.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:07.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:07.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:07.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:07.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:07.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:07.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:07.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:07.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:51.968627+0000 '>' 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:07.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:08.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:08.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:08.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:08.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:08.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:08.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:08.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:09.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:51.968627+0000 '>' 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:09.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:10.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:10.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:10.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:10.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:10.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:10.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:10.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:10.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T07:59:51.968627+0000 '>' 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:10.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:11.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:11.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:11.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:11.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:11.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:11.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:11.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:06.041309+0000 '>' 2026-02-23T07:59:51.968627+0000 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:11.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:11.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:00:11.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:00:11.786 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:00:11.786 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:00:11.786 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:00:11.786 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:11.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:11.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:11.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:00:11.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:00:11.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:11.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:11.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:11.835 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:11.834+0000 7ffb35017780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:11.837 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:11.836+0000 7ffb35017780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:11.838 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:11.837+0000 7ffb35017780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:00:11.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:11.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:00:12.037 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:12.036+0000 7ffb35017780 -1 Falling back to public interface 2026-02-23T08:00:12.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:12.372 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:12.371+0000 7ffb35017780 -1 osd.3 53 log_to_monitors true 2026-02-23T08:00:13.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:13.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:13.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:13.159 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:00:13.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:13.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 57 up_thru 57 down_at 54 last_clean_interval [45,53) [v2:127.0.0.1:6826/2442254423,v1:127.0.0.1:6827/2442254423] [v2:127.0.0.1:6828/2442254423,v1:127.0.0.1:6829/2442254423] exists,up 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:13.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:13.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:13.323 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:13.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:13.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:13.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:13.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:13.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:13.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:13.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:13.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:13.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:13.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:13.564 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:00:13.564 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:00:13.564 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:00:13.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:13.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:13.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T08:00:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T08:00:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T08:00:13.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:13.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:13.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=214748364805 2026-02-23T08:00:13.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 214748364805 2026-02-23T08:00:13.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-214748364805' 2026-02-23T08:00:13.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:13.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:13.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542158 2026-02-23T08:00:13.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542158 2026-02-23T08:00:13.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-214748364805 2-60129542158' 2026-02-23T08:00:13.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:13.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:13.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135874 2026-02-23T08:00:13.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135874 2026-02-23T08:00:13.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-214748364805 2-60129542158 3-244813135874' 2026-02-23T08:00:13.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:13.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T08:00:13.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:13.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:13.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T08:00:13.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:13.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T08:00:13.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T08:00:13.863 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836495 2026-02-23T08:00:13.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836495 2026-02-23T08:00:14.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:15.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:15.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:15.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836495 2026-02-23T08:00:15.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:16.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:00:16.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:16.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T08:00:16.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:16.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-214748364805 2026-02-23T08:00:16.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:16.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:16.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-214748364805 2026-02-23T08:00:16.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:16.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=214748364805 2026-02-23T08:00:16.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 214748364805' 2026-02-23T08:00:16.366 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 214748364805 2026-02-23T08:00:16.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:16.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 214748364806 -lt 214748364805 2026-02-23T08:00:16.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:16.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542158 2026-02-23T08:00:16.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:16.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:16.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542158 2026-02-23T08:00:16.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:16.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542158 2026-02-23T08:00:16.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542158' 2026-02-23T08:00:16.535 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542158 2026-02-23T08:00:16.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:16.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542159 -lt 60129542158 2026-02-23T08:00:16.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:16.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135874 2026-02-23T08:00:16.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:16.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:16.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135874 2026-02-23T08:00:16.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:16.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135874 2026-02-23T08:00:16.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135874' 2026-02-23T08:00:16.702 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 244813135874 2026-02-23T08:00:16.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:16.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135874 -lt 244813135874 2026-02-23T08:00:16.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:16.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:16.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:17.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:17.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:17.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:17.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:17.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:17.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:17.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:17.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:17.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:17.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:00:17.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:00:17.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 1 2 2026-02-23T08:00:17.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=1 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=2 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 515866"' 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 515866' 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:17.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 515867"' 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 515867' 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 515866 515867' 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 515866 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/515869: /' 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:00:17.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/515871: /' 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:17.970 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:17.971 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:17.972 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: 515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:17.973 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:00:17.974 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:17.975 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:17.976 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:17.977 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: start osd.2 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_oactivate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:17.978 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:17.979 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:00:17.980 INFO:tasks.workunit.client.0.trial129.stderr:515869: start osd.1 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: 2026-02-23T08:00:17.983+0000 7f070136d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: 2026-02-23T08:00:17.985+0000 7f070136d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: 2026-02-23T08:00:17.985+0000 7f070136d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: 0 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: 2026-02-23T08:00:18.168+0000 7f070136d780 -1 Falling back to public interface 2026-02-23T08:00:19.481 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: 2026-02-23T08:00:18.616+0000 7f070136d780 -1 osd.1 60 log_to_monitors true 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: 1 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: osd.1 up in weight 1 up_from 64 up_thru 64 down_at 60 last_clean_interval [50,60) [v2:127.0.0.1:6810/3557241747,v1:127.0.0.1:6811/3557241747] [v2:127.0.0.1:6812/3557241747,v1:127.0.0.1:6813/3557241747] exists,up bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:19.482 INFO:tasks.workunit.client.0.trial129.stderr:515869: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:19.484 INFO:tasks.workunit.client.0.trial129.stderr:515869: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-23T08:00:19.484 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: 2026-02-23T08:00:17.983+0000 7f34d76de780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: 2026-02-23T08:00:17.984+0000 7f34d76de780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: 2026-02-23T08:00:17.985+0000 7f34d76de780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:00:19.485 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: 0 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: 2026-02-23T08:00:18.189+0000 7f34d76de780 -1 Falling back to public interface 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: 2026-02-23T08:00:18.622+0000 7f34d76de780 -1 osd.2 59 log_to_monitors true 2026-02-23T08:00:19.486 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: 1 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: osd.2 up in weight 1 up_from 63 up_thru 63 down_at 60 last_clean_interval [14,59) [v2:127.0.0.1:6818/3594017694,v1:127.0.0.1:6819/3594017694] [v2:127.0.0.1:6820/3594017694,v1:127.0.0.1:6821/3594017694] exists,up 621b9b28-fe3b-4b10-9ea9-9f403474c61d 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:19.487 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:19.488 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:19.488 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:19.488 INFO:tasks.workunit.client.0.trial129.stderr:515871: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:20.031 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: 1 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: 2 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: 3' 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836498 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836498 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498' 2026-02-23T08:00:20.032 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=274877906946 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 274877906946 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-274877906946' 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939650 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939650 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-274877906946 2-270582939650' 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135876 2026-02-23T08:00:20.033 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135876 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-274877906946 2-270582939650 3-244813135876' 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:3: get_timeout_delays: echo true 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:20.034 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: 1 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: 2 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: 3' 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-23T08:00:20.035 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499' 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=274877906947 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 274877906947 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-274877906947' 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939651 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939651 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-274877906947 2-270582939651' 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135877 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135877 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-274877906947 2-270582939651 3-244813135877' 2026-02-23T08:00:20.036 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: waiting osd.0 seq 21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836498 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-274877906946 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-274877906946 2026-02-23T08:00:22.715 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=274877906946 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 274877906946' 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: waiting osd.1 seq 274877906946 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 274877906947 -lt 274877906946 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-270582939650 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-270582939650 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:22.716 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939650 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_s flush_pg_stats: echo 0-21474836499 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836499 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-23T08:00:22.722 INFO:tasks.workunit.client.0.trial129.stderr:515869: waiting osd.0 seq 21474836499 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836499 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836499 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836499 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-274877906947 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-274877906947 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=274877906947 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 274877906947' 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: waiting osd.1 seq 274877906947 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 274877906947 -lt 274877906947 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-270582939651 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-270582939651 2026-02-23T08:00:22.723 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:22.724 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939651 2026-02-23T08:00:23.641 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 270582939650' 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: waiting osd.2 seq 270582939650 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939651 -lt 270582939650 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135876 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135876 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:23.642 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135876 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135876' 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: waiting osd.3 seq 244813135876 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135877 -lt 244813135876 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:23.643 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515871: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:tats: echo 'waiting osd.2 seq 270582939651' 2026-02-23T08:00:23.644 INFO:tasks.workunit.client.0.trial129.stderr:515869: waiting osd.2 seq 270582939651 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939651 -lt 270582939651 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135877 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135877 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135877 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135877' 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: waiting osd.3 seq 244813135877 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:23.645 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135877 -lt 244813135877 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:23.646 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:515869: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:515869: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 515867 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:00:23.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:00:23.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:00:23.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:00:23.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:00:23.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:00:23.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:00:23.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:00:23.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:00:23.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:00:23.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:00:23.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:00:23.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:23.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:23.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:23.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:23.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:23.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:00:24.123 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:00:24.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:24.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:24.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:06.041309+0000 '>' 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:24.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:25.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:25.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:25.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:25.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:25.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:25.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:25.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:25.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:06.041309+0000 '>' 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:25.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:26.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:26.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:26.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:26.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:26.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:26.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:26.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:26.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:06.041309+0000 '>' 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:26.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:27.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:27.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:27.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:27.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:27.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:27.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:27.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:27.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:06.041309+0000 '>' 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:27.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:28.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:28.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:28.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:28.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:28.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:28.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:28.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:06.041309+0000 '>' 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:28.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:29.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:29.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:29.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:29.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:29.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:29.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:29.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:24.416476+0000 '>' 2026-02-23T08:00:06.041309+0000 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 518763"' 2026-02-23T08:00:30.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 518763' 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 518764"' 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 518764' 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 518763 518764' 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:30.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 518763 2026-02-23T08:00:30.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:30.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/518766: /' 2026-02-23T08:00:30.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:00:30.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/518768: /' 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:30.571 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING list-attrs 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: _ 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: hinfo_key 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: snapset 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:30.572 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:30.574 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:30.575 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:00:30.575 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:00:30.575 INFO:tasks.workunit.client.0.trial129.stderr:518768: start osd.2 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:30.580 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: _ 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: hinfo_key 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: snapset 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:30.581 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:30.583 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:00:30.584 INFO:tasks.workunit.client.0.trial129.stderr:518766: start osd.1 2026-02-23T08:00:32.080 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:32.080 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: 2026-02-23T08:00:30.585+0000 7f4f1c94d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: 2026-02-23T08:00:30.586+0000 7f4f1c94d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: 2026-02-23T08:00:30.587+0000 7f4f1c94d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:00:32.081 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: 0 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: 2026-02-23T08:00:30.844+0000 7f4f1c94d780 -1 Falling back to public interface 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: 2026-02-23T08:00:31.182+0000 7f4f1c94d780 -1 osd.2 65 log_to_monitors true 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:32.082 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: 1 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: osd.2 up in weight 1 up_from 69 up_thru 69 down_at 66 last_clean_interval [63,65) [v2:127.0.0.1:6818/324039921,v1:127.0.0.1:6819/324039921] [v2:127.0.0.1:6820/324039921,v1:127.0.0.1:6821/324039921] exists,up 621b9b28-fe3b-4b10-9ea9-9f403474c61d 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:32.083 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:32.084 INFO:tasks.workunit.client.0.trial129.stderr:518768: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:32.087 INFO:tasks.workunit.client.0.trial129.stderr:518768: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.recovery_ops 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: 2026-02-23T08:00:30.594+0000 7f43a1e11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: 2026-02-23T08:00:30.596+0000 7f43a1e11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: 2026-02-23T08:00:30.596+0000 7f43a1e11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:32.088 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: 0 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: 2026-02-23T08:00:30.833+0000 7f43a1e11780 -1 Falling back to public interface 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: 2026-02-23T08:00:31.195+0000 7f43a1e11780 -1 osd.1 65 log_to_monitors true 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:32.089 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: 1 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: osd.1 up in weight 1 up_from 70 up_thru 70 down_at 66 last_clean_interval [64,65) [v2:127.0.0.1:6810/1588969374,v1:127.0.0.1:6811/1588969374] [v2:127.0.0.1:6812/1588969374,v1:127.0.0.1:6813/1588969374] exists,up bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:32.090 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:32.091 INFO:tasks.workunit.client.0.trial129.stderr:518766: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518766: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpsh:1593: get_timeout_delays: echo true 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:32.627 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: 1 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: 2 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: 3' 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836502 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836502 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502' 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710722 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710722 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-300647710722' 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.628 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743426 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743426 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-300647710722 2-296352743426' 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135881 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135881 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-300647710722 2-296352743426 3-244813135881' 2026-02-23T08:00:32.629 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.shers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:32.632 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: 1 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: 2 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: 3' 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710723 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710723 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-300647710723' 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.633 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743427 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743427 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-300647710723 2-296352743427' 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135882 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135882 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-300647710723 2-296352743427 3-244813135882' 2026-02-23T08:00:32.634 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper:2266: flush_pg_stats: echo 0-21474836502 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836502 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836502 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: waiting osd.0 seq 21474836502 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836502 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836502 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-300647710722 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:34.311 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-300647710722 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710722 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 300647710722' 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: waiting osd.1 seq 300647710722 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710723 -lt 300647710722 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743426 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743426 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743426 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743426' 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: waiting osd.2 seq 296352743426 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743427 -lt 296352743426 2026-02-23T08:00:34.312 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:34.313 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubs.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-23T08:00:34.313 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:34.313 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:34.313 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-23T08:00:34.313 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:34.313 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: waiting osd.0 seq 21474836503 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836503 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836503 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:34.314 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-300647710723 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-300647710723 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710723 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 300647710723' 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: waiting osd.1 seq 300647710723 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:34.315 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710723 -lt 300647710723 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743427 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743427 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743427 2026-02-23T08:00:34.316 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743427' 2026-02-23T08:00:34.317 INFO:tasks.workunit.client.0.trial129.stderr:518766: waiting osd.2 seq 296352743427 2026-02-23T08:00:34.317 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:34.317 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743427 -lt 296352743427 2026-02-23T08:00:34.317 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518766: //homuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135881 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135881 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135881 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135881' 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: waiting osd.3 seq 244813135881 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135882 -lt 244813135881 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:35.070 INFO:tasks.workunit.client.0.trial129.stderr:518768: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:35.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135882 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135882 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135882 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135882' 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: waiting osd.3 seq 244813135882 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:35.073 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135882 -lt 244813135882 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:518766: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 518764 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:00:35.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:00:35.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:00:35.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:00:35.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:00:35.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:00:35.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 1 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=1 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 521051"' 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 521051' 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 521052"' 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 521052' 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:00:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 521051 521052' 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 521051 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/521054: /' 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:35.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/521056: /' 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:35.602 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:35.603 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:00:35.605 INFO:tasks.workunit.client.0.trial129.stderr:521054: start osd.3 2026-02-23T08:00:35.613 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.613 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:35.613 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:00:35.613 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:35.613 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:35.614 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:35.616 INFO:tasks.workunit.client.0.trial129.stderr:521056: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:00:35.617 INFO:tasks.workunit.client.0.trial129.stderr:521056: start osd.1 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: 2026-02-23T08:00:35.616+0000 7fc959408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: 2026-02-23T08:00:35.617+0000 7fc959408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: 2026-02-23T08:00:35.618+0000 7fc959408780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:37.111 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: 0 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: 2026-02-23T08:00:35.812+0000 7fc959408780 -1 Falling back to public interface 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: 2026-02-23T08:00:36.184+0000 7fc959408780 -1 osd.3 71 log_to_monitors true 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: 1 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: osd.3 up in weight 1 up_from 75 up_thru 75 down_at 72 last_clean_interval [57,71) [v2:127.0.0.1:6810/1402842306,v1:127.0.0.1:6811/1402842306] [v2:127.0.0.1:6812/1402842306,v1:127.0.0.1:6813/1402842306] exists,up 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:37.112 INFO:tasks.workunit.client.0.trial129.stderr:521054: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521054: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: 2026-02-23T08:00:35.628+0000 7fe87916d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: 2026-02-23T08:00:35.630+0000 7fe87916d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: 2026-02-23T08:00:35.631+0000 7fe87916d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:00:37.123 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: 0 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: 2026-02-23T08:00:35.830+0000 7fe87916d780 -1 Falling back to public interface 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: 2026-02-23T08:00:36.191+0000 7fe87916d780 -1 osd.1 71 log_to_monitors true 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: 1 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: osd.1 up in weight 1 up_from 75 up_thru 75 down_at 72 last_clean_interval [70,71) [v2:127.0.0.1:6826/3201630952,v1:127.0.0.1:6827/3201630952] [v2:127.0.0.1:6828/3201630952,v1:127.0.0.1:6829/3201630952] exists,up bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:37.124 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:37.125 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:37.125 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:37.125 INFO:tasks.workunit.client.0.trial129.stderr:521056: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:37.660 INFO:tasks.workunit.client.0.trial129.stderr:521056: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:37.661 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:37.661 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:37.661 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:37.661 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:37.661 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: 1 2026-02-23T08:00:37.662 INFO:tasks.workunit.client.0.trial129.stderr:521054: 2 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: 3' 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836505 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836505 2026-02-23T08:00:37.663 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505' 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=322122547202 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 322122547202 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-322122547202' 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:37.664 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743429 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743429 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-322122547202 2-296352743429' 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=322122547202 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 322122547202 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-322122547202 2-296352743429 3-322122547202' 2026-02-23T08:00:37.665 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:37.666 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:3: get_timeout_delays: echo true 2026-02-23T08:00:37.666 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:37.666 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:37.667 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: 1 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: 2 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: 3' 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-23T08:00:37.668 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=322122547203 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 322122547203 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-322122547203' 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.669 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743430 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743430 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-322122547203 2-296352743430' 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=322122547203 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 322122547203 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-322122547203 2-296352743430 3-322122547203' 2026-02-23T08:00:37.670 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:40.346 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836505 2026-02-23T08:00:40.346 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:40.346 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836505 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836505 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: waiting osd.0 seq 21474836505 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836505 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:40.347 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836505 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836505 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-322122547202 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-322122547202 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=322122547202 2026-02-23T08:00:40.348 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 322122547202' 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: waiting osd.1 seq 322122547202 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 322122547203 -lt 322122547202 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743429 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743429 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:40.349 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743429 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_s flush_pg_stats: echo 0-21474836506 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-23T08:00:40.350 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: waiting osd.0 seq 21474836506 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836506 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836506 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-23T08:00:40.351 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-322122547203 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-322122547203 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=322122547203 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 322122547203' 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: waiting osd.1 seq 322122547203 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 322122547203 -lt 322122547203 2026-02-23T08:00:40.352 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:40.353 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743430 2026-02-23T08:00:40.353 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:40.353 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:40.353 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743430 2026-02-23T08:00:40.353 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:40.353 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743430 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743430' 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: waiting osd.2 seq 296352743430 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743430 -lt 296352743430 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-322122547203 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:41.272 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-322122547203 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=322122547203 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 322122547203' 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: waiting osd.3 seq 322122547203 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 322122547203 -lt 322122547203 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:41.273 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:41.274 INFO:tasks.workunit.client.0.trial129.stderr:521056: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:tats: echo 'waiting osd.2 seq 296352743429' 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: waiting osd.2 seq 296352743429 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743430 -lt 296352743429 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-322122547202 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-322122547202 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=322122547202 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 322122547202' 2026-02-23T08:00:41.275 INFO:tasks.workunit.client.0.trial129.stderr:521054: waiting osd.3 seq 322122547202 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 322122547203 -lt 322122547202 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:41.276 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:521054: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 521052 2026-02-23T08:00:41.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:00:41.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:00:41.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:41.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:41.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:41.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:00:41.752 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:41.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:41.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:41.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:24.416476+0000 '>' 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:41.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:42.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:42.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:42.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:42.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:42.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:42.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:42.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:43.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:24.416476+0000 '>' 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:43.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:44.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:44.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:44.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:44.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:44.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:44.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:44.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:24.416476+0000 '>' 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:44.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:45.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:45.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:45.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:45.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:45.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:45.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:45.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:45.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:24.416476+0000 '>' 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:45.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:46.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:46.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:46.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:46.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:46.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:46.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:46.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:24.416476+0000 '>' 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:46.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:00:47.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:00:47.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:00:47.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:00:47.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:00:47.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:00:47.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:00:47.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:00:42.099490+0000 '>' 2026-02-23T08:00:24.416476+0000 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 523948"' 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 523948' 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 523949"' 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 523949' 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 523948 523949' 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 523948 2026-02-23T08:00:47.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:47.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/523951: /' 2026-02-23T08:00:47.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/523953: /' 2026-02-23T08:00:47.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:48.169 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.169 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:48.169 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:00:48.169 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:00:48.170 INFO:tasks.workunit.client.0.trial129.stderr:523951: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: _ 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: hinfo_key 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: snapset 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:48.171 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:48.172 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:00:48.173 INFO:tasks.workunit.client.0.trial129.stderr:523951: start osd.3 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$n523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:00:48.184 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:00:48.185 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: _ 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: hinfo_key 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: snapset 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:48.186 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:48.187 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:48.187 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:48.187 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:48.187 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:00:48.187 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:00:48.187 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:48.188 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:00:48.189 INFO:tasks.workunit.client.0.trial129.stderr:523953: start osd.1 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_ame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: 2026-02-23T08:00:48.183+0000 7fc93a34b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: 2026-02-23T08:00:48.185+0000 7fc93a34b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: 2026-02-23T08:00:48.186+0000 7fc93a34b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: 0 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: 2026-02-23T08:00:48.416+0000 7fc93a34b780 -1 Falling back to public interface 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: 2026-02-23T08:00:48.829+0000 7fc93a34b780 -1 osd.3 76 log_to_monitors true 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:49.684 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: 1 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: osd.3 up in weight 1 up_from 80 up_thru 80 down_at 77 last_clean_interval [75,76) [v2:127.0.0.1:6810/347856940,v1:127.0.0.1:6811/347856940] [v2:127.0.0.1:6812/347856940,v1:127.0.0.1:6813/347856940] exists,up 19501243-6e2d-4998-9e3a-a1c25cc2c9fc 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:49.685 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delrecovery_ops 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 2026-02-23T08:00:48.197+0000 7fd77e396780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 2026-02-23T08:00:48.198+0000 7fd77e396780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 2026-02-23T08:00:48.199+0000 7fd77e396780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 0 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 2026-02-23T08:00:48.423+0000 7fd77e396780 -1 Falling back to public interface 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 2026-02-23T08:00:48.849+0000 7fd77e396780 -1 osd.1 76 log_to_monitors true 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: 1 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: osd.1 up in weight 1 up_from 80 up_thru 80 down_at 77 last_clean_interval [75,76) [v2:127.0.0.1:6826/4172056111,v1:127.0.0.1:6827/4172056111] [v2:127.0.0.1:6828/4172056111,v1:127.0.0.1:6829/4172056111] exists,up bef3305e-980b-4f8e-9826-71bd040e0dbe 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:00:49.698 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:00:49.699 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:00:49.699 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:00:49.699 INFO:tasks.workunit.client.0.trial129.stderr:523953: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:50.227 INFO:tasks.workunit.client.0.trial129.stderr:523953: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpays 90 .1 2026-02-23T08:00:50.227 INFO:tasks.workunit.client.0.trial129.stderr:523951: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:00:50.227 INFO:tasks.workunit.client.0.trial129.stderr:523951: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:50.227 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:50.228 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: 1 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: 2 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: 3' 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-23T08:00:50.229 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=343597383682 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 343597383682 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-343597383682' 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743433 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743433 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-343597383682 2-296352743433' 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.230 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:50.231 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=343597383682 2026-02-23T08:00:50.231 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 343597383682 2026-02-23T08:00:50.248 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-343597383682 2-2963527434ers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:00:50.248 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: 1 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: 2 2026-02-23T08:00:50.249 INFO:tasks.workunit.client.0.trial129.stderr:523953: 3' 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=343597383683 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 343597383683 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-343597383683' 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.250 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743434 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743434 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-343597383683 2-296352743434' 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=343597383683 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 343597383683 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-343597383683 2-296352743434 3-343597383683' 2026-02-23T08:00:50.251 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:51.924 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper33 3-343597383682' 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-23T08:00:51.925 INFO:tasks.workunit.client.0.trial129.stderr:523951: waiting osd.0 seq 21474836510 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836510 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-343597383682 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-343597383682 2026-02-23T08:00:51.926 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=343597383682 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 343597383682' 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: waiting osd.1 seq 343597383682 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 343597383683 -lt 343597383682 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743433 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743433 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743433 2026-02-23T08:00:51.927 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743433' 2026-02-23T08:00:51.928 INFO:tasks.workunit.client.0.trial129.stderr:523951: waiting osd.2 seq 296352743433 2026-02-23T08:00:51.928 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:51.933 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalos.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-23T08:00:51.933 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:51.933 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:00:51.933 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-23T08:00:51.933 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: waiting osd.0 seq 21474836511 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836511 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836511 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-343597383683 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:51.934 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-343597383683 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=343597383683 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 343597383683' 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: waiting osd.1 seq 343597383683 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 343597383683 -lt 343597383683 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743434 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:00:51.935 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743434 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743434 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743434' 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: waiting osd.2 seq 296352743434 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743435 -lt 296352743434 2026-02-23T08:00:51.936 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:52.674 INFO:tasks.workunit.client.0.trial129.stderr:523953: //homne/ceph-helpers.sh:2269: flush_pg_stats: test 296352743435 -lt 296352743433 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-343597383682 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-343597383682 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=343597383682 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 343597383682' 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: waiting osd.3 seq 343597383682 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 343597383683 -lt 343597383682 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:52.675 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:523951: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:00:52.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 523949 2026-02-23T08:00:52.685 INFO:tasks.workunit.client.0.trial129.stderr:e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-343597383683 2026-02-23T08:00:52.685 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:00:52.685 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-343597383683 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=343597383683 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 343597383683' 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: waiting osd.3 seq 343597383683 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 343597383683 -lt 343597383683 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:00:52.686 INFO:tasks.workunit.client.0.trial129.stderr:523953: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:523953: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:00:52.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:00:52.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:00:52.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:00:52.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:00:52.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:00:52.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:00:52.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:52.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:52.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:52.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:52.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:52.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:52.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:00:52.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:00:52.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:00:52.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:00:52.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:00:52.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:00:52.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:00:52.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:00:52.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:00:52.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:00:52.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:00:52.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:00:52.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:00:52.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:00:52.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:52.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:52.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:00:52.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:00:52.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:00:52.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:00:52.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:00:52.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:00:52.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:00:52.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:00:52.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:00:52.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:00:52.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:00:52.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:00:52.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:00:52.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:00:52.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:00:52.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:00:52.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:00:52.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:00:52.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:00:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:00:52.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:00:52.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:00:52.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:52.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:52.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:00:52.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:00:52.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:00:52.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:00:52.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:00:52.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:52.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:52.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:00:52.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_jerasure_overwrites td/osd-scrub-repair 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:878: TEST_corrupt_and_repair_jerasure_overwrites: '[' true = true ']' 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:879: TEST_corrupt_and_repair_jerasure_overwrites: corrupt_and_repair_jerasure td/osd-scrub-repair true 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:857: corrupt_and_repair_jerasure: local dir=td/osd-scrub-repair 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:858: corrupt_and_repair_jerasure: local allow_overwrites=true 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:859: corrupt_and_repair_jerasure: local poolname=ecpool 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:861: corrupt_and_repair_jerasure: run_mon td/osd-scrub-repair a 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:00:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:00:52.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:00:52.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:52.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:52.869 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:52.869 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:52.869 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:52.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:00:52.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:00:52.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:00:52.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:00:52.890 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:00:52.891 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:52.891 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:52.891 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:00:52.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:00:52.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:00:52.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:00:52.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:00:52.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:00:52.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:52.950 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:52.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:00:52.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:00:52.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:862: corrupt_and_repair_jerasure: run_mgr td/osd-scrub-repair x 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:00:53.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:00:53.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:00:53.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:53.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:53.103 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:53.103 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:53.103 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:53.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:53.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:00:53.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:00:53.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: seq 0 3 2026-02-23T08:00:53.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T08:00:53.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 0 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:53.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:00:53.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:00:53.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:00:53.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=99dc1807-850a-49af-9be3-50f36b6e5c54 2026-02-23T08:00:53.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 99dc1807-850a-49af-9be3-50f36b6e5c54' 2026-02-23T08:00:53.122 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 99dc1807-850a-49af-9be3-50f36b6e5c54 2026-02-23T08:00:53.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:00:53.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA1CZxp6LDQBxAAc/wRjYJBf+5wy4KWxQvffA== 2026-02-23T08:00:53.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA1CZxp6LDQBxAAc/wRjYJBf+5wy4KWxQvffA=="}' 2026-02-23T08:00:53.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 99dc1807-850a-49af-9be3-50f36b6e5c54 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:00:53.218 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:00:53.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:00:53.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA1CZxp6LDQBxAAc/wRjYJBf+5wy4KWxQvffA== --osd-uuid 99dc1807-850a-49af-9be3-50f36b6e5c54 2026-02-23T08:00:53.242 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.240+0000 7fb0ed749780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:53.243 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.241+0000 7fb0ed749780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:53.244 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.242+0000 7fb0ed749780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:53.244 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.242+0000 7fb0ed749780 -1 bdev(0x5567ccc1b400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:00:53.244 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.242+0000 7fb0ed749780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:00:53.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:00:53.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:00:53.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:00:53.681 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:00:53.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:00:53.776 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:00:53.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:00:53.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:53.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:00:53.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:00:53.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:00:53.789 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.787+0000 7f24e0f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:53.790 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.788+0000 7f24e0f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:53.791 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.789+0000 7f24e0f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:53.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:00:53.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:53.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:00:53.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:53.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:53.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:53.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:53.871 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:00:53.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:53.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:00:53.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:53.987 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:53.985+0000 7f24e0f4f780 -1 Falling back to public interface 2026-02-23T08:00:54.315 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:54.313+0000 7f24e0f4f780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:00:54.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:54.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:54.965 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:00:54.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:54.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:54.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:00:55.058 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1744026833,v1:127.0.0.1:6801/1744026833] [v2:127.0.0.1:6802/1744026833,v1:127.0.0.1:6803/1744026833] exists,up 99dc1807-850a-49af-9be3-50f36b6e5c54 2026-02-23T08:00:55.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:55.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 1 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:55.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:55.065 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:55.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 59104ff4-6d45-451e-98a0-2699ae285428' 2026-02-23T08:00:55.067 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:00:55.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:00:55.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA3CZxpH9UbBBAAalZWL0CWsGrsZupT4wHYkw== 2026-02-23T08:00:55.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA3CZxpH9UbBBAAalZWL0CWsGrsZupT4wHYkw=="}' 2026-02-23T08:00:55.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 59104ff4-6d45-451e-98a0-2699ae285428 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:00:55.161 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:00:55.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:00:55.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA3CZxpH9UbBBAAalZWL0CWsGrsZupT4wHYkw== --osd-uuid 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:00:55.184 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.182+0000 7f9380a07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:55.185 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.183+0000 7f9380a07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:55.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.184+0000 7f9380a07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:55.187 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.184+0000 7f9380a07780 -1 bdev(0x5599e0eb7400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:00:55.187 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.184+0000 7f9380a07780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:00:55.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:00:55.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:00:55.579 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:00:55.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:00:55.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:00:55.784 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:00:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:00:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:55.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:00:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:00:55.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:00:55.796 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.794+0000 7f9056a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:55.798 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.795+0000 7f9056a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:55.798 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.796+0000 7f9056a14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:55.948 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:00:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:55.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:55.967 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:55.965+0000 7f9056a14780 -1 Falling back to public interface 2026-02-23T08:00:56.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:56.320 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:56.318+0000 7f9056a14780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:00:57.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:57.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:57.112 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:00:57.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:57.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:57.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:00:57.276 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3367161845,v1:127.0.0.1:6811/3367161845] [v2:127.0.0.1:6812/3367161845,v1:127.0.0.1:6813/3367161845] exists,up 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 2 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:00:57.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:57.281 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:00:57.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:00:57.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2db66020-d525-4d13-8a58-a5c86265360e 2026-02-23T08:00:57.283 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 2db66020-d525-4d13-8a58-a5c86265360e 2026-02-23T08:00:57.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 2db66020-d525-4d13-8a58-a5c86265360e' 2026-02-23T08:00:57.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:00:57.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA5CZxp5XAwERAAbo0p+6+USm1ytiW3ZI0fkw== 2026-02-23T08:00:57.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA5CZxp5XAwERAAbo0p+6+USm1ytiW3ZI0fkw=="}' 2026-02-23T08:00:57.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2db66020-d525-4d13-8a58-a5c86265360e -i td/osd-scrub-repair/2/new.json 2026-02-23T08:00:57.448 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:00:57.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:00:57.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA5CZxp5XAwERAAbo0p+6+USm1ytiW3ZI0fkw== --osd-uuid 2db66020-d525-4d13-8a58-a5c86265360e 2026-02-23T08:00:57.472 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:57.470+0000 7fd18d57f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:57.474 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:57.472+0000 7fd18d57f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:57.475 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:57.473+0000 7fd18d57f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:57.475 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:57.473+0000 7fd18d57f780 -1 bdev(0x5650ab6e1400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:00:57.476 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:57.473+0000 7fd18d57f780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:00:57.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:00:57.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:00:57.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:00:57.885 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:00:57.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:00:58.091 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:00:58.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:00:58.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:00:58.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:00:58.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:00:58.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:00:58.103 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:58.101+0000 7ff51d48d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:58.104 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:58.102+0000 7ff51d48d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:58.105 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:58.103+0000 7ff51d48d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:58.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:00:58.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:00:58.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:00:58.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:00:58.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:00:58.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:58.259 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:00:58.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:00:58.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:58.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:00:58.306 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:58.304+0000 7ff51d48d780 -1 Falling back to public interface 2026-02-23T08:00:58.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:00:58.710 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:58.708+0000 7ff51d48d780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:00:59.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:00:59.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:00:59.424 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:00:59.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:00:59.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:00:59.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:00:59.590 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2902077166,v1:127.0.0.1:6819/2902077166] [v2:127.0.0.1:6820/2902077166,v1:127.0.0.1:6821/2902077166] exists,up 2db66020-d525-4d13-8a58-a5c86265360e 2026-02-23T08:00:59.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:863: corrupt_and_repair_jerasure: for id in $(seq 0 3) 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:864: corrupt_and_repair_jerasure: run_osd td/osd-scrub-repair 3 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:00:59.593 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:00:59.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:00:59.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:00:59.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:00:59.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 59e6313d-4615-42c5-a25f-1f8faf299afd' 2026-02-23T08:00:59.595 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:00:59.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:00:59.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA7CZxpnlXjIxAAjcN1mmPXNNofWnlxWhf1cg== 2026-02-23T08:00:59.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA7CZxpnlXjIxAAjcN1mmPXNNofWnlxWhf1cg=="}' 2026-02-23T08:00:59.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 59e6313d-4615-42c5-a25f-1f8faf299afd -i td/osd-scrub-repair/3/new.json 2026-02-23T08:00:59.766 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T08:00:59.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-23T08:00:59.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA7CZxpnlXjIxAAjcN1mmPXNNofWnlxWhf1cg== --osd-uuid 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:00:59.791 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:59.789+0000 7f3d4c184780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:59.792 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:59.790+0000 7f3d4c184780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:59.793 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:59.791+0000 7f3d4c184780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:00:59.794 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:59.791+0000 7f3d4c184780 -1 bdev(0x55e1bd7b9400 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-23T08:00:59.794 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:00:59.791+0000 7f3d4c184780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-23T08:01:00.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-23T08:01:00.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:01:00.276 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T08:01:00.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T08:01:00.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:01:00.482 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T08:01:00.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T08:01:00.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:00.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:01:00.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:01:00.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:01:00.494 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:00.492+0000 7eff5b815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:00.495 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:00.494+0000 7eff5b815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:00.496 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:00.494+0000 7eff5b815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:00.677 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:00.675+0000 7eff5b815780 -1 Falling back to public interface 2026-02-23T08:01:00.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:01.018 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:01.016+0000 7eff5b815780 -1 osd.3 0 log_to_monitors true 2026-02-23T08:01:01.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:01.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:01.817 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:01:01.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:01.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:01.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:01.983 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/492948950,v1:127.0.0.1:6827/492948950] [v2:127.0.0.1:6828/492948950,v1:127.0.0.1:6829/492948950] exists,up 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:01:01.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:01.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:01.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:01.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:866: corrupt_and_repair_jerasure: create_rbd_pool 2026-02-23T08:01:01.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:01:02.139 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:01:02.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:01:02.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:01:02.359 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:01:02.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:01:03.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:01:03.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:867: corrupt_and_repair_jerasure: wait_for_clean 2026-02-23T08:01:03.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:03.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:03.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:03.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:03.642 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:03.642 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:03.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:03.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:03.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:03.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:03.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:03.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:03.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:03.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:03.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:03.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:03.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:01:03.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:01:03.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:01:03.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:03.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:04.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T08:01:04.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T08:01:04.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672964' 2026-02-23T08:01:04.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:04.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:04.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T08:01:04.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T08:01:04.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672964 2-60129542146' 2026-02-23T08:01:04.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:04.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378626 2026-02-23T08:01:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378626 2026-02-23T08:01:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672964 2-60129542146 3-81604378626' 2026-02-23T08:01:04.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:04.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:01:04.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:04.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:04.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:01:04.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:04.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:01:04.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:01:04.186 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:01:04.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:04.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:01:04.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:05.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:05.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:05.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:01:05.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:05.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T08:01:05.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:05.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:05.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T08:01:05.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:05.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T08:01:05.520 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T08:01:05.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T08:01:05.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:05.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-23T08:01:05.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:05.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T08:01:05.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:05.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:05.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T08:01:05.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:05.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T08:01:05.689 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T08:01:05.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T08:01:05.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:05.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-23T08:01:05.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:05.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378626 2026-02-23T08:01:05.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:05.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:05.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378626 2026-02-23T08:01:05.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:05.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378626 2026-02-23T08:01:05.857 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 81604378626 2026-02-23T08:01:05.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378626' 2026-02-23T08:01:05.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378626 -lt 81604378626 2026-02-23T08:01:06.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:06.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:06.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:06.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:06.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:01:06.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:06.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:06.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:869: corrupt_and_repair_jerasure: create_ec_pool ecpool true k=2 m=2 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-23T08:01:06.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:01:06.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-23T08:01:06.804 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:01:06.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:01:06.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:01:07.109 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:01:07.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:01:08.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-23T08:01:08.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-23T08:01:08.295 INFO:tasks.workunit.client.0.trial129.stderr:set pool 2 allow_ec_overwrites to true 2026-02-23T08:01:08.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:01:08.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:08.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:08.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:08.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:08.308 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:08.308 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:08.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:08.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:08.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:08.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:08.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:08.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:08.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:08.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:08.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:08.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:08.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:01:08.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:01:08.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:01:08.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:08.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:08.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-23T08:01:08.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-23T08:01:08.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672966' 2026-02-23T08:01:08.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:08.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:08.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T08:01:08.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T08:01:08.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672966 2-60129542148' 2026-02-23T08:01:08.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:08.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:08.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378628 2026-02-23T08:01:08.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378628 2026-02-23T08:01:08.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672966 2-60129542148 3-81604378628' 2026-02-23T08:01:08.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:08.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:01:08.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:08.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:08.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:01:08.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:08.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:01:08.845 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:01:08.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:01:08.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:09.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:01:09.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:10.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:10.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:10.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:01:10.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:10.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-23T08:01:10.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:10.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:10.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-23T08:01:10.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:10.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-23T08:01:10.181 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672966 2026-02-23T08:01:10.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-23T08:01:10.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:10.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-23T08:01:10.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:10.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T08:01:10.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:10.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:10.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T08:01:10.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:10.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T08:01:10.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T08:01:10.350 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542148 2026-02-23T08:01:10.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:10.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T08:01:10.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:10.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378628 2026-02-23T08:01:10.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:10.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:10.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378628 2026-02-23T08:01:10.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:10.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378628 2026-02-23T08:01:10.519 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 81604378628 2026-02-23T08:01:10.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378628' 2026-02-23T08:01:10.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:10.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378628 -lt 81604378628 2026-02-23T08:01:10.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:10.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:10.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:10.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:10.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:11.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:11.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:11.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:11.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:11.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:870: corrupt_and_repair_jerasure: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-23T08:01:11.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:01:11.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:01:11.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:01:11.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:01:11.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:01:11.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:01:11.467 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:01:11.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:01:11.671 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:01:11.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:01:11.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:01:11.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:01:11.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-23T08:01:11.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T08:01:11.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:01:11.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:01:11.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:01:11.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-23T08:01:11.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-23T08:01:11.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-23T08:01:11.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:01:11.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-23T08:01:11.872 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:01:11.872 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:01:12.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-23T08:01:12.040 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:12.040 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:12.040 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:01:12.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 1 2 0 2026-02-23T08:01:12.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('1' '2' '0') 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=1 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=2 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:01:12.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:12.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:12.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:01:12.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:01:12.447 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:12.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:01:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:01:12.497 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T08:01:12.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:12.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:01:12.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:01:12.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:12.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:12.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:12.509 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:12.507+0000 7fe7b7a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:12.510 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:12.509+0000 7fe7b7a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:12.511 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:12.509+0000 7fe7b7a0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:12.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:01:12.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:12.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:12.719 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:12.716+0000 7fe7b7a0f780 -1 Falling back to public interface 2026-02-23T08:01:12.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:13.025 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:13.023+0000 7fe7b7a0f780 -1 osd.3 37 log_to_monitors true 2026-02-23T08:01:13.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:13.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:13.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:13.828 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:13.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:13.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:13.995 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 41 up_thru 41 down_at 38 last_clean_interval [19,37) [v2:127.0.0.1:6826/1341494715,v1:127.0.0.1:6827/1341494715] [v2:127.0.0.1:6828/1341494715,v1:127.0.0.1:6829/1341494715] exists,up 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:01:13.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:13.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:13.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:13.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:13.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:14.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:14.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:14.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:14.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:14.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:14.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:14.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:14.237 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:14.237 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:14.237 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:01:14.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:14.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:14.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:14.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:01:14.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:01:14.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:01:14.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:14.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:14.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672968 2026-02-23T08:01:14.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672968 2026-02-23T08:01:14.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968' 2026-02-23T08:01:14.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:14.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:14.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-23T08:01:14.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-23T08:01:14.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968 2-60129542150' 2026-02-23T08:01:14.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:14.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:14.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659138 2026-02-23T08:01:14.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659138 2026-02-23T08:01:14.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672968 2-60129542150 3-176093659138' 2026-02-23T08:01:14.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:14.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:01:14.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:14.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:14.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:01:14.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:14.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:01:14.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:01:14.530 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T08:01:14.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:01:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:15.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:15.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:15.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:01:15.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:15.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672968 2026-02-23T08:01:15.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:15.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:15.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672968 2026-02-23T08:01:15.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:15.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672968 2026-02-23T08:01:15.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2026-02-23T08:01:15.867 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672968 2026-02-23T08:01:15.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:16.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672968 -lt 42949672968 2026-02-23T08:01:16.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:16.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-23T08:01:16.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:16.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:16.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-23T08:01:16.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-23T08:01:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-23T08:01:16.035 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542150 2026-02-23T08:01:16.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:16.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542150 2026-02-23T08:01:16.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:16.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-176093659138 2026-02-23T08:01:16.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:16.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:16.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-176093659138 2026-02-23T08:01:16.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:16.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659138 2026-02-23T08:01:16.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 176093659138' 2026-02-23T08:01:16.207 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 176093659138 2026-02-23T08:01:16.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:16.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659138 -lt 176093659138 2026-02-23T08:01:16.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:16.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:16.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:16.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:16.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:16.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:16.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:16.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:16.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:16.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:16.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:16.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:16.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:16.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:16.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:16.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:16.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:16.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:16.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:01:16.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:01:16.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:01:16.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:01:16.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:01:17.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:01:17.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:01:17.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:01:17.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:01:17.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:17.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:17.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:17.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:17.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:01:07.107702+0000 2026-02-23T08:01:17.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:01:17.428 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:01:17.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:01:07.107702+0000 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:01:07.107702+0000 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:17.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:17.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:07.107702+0000 '>' 2026-02-23T08:01:07.107702+0000 2026-02-23T08:01:17.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:18.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:18.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:18.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:07.107702+0000 '>' 2026-02-23T08:01:07.107702+0000 2026-02-23T08:01:18.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:19.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:19.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:19.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:19.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:19.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:19.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:19.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:18.029861+0000 '>' 2026-02-23T08:01:07.107702+0000 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:01:19.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:20.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:01:20.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:01:20.300 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:01:20.300 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:01:20.300 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:01:20.300 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:01:20.301 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:01:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:01:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:01:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:20.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:20.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:20.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:01:20.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:01:20.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:20.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:20.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:20.356 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:20.354+0000 7fb2a674a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:20.357 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:20.355+0000 7fb2a674a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:20.358 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:20.356+0000 7fb2a674a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:01:20.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:20.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:20.560 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:20.558+0000 7fb2a674a780 -1 Falling back to public interface 2026-02-23T08:01:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:20.908 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:20.906+0000 7fb2a674a780 -1 osd.3 42 log_to_monitors true 2026-02-23T08:01:21.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:21.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:21.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:21.680 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:21.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:21.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 46 up_thru 46 down_at 43 last_clean_interval [41,42) [v2:127.0.0.1:6826/1682949696,v1:127.0.0.1:6827/1682949696] [v2:127.0.0.1:6828/1682949696,v1:127.0.0.1:6829/1682949696] exists,up 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:21.846 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:21.847 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:21.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:21.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:21.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:21.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:21.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:21.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:21.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:21.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:21.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:22.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:22.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-23T08:01:22.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-23T08:01:22.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-23T08:01:22.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:22.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:22.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-23T08:01:22.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-23T08:01:22.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970' 2026-02-23T08:01:22.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:22.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:22.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T08:01:22.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T08:01:22.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153' 2026-02-23T08:01:22.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:22.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:22.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495618 2026-02-23T08:01:22.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495618 2026-02-23T08:01:22.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153 3-197568495618' 2026-02-23T08:01:22.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:22.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-23T08:01:22.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:22.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-23T08:01:22.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:22.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-23T08:01:22.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-23T08:01:22.391 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836490 2026-02-23T08:01:22.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:22.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836490 2026-02-23T08:01:22.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:23.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:23.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:23.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-23T08:01:23.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:23.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-23T08:01:23.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:23.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:23.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-23T08:01:23.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:23.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-23T08:01:23.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-23T08:01:23.726 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672970 2026-02-23T08:01:23.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:23.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672971 -lt 42949672970 2026-02-23T08:01:23.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:23.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T08:01:23.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:23.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:23.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T08:01:23.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:23.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T08:01:23.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T08:01:23.897 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542153 2026-02-23T08:01:23.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:24.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-23T08:01:24.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:24.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-197568495618 2026-02-23T08:01:24.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:24.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:24.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-197568495618 2026-02-23T08:01:24.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:24.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495618 2026-02-23T08:01:24.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 197568495618' 2026-02-23T08:01:24.064 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 197568495618 2026-02-23T08:01:24.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:24.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495618 -lt 197568495618 2026-02-23T08:01:24.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:24.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:24.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:24.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:24.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:24.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:24.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:24.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:24.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:24.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:24.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:24.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:24.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:24.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:24.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:24.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:24.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:24.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:24.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:01:24.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 1 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=1 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:24.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:25.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:25.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:25.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:25.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:25.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:01:25.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:25.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:01:25.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T08:01:25.254 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:01:25.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:01:25.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:25.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:25.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:01:25.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:25.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:25.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:25.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:01:25.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:01:25.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:25.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:25.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:25.328 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:25.326+0000 7f3ab6817780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:25.329 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:25.327+0000 7f3ab6817780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:25.330 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:25.328+0000 7f3ab6817780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:01:25.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:25.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:01:25.541 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:25.538+0000 7f3ab6817780 -1 Falling back to public interface 2026-02-23T08:01:25.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:25.925 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:25.922+0000 7f3ab6817780 -1 osd.1 47 log_to_monitors true 2026-02-23T08:01:26.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:26.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:26.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:26.646 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:26.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:26.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:01:26.811 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 48 last_clean_interval [10,47) [v2:127.0.0.1:6810/3608601535,v1:127.0.0.1:6811/3608601535] [v2:127.0.0.1:6812/3608601535,v1:127.0.0.1:6813/3608601535] exists,up 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:01:26.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:26.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:26.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:26.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:26.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:26.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:26.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:26.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:26.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:26.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:27.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:27.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-23T08:01:27.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-23T08:01:27.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-23T08:01:27.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:27.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:27.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332098 2026-02-23T08:01:27.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332098 2026-02-23T08:01:27.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-219043332098' 2026-02-23T08:01:27.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:27.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:27.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-23T08:01:27.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-23T08:01:27.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-219043332098 2-60129542155' 2026-02-23T08:01:27.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:27.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495620 2026-02-23T08:01:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495620 2026-02-23T08:01:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492 1-219043332098 2-60129542155 3-197568495620' 2026-02-23T08:01:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:27.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-23T08:01:27.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:27.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:27.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-23T08:01:27.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:27.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-23T08:01:27.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-23T08:01:27.345 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836492 2026-02-23T08:01:27.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:27.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T08:01:27.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:28.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:28.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:28.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T08:01:28.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:29.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:01:29.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:29.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-23T08:01:29.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:29.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-219043332098 2026-02-23T08:01:29.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:29.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:29.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-219043332098 2026-02-23T08:01:29.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:29.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332098 2026-02-23T08:01:29.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 219043332098' 2026-02-23T08:01:29.853 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 219043332098 2026-02-23T08:01:29.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:30.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332098 -lt 219043332098 2026-02-23T08:01:30.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:30.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-23T08:01:30.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:30.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:30.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-23T08:01:30.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:30.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-23T08:01:30.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-23T08:01:30.023 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542155 2026-02-23T08:01:30.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:30.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-23T08:01:30.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:30.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-197568495620 2026-02-23T08:01:30.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:30.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:30.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-197568495620 2026-02-23T08:01:30.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:30.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495620 2026-02-23T08:01:30.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 197568495620' 2026-02-23T08:01:30.191 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 197568495620 2026-02-23T08:01:30.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:30.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495620 -lt 197568495620 2026-02-23T08:01:30.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:30.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:30.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:30.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:30.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:30.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:30.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:30.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:30.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:30.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:30.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:30.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:01:30.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:01:30.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:01:30.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:01:30.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:31.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:31.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:31.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:01:31.418 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:01:31.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:31.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:31.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:31.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:18.029861+0000 '>' 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:31.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:32.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:32.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:32.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:18.029861+0000 '>' 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:32.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:33.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:33.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:33.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:33.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:33.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:33.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:33.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:18.029861+0000 '>' 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:34.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:34.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:34.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:34.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:34.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:34.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:34.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:35.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:18.029861+0000 '>' 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:35.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:36.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:36.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:36.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:36.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:36.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:36.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:36.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:36.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:18.029861+0000 '>' 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:36.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:37.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:37.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:37.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:37.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:37.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:37.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:37.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:18.029861+0000 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:37.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:01:37.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:01:37.805 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:01:37.805 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:01:37.805 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:01:37.805 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:01:37.805 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:37.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:37.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:37.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:01:37.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:01:37.860 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T08:01:37.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:37.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:01:37.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:01:37.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:37.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:37.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:37.873 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:37.871+0000 7f6bade09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:37.875 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:37.873+0000 7f6bade09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:37.876 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:37.874+0000 7f6bade09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:38.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:01:38.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:38.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:38.071 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:38.068+0000 7f6bade09780 -1 Falling back to public interface 2026-02-23T08:01:38.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:38.449 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:01:38.447+0000 7f6bade09780 -1 osd.3 53 log_to_monitors true 2026-02-23T08:01:39.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:39.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:39.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:39.192 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:39.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:39.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 57 up_thru 57 down_at 54 last_clean_interval [46,53) [v2:127.0.0.1:6826/1453786406,v1:127.0.0.1:6827/1453786406] [v2:127.0.0.1:6828/1453786406,v1:127.0.0.1:6829/1453786406] exists,up 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:39.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:39.357 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:39.357 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:39.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:39.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:39.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:39.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:39.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:39.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:39.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:39.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:39.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:39.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:39.602 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:01:39.603 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:01:39.603 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:01:39.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:39.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:39.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:39.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T08:01:39.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T08:01:39.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T08:01:39.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:39.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:39.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332101 2026-02-23T08:01:39.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332101 2026-02-23T08:01:39.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-219043332101' 2026-02-23T08:01:39.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:39.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:39.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542158 2026-02-23T08:01:39.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542158 2026-02-23T08:01:39.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-219043332101 2-60129542158' 2026-02-23T08:01:39.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:39.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:39.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135874 2026-02-23T08:01:39.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135874 2026-02-23T08:01:39.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-219043332101 2-60129542158 3-244813135874' 2026-02-23T08:01:39.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:39.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T08:01:39.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:39.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:39.903 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T08:01:39.903 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:39.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T08:01:39.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T08:01:39.904 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836495 2026-02-23T08:01:39.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:40.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836495 2026-02-23T08:01:40.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:41.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:41.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:41.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T08:01:41.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:41.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-219043332101 2026-02-23T08:01:41.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:41.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:41.236 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-219043332101 2026-02-23T08:01:41.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:41.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332101 2026-02-23T08:01:41.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 219043332101' 2026-02-23T08:01:41.238 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 219043332101 2026-02-23T08:01:41.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:41.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332102 -lt 219043332101 2026-02-23T08:01:41.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:41.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542158 2026-02-23T08:01:41.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:41.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:41.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542158 2026-02-23T08:01:41.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:41.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542158 2026-02-23T08:01:41.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542158' 2026-02-23T08:01:41.405 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542158 2026-02-23T08:01:41.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:41.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542159 -lt 60129542158 2026-02-23T08:01:41.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:41.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135874 2026-02-23T08:01:41.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:41.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:41.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135874 2026-02-23T08:01:41.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:41.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135874 2026-02-23T08:01:41.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135874' 2026-02-23T08:01:41.579 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 244813135874 2026-02-23T08:01:41.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:41.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135874 -lt 244813135874 2026-02-23T08:01:41.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:41.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:41.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:41.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:41.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:41.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:41.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:41.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:41.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:41.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:41.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:42.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:42.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:42.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:42.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:42.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:42.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:42.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:42.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:01:42.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 1 2 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=1 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=2 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:01:42.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 538278"' 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 538278' 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 538279"' 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 538279' 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 538278 538279' 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 538278 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:42.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/538281: /' 2026-02-23T08:01:42.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:01:42.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/538283: /' 2026-02-23T08:01:42.829 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:42.830 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:42.831 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-23T08:01:42.832 INFO:tasks.workunit.client.0.trial129.stderr:538283: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-23T08:01:42.833 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:01:42.833 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.833 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:42.833 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:01:42.833 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:42.833 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:01:42.834 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:42.834 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:42.835 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:42.835 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:42.836 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:01:42.836 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:01:42.836 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:42.837 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:42.837 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:42.837 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:42.837 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:42.837 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:42.837 INFO:tasks.workunit.client.0.trial129.stderr:538283: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:42.838 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:42.839 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:42.839 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:42.839 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:42.839 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:42.839 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:42.839 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:42.840 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:01:42.840 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:01:42.840 INFO:tasks.workunit.client.0.trial129.stderr:538283: start osd.2 2026-02-23T08:01:42.842 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.843 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:42.843 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:01:42.843 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:42.843 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:42.843 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.844 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:42.844 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:01:42.844 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:42.844 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:01:42.844 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:42.844 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.845 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:01:42.846 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:42.847 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:42.847 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:01:42.847 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:42.847 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:01:42.847 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:42.847 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:42.848 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:42.848 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:42.849 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:01:42.849 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:01:42.849 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:42.849 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:42.849 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:42.849 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:42.850 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:42.850 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:42.850 INFO:tasks.workunit.client.0.trial129.stderr:538281: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:42.850 INFO:tasks.workunit.client.0.trial129.stderr:538281: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:42.850 INFO:tasks.workunit.client.0.trial129.stderr:538281: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:42.851 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:42.852 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:42.852 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:42.852 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:42.852 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:42.852 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:01:42.853 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:01:42.853 INFO:tasks.workunit.client.0.trial129.stderr:538281: start osd.1 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:44.340 INFO:tasks.workunit.client.0.trial129.stderr:538283: 2026-02-23T08:01:42.842+0000 7f22b8fff780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: 2026-02-23T08:01:42.843+0000 7f22b8fff780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: 2026-02-23T08:01:42.845+0000 7f22b8fff780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: 0 2026-02-23T08:01:44.341 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: 2026-02-23T08:01:43.024+0000 7f22b8fff780 -1 Falling back to public interface 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: 2026-02-23T08:01:43.468+0000 7f22b8fff780 -1 osd.2 59 log_to_monitors true 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: 1 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:01:44.342 INFO:tasks.workunit.client.0.trial129.stderr:538283: osd.2 up in weight 1 up_from 63 up_thru 63 down_at 60 last_clean_interval [14,59) [v2:127.0.0.1:6810/2326662025,v1:127.0.0.1:6811/2326662025] [v2:127.0.0.1:6812/2326662025,v1:127.0.0.1:6813/2326662025] exists,up 2db66020-d525-4d13-8a58-a5c86265360e 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:44.343 INFO:tasks.workunit.client.0.trial129.stderr:538283: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538283: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: 2026-02-23T08:01:42.854+0000 7f8690f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: 2026-02-23T08:01:42.855+0000 7f8690f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:44.351 INFO:tasks.workunit.client.0.trial129.stderr:538281: 2026-02-23T08:01:42.856+0000 7f8690f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: 0 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: 2026-02-23T08:01:43.064+0000 7f8690f4f780 -1 Falling back to public interface 2026-02-23T08:01:44.352 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: 2026-02-23T08:01:43.477+0000 7f8690f4f780 -1 osd.1 59 log_to_monitors true 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: 1 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: osd.1 up in weight 1 up_from 65 up_thru 65 down_at 60 last_clean_interval [51,59) [v2:127.0.0.1:6818/628966834,v1:127.0.0.1:6819/628966834] [v2:127.0.0.1:6820/628966834,v1:127.0.0.1:6821/628966834] exists,up 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:44.353 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:44.354 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:44.354 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:44.354 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:44.354 INFO:tasks.workunit.client.0.trial129.stderr:538281: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:44.888 INFO:tasks.workunit.client.0.trial129.stderr:538281: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: g3: get_timeout_delays: echo true 2026-02-23T08:01:44.888 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:44.888 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:44.888 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:44.888 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: 1 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: 2 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: 3' 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836497 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836497 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497' 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=279172874242 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 279172874242 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-279172874242' 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939650 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939650 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-279172874242 2-270582939650' 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135876 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135876 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-279172874242 2-270582939650 3-244813135876' 2026-02-23T08:01:44.889 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:et_timeout_delays: echo true 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:44.901 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: 1 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: 2 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: 3' 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836498 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836498 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498' 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=279172874243 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 279172874243 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-279172874243' 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:44.902 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939651 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939651 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-279172874243 2-270582939651' 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135877 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135877 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498 1-279172874243 2-270582939651 3-244813135877' 2026-02-23T08:01:44.903 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flu flush_pg_stats: echo 0-21474836497 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836497 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836497 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836497' 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: waiting osd.0 seq 21474836497 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836497 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836497 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-279172874242 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-279172874242 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=279172874242 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 279172874242' 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: waiting osd.1 seq 279172874242 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 279172874243 -lt 279172874242 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-270582939650 2026-02-23T08:01:46.572 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-270582939650 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939650 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 270582939650' 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: waiting osd.2 seq 270582939650 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939651 -lt 270582939650 2026-02-23T08:01:46.573 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/csh_pg_stats: echo 0-21474836498 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836498 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836498 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: waiting osd.0 seq 21474836498 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836498 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836498 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-279172874243 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-279172874243 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=279172874243 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 279172874243' 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: waiting osd.1 seq 279172874243 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 279172874243 -lt 279172874243 2026-02-23T08:01:46.575 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-270582939651 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-270582939651 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939651 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 270582939651' 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: waiting osd.2 seq 270582939651 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939651 -lt 270582939651 2026-02-23T08:01:46.576 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135876 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135876 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135876 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135876' 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: waiting osd.3 seq 244813135876 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135877 -lt 244813135876 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:538283: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:47.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:est/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135877 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135877 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135877 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135877' 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: waiting osd.3 seq 244813135877 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135877 -lt 244813135877 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:01:47.333 INFO:tasks.workunit.client.0.trial129.stderr:538281: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:538281: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 538279 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:01:47.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:47.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:47.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:47.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:47.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:01:47.815 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:47.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:47.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:47.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:47.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:47.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:48.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:48.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:48.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:48.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:48.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:48.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:48.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:49.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:49.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:50.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:50.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:50.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:50.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:50.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:50.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:50.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:50.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:50.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:51.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:51.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:51.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:51.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:51.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:51.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:51.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:51.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:51.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:52.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:52.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:52.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:52.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:52.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:52.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:52.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:52.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:52.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:53.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:53.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:53.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:53.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:53.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:53.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:53.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:53.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:53.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:54.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:54.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:54.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:54.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:54.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:54.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:54.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:54.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:31.809999+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:54.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:01:55.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:01:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:01:56.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:01:56.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:01:56.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:01:56.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:01:56.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:48.527946+0000 '>' 2026-02-23T08:01:31.809999+0000 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 541179"' 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 541179' 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:01:56.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 541180"' 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 541180' 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 541179 541180' 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 541179 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/541182: /' 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:01:56.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/541184: /' 2026-02-23T08:01:56.379 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.379 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:56.379 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:01:56.379 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:56.379 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING list-attrs 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:01:56.380 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING list-attrs 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: _ 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: hinfo_key 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: snapset 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:56.381 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:56.382 INFO:tasks.workunit.client.0.trial129.stderr:541184: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:56.383 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:01:56.384 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:01:56.384 INFO:tasks.workunit.client.0.trial129.stderr:541184: start osd.2 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:01:56.603 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:01:56.604 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: _ 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: hinfo_key 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: snapset 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:01:56.605 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:01:56.606 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:01:56.606 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:01:56.606 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:01:56.606 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:01:56.606 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:01:56.606 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:01:56.607 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:01:56.608 INFO:tasks.workunit.client.0.trial129.stderr:541182: start osd.1 2026-02-23T08:01:57.883 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:01:57.883 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:01:57.883 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: 2026-02-23T08:01:56.391+0000 7f1be274f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: 2026-02-23T08:01:56.393+0000 7f1be274f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: 2026-02-23T08:01:56.393+0000 7f1be274f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:57.884 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: 0 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: 2026-02-23T08:01:56.609+0000 7f1be274f780 -1 Falling back to public interface 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: 2026-02-23T08:01:57.027+0000 7f1be274f780 -1 osd.2 66 log_to_monitors true 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: 1 2026-02-23T08:01:57.885 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: osd.2 up in weight 1 up_from 70 up_thru 70 down_at 67 last_clean_interval [63,66) [v2:127.0.0.1:6810/453722593,v1:127.0.0.1:6811/453722593] [v2:127.0.0.1:6812/453722593,v1:127.0.0.1:6813/453722593] exists,up 2db66020-d525-4d13-8a58-a5c86265360e 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:57.886 INFO:tasks.workunit.client.0.trial129.stderr:541184: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:58.107 INFO:tasks.workunit.client.0.trial129.stderr:541184: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.recovery_ops 2026-02-23T08:01:58.107 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:01:58.108 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:01:58.108 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:01:58.108 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:01:58.108 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:01:58.108 INFO:tasks.workunit.client.0.trial129.stderr:541182: 2026-02-23T08:01:56.616+0000 7fd666415780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:58.109 INFO:tasks.workunit.client.0.trial129.stderr:541182: 2026-02-23T08:01:56.617+0000 7fd666415780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:58.109 INFO:tasks.workunit.client.0.trial129.stderr:541182: 2026-02-23T08:01:56.618+0000 7fd666415780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:01:58.109 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:01:58.109 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:01:58.109 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:01:58.109 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:01:58.110 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:01:58.110 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:58.110 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:01:58.110 INFO:tasks.workunit.client.0.trial129.stderr:541182: 0 2026-02-23T08:01:58.110 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:58.111 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:01:58.111 INFO:tasks.workunit.client.0.trial129.stderr:541182: 2026-02-23T08:01:56.821+0000 7fd666415780 -1 Falling back to public interface 2026-02-23T08:01:58.111 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:01:58.111 INFO:tasks.workunit.client.0.trial129.stderr:541182: 2026-02-23T08:01:57.248+0000 7fd666415780 -1 osd.1 66 log_to_monitors true 2026-02-23T08:01:58.111 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:01:58.111 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:01:58.112 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:01:58.112 INFO:tasks.workunit.client.0.trial129.stderr:541182: 1 2026-02-23T08:01:58.112 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:01:58.112 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:01:58.112 INFO:tasks.workunit.client.0.trial129.stderr:541182: osd.1 up in weight 1 up_from 73 up_thru 73 down_at 67 last_clean_interval [65,66) [v2:127.0.0.1:6818/3767067658,v1:127.0.0.1:6819/3767067658] [v2:127.0.0.1:6820/3767067658,v1:127.0.0.1:6821/3767067658] exists,up 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:01:58.112 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:01:58.113 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:01:58.113 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:01:58.113 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:01:58.113 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:01:58.113 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:01:58.114 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:01:58.114 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:01:58.114 INFO:tasks.workunit.client.0.trial129.stderr:541182: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:01:58.426 INFO:tasks.workunit.client.0.trial129.stderr:541182: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpsh:1593: get_timeout_delays: echo true 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:58.427 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: 1 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: 2 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: 3' 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836502 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836502 2026-02-23T08:01:58.428 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502' 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612610 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612610 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-313532612610' 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710722 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710722 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-313532612610 2-300647710722' 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.429 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:58.430 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135880 2026-02-23T08:01:58.430 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135880 2026-02-23T08:01:58.430 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-313532612610 2-300647710722 3-244813135880' 2026-02-23T08:01:58.430 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:01:58.648 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.shers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:01:58.648 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:01:58.648 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:01:58.648 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:01:58.648 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:01:58.648 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: 1 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: 2 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: 3' 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:01:58.649 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612611 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612611 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-313532612611' 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710723 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710723 2026-02-23T08:01:58.650 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-313532612611 2-300647710723' 2026-02-23T08:01:58.651 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:01:58.651 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:01:58.651 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=244813135882 2026-02-23T08:01:58.651 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 244813135882 2026-02-23T08:01:58.651 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-313532612611 2-300647710723 3-244813135882' 2026-02-23T08:01:58.651 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.105 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper:2266: flush_pg_stats: echo 0-21474836502 2026-02-23T08:02:00.105 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.105 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:00.105 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836502 2026-02-23T08:02:00.105 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.105 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836502 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: waiting osd.0 seq 21474836502 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836502 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836502 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-313532612610 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-313532612610 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612610 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 313532612610' 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: waiting osd.1 seq 313532612610 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612611 -lt 313532612610 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-300647710722 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-300647710722 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710722 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 300647710722' 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: waiting osd.2 seq 300647710722 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710723 -lt 300647710722 2026-02-23T08:02:00.106 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.324 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubs.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-23T08:02:00.324 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.324 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: waiting osd.0 seq 21474836503 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836503 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836503 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-313532612611 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-313532612611 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612611 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 313532612611' 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: waiting osd.1 seq 313532612611 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612611 -lt 313532612611 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-300647710723 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-300647710723 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710723 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 300647710723' 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: waiting osd.2 seq 300647710723 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710723 -lt 300647710723 2026-02-23T08:02:00.325 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541182: //homuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135880 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135880 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135880 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135880' 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: waiting osd.3 seq 244813135880 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135882 -lt 244813135880 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:00.864 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:541184: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:00.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:02:01.083 INFO:tasks.workunit.client.0.trial129.stderr:e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-244813135882 2026-02-23T08:02:01.083 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-244813135882 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=244813135882 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 244813135882' 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: waiting osd.3 seq 244813135882 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 244813135882 -lt 244813135882 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:01.084 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:01.085 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:541182: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:541182: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 541180 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:02:01.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:02:01.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:02:01.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:02:01.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 1 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=1 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:02:01.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 543465"' 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 543465' 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 543466"' 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 543466' 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 543465 543466' 2026-02-23T08:02:01.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:02:01.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:02:01.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 543465 2026-02-23T08:02:01.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:01.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/543468: /' 2026-02-23T08:02:01.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:02:01.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/543470: /' 2026-02-23T08:02:01.585 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.585 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:02:01.585 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:02:01.585 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:02:01.585 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:02:01.585 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:01.586 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:02:01.587 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:02:01.588 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:02:01.588 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:02:01.588 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:01.588 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:01.588 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:01.588 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:01.589 INFO:tasks.workunit.client.0.trial129.stderr:543470: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:02:01.590 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:02:01.591 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:02:01.591 INFO:tasks.workunit.client.0.trial129.stderr:543470: start osd.1 2026-02-23T08:02:01.591 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.591 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:02:01.591 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:01.592 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:02:01.593 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:01.594 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:01.595 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:02:01.596 INFO:tasks.workunit.client.0.trial129.stderr:543468: start osd.3 2026-02-23T08:02:03.101 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:03.101 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:02:03.101 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: 2026-02-23T08:02:01.598+0000 7f3ef0b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: 2026-02-23T08:02:01.600+0000 7f3ef0b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: 2026-02-23T08:02:01.600+0000 7f3ef0b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:02:03.102 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: 0 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: 2026-02-23T08:02:01.766+0000 7f3ef0b4f780 -1 Falling back to public interface 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: 2026-02-23T08:02:02.195+0000 7f3ef0b4f780 -1 osd.1 74 log_to_monitors true 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:03.103 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: 1 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: osd.1 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [73,74) [v2:127.0.0.1:6818/871073910,v1:127.0.0.1:6819/871073910] [v2:127.0.0.1:6820/871073910,v1:127.0.0.1:6821/871073910] exists,up 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:03.104 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:03.105 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:02:03.105 INFO:tasks.workunit.client.0.trial129.stderr:543470: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:03.105 INFO:tasks.workunit.client.0.trial129.stderr:543470: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: gps 2026-02-23T08:02:03.105 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:02:03.105 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: 2026-02-23T08:02:01.602+0000 7f502994f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: 2026-02-23T08:02:01.603+0000 7f502994f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: 2026-02-23T08:02:01.604+0000 7f502994f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:03.106 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: 0 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: 2026-02-23T08:02:01.777+0000 7f502994f780 -1 Falling back to public interface 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: 2026-02-23T08:02:02.215+0000 7f502994f780 -1 osd.3 74 log_to_monitors true 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: 1 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:03.107 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: osd.3 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [57,74) [v2:127.0.0.1:6826/896821374,v1:127.0.0.1:6827/896821374] [v2:127.0.0.1:6828/896821374,v1:127.0.0.1:6829/896821374] exists,up 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:02:03.108 INFO:tasks.workunit.client.0.trial129.stderr:543468: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543468: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: 1 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: 2 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: 3' 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836506 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836506 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506' 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-335007449090' 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.649 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710725 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710725 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-335007449090 2-300647710725' 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836506 1-335007449090 2-300647710725 3-335007449090' 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: fluet_timeout_delays: echo true 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: 1 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: 2 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: 3' 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836505 2026-02-23T08:02:03.650 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836505 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505' 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449091 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449091 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-335007449091' 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710726 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710726 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-335007449091 2-300647710726' 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449091 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449091 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-335007449091 2-300647710726 3-335007449091' 2026-02-23T08:02:03.651 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: waiting osd.0 seq 21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836505 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-335007449091 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:06.336 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-335007449091 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449091 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 335007449091' 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: waiting osd.1 seq 335007449091 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449091 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-300647710726 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-300647710726 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710726 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_statssh_pg_stats: echo 0-21474836506 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836506 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836506 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836506' 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: waiting osd.0 seq 21474836506 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836506 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836506 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:02:06.337 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836506 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-335007449090 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-335007449090 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 335007449090' 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: waiting osd.1 seq 335007449090 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449090 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-300647710725 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-300647710725 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:06.338 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710725 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 300647710725' 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: waiting osd.2 seq 300647710725 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710726 -lt 300647710725 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-335007449090 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-335007449090 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 335007449090' 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: waiting osd.3 seq 335007449090 2026-02-23T08:02:07.258 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449090 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:543470: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:07.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:: echo 'waiting osd.2 seq 300647710726' 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:543468: waiting osd.2 seq 300647710726 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710726 -lt 300647710726 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-335007449091 2026-02-23T08:02:07.260 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-335007449091 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449091 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 335007449091' 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: waiting osd.3 seq 335007449091 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449091 -lt 335007449091 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:07.261 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:543468: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:543468: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 543466 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:02:07.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:07.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:02:07.747 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:02:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:02:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:02:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:02:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:02:07.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:02:07.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:07.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:07.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:07.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:07.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:48.527946+0000 '>' 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:07.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:02:08.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:02:08.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:02:08.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:02:08.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:08.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:08.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:08.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:09.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:48.527946+0000 '>' 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:09.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:02:10.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:02:10.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:02:10.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:02:10.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:10.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:10.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:10.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:10.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:48.527946+0000 '>' 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:10.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:02:11.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:02:11.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:02:11.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:02:11.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:11.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:11.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:11.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:11.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:48.527946+0000 '>' 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:11.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:02:12.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:02:12.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:02:12.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:02:12.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:12.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:12.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:12.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:12.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:01:48.527946+0000 '>' 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:12.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:02:13.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:02:13.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:02:13.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:02:13.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:02:13.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:02:13.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:02:13.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:02:08.197085+0000 '>' 2026-02-23T08:01:48.527946+0000 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 546362"' 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 546362' 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:02:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 546363"' 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 546363' 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 546362 546363' 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 546362 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/546365: /' 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:02:13.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/546367: /' 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:02:14.169 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:02:14.170 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: _ 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: hinfo_key 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: snapset 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:02:14.171 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:02:14.172 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:02:14.172 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:14.172 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:14.172 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:14.172 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:14.173 INFO:tasks.workunit.client.0.trial129.stderr:546365: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:02:14.174 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:02:14.175 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:02:14.175 INFO:tasks.workunit.client.0.trial129.stderr:546365: start osd.3 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$n546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:02:14.180 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:02:14.181 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: _ 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: hinfo_key 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: snapset 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:02:14.182 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:14.183 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:14.183 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:14.183 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:14.183 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:02:14.183 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:02:14.183 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:14.184 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:02:14.185 INFO:tasks.workunit.client.0.trial129.stderr:546367: start osd.1 2026-02-23T08:02:15.679 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_ame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:15.679 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: 2026-02-23T08:02:14.182+0000 7f7af5d64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: 2026-02-23T08:02:14.183+0000 7f7af5d64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: 2026-02-23T08:02:14.184+0000 7f7af5d64780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:15.680 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: 0 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: 2026-02-23T08:02:14.372+0000 7f7af5d64780 -1 Falling back to public interface 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: 2026-02-23T08:02:14.820+0000 7f7af5d64780 -1 osd.3 80 log_to_monitors true 2026-02-23T08:02:15.681 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:15.682 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:15.682 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:15.682 INFO:tasks.workunit.client.0.trial129.stderr:546365: 1 2026-02-23T08:02:15.682 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:15.682 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:15.682 INFO:tasks.workunit.client.0.trial129.stderr:546365: osd.3 up in weight 1 up_from 84 up_thru 78 down_at 81 last_clean_interval [78,80) [v2:127.0.0.1:6818/2469025572,v1:127.0.0.1:6819/2469025572] [v2:127.0.0.1:6820/2469025572,v1:127.0.0.1:6821/2469025572] exists,up 59e6313d-4615-42c5-a25f-1f8faf299afd 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:15.683 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:15.696 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeoutrecovery_ops 2026-02-23T08:02:15.696 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:02:15.696 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:02:15.696 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: 2026-02-23T08:02:14.193+0000 7f46ae7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: 2026-02-23T08:02:14.194+0000 7f46ae7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: 2026-02-23T08:02:14.195+0000 7f46ae7fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:02:15.697 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: 0 2026-02-23T08:02:15.698 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: 2026-02-23T08:02:14.396+0000 7f46ae7fd780 -1 Falling back to public interface 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: 2026-02-23T08:02:14.843+0000 7f46ae7fd780 -1 osd.1 80 log_to_monitors true 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:15.699 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: 1 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: osd.1 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [78,80) [v2:127.0.0.1:6826/3278234737,v1:127.0.0.1:6827/3278234737] [v2:127.0.0.1:6828/3278234737,v1:127.0.0.1:6829/3278234737] exists,up 59104ff4-6d45-451e-98a0-2699ae285428 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:15.700 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:15.701 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:02:15.701 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:15.701 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:15.701 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:15.701 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:02:15.701 INFO:tasks.workunit.client.0.trial129.stderr:546367: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:16.224 INFO:tasks.workunit.client.0.trial129.stderr:546367: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-help_delays 90 .1 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:16.225 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: 1 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: 2 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: 3' 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.226 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-360777252866' 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:16.227 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710729 2026-02-23T08:02:16.228 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710729 2026-02-23T08:02:16.228 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-360777252866 2-300647710729' 2026-02-23T08:02:16.228 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.228 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:16.228 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-23T08:02:16.228 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-360777252866 2-300647ers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: 1 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: 2 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: 3' 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.249 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-360777252867' 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=300647710730 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 300647710730 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-360777252867 2-300647710730' 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-360777252867 2-300647710730 3-360777252867' 2026-02-23T08:02:16.250 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helper710729 3-360777252866' 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-23T08:02:17.905 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: waiting osd.0 seq 21474836510 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836510 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-360777252866 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:17.906 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-360777252866 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 360777252866' 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: waiting osd.1 seq 360777252866 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252866 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-300647710729 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:17.907 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-300647710729 2026-02-23T08:02:17.908 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:17.908 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710729 2026-02-23T08:02:17.908 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 300647710729' 2026-02-23T08:02:17.908 INFO:tasks.workunit.client.0.trial129.stderr:546365: waiting osd.2 seq 300647710729 2026-02-23T08:02:17.908 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:17.930 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/stans.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-23T08:02:17.930 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:17.930 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:17.930 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: waiting osd.0 seq 21474836511 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836511 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836511 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:17.931 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-360777252867 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-360777252867 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 360777252867' 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: waiting osd.1 seq 360777252867 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252867 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-300647710730 2026-02-23T08:02:17.932 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-300647710730 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=300647710730 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 300647710730' 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: waiting osd.2 seq 300647710730 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710731 -lt 300647710730 2026-02-23T08:02:17.933 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:18.659 INFO:tasks.workunit.client.0.trial129.stderr:546367: //homdalone/ceph-helpers.sh:2269: flush_pg_stats: test 300647710731 -lt 300647710729 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-360777252866 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-360777252866 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 360777252866' 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: waiting osd.3 seq 360777252866 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252866 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:18.660 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:546365: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:02:18.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 546363 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-360777252867 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-360777252867 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-23T08:02:18.683 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 360777252867' 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: waiting osd.3 seq 360777252867 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252867 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:18.684 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:546367: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:02:18.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:02:18.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:02:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:02:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:02:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:02:18.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:02:18.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:02:18.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:02:18.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:18.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:18.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:18.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:02:18.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:02:18.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:02:18.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:02:18.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:02:18.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:02:18.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:02:18.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:02:18.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:02:18.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:02:18.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:02:18.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:02:18.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:02:18.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:02:18.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:18.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:18.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:18.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:18.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:18.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:02:18.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:02:18.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:02:18.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:02:18.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:02:18.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:02:18.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:02:18.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:02:18.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:02:18.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:02:18.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:02:18.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:02:18.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:02:18.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:02:18.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:18.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:18.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:02:18.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:02:18.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:02:18.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:02:18.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:02:18.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:18.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:18.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:02:18.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:02:18.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:02:18.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:02:18.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:02:18.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_lrc_appends td/osd-scrub-repair 2026-02-23T08:02:18.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:901: TEST_corrupt_and_repair_lrc_appends: corrupt_and_repair_lrc td/osd-scrub-repair false 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:884: corrupt_and_repair_lrc: local dir=td/osd-scrub-repair 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:885: corrupt_and_repair_lrc: local allow_overwrites=false 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:886: corrupt_and_repair_lrc: local poolname=ecpool 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:888: corrupt_and_repair_lrc: run_mon td/osd-scrub-repair a 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:02:18.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:18.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:02:18.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:02:18.889 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:02:18.890 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:02:18.890 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:18.891 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:18.891 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:02:18.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:02:18.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:02:18.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:02:18.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:02:18.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:02:18.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:02:18.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:02:18.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:889: corrupt_and_repair_lrc: run_mgr td/osd-scrub-repair x 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:02:19.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:19.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:19.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:02:19.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:02:19.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: seq 0 9 2026-02-23T08:02:19.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 0 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:19.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:19.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:02:19.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:19.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2dfb53f1-dc94-43ce-9148-5c3d3efb52c6 2026-02-23T08:02:19.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2dfb53f1-dc94-43ce-9148-5c3d3efb52c6' 2026-02-23T08:02:19.123 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 2dfb53f1-dc94-43ce-9148-5c3d3efb52c6 2026-02-23T08:02:19.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:19.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCLCZxpw0PfBxAABAhZGdJgZPevXdNJFEEW1A== 2026-02-23T08:02:19.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCLCZxpw0PfBxAABAhZGdJgZPevXdNJFEEW1A=="}' 2026-02-23T08:02:19.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2dfb53f1-dc94-43ce-9148-5c3d3efb52c6 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:02:19.222 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:19.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:02:19.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCLCZxpw0PfBxAABAhZGdJgZPevXdNJFEEW1A== --osd-uuid 2dfb53f1-dc94-43ce-9148-5c3d3efb52c6 2026-02-23T08:02:19.246 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.244+0000 7fab30213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:19.248 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.246+0000 7fab30213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:19.248 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.246+0000 7fab30213780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:19.249 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.247+0000 7fab30213780 -1 bdev(0x5580005ed400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:19.249 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.247+0000 7fab30213780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:02:19.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:02:19.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:19.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:02:19.717 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:02:19.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:19.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:02:19.813 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:02:19.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:19.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:19.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:19.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:19.825 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.823+0000 7fa4e9412780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:19.827 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.825+0000 7fa4e9412780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:19.827 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:19.826+0000 7fa4e9412780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:19.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:02:19.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:19.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:02:19.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:19.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:19.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:19.910 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:19.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:19.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:19.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:02:20.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:20.075 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:20.072+0000 7fa4e9412780 -1 Falling back to public interface 2026-02-23T08:02:20.513 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:20.511+0000 7fa4e9412780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:02:21.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:21.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:21.005 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:21.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:21.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:21.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:02:21.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:22.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:22.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:22.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-23T08:02:22.099 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:02:22.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:22.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:02:22.265 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/192707876,v1:127.0.0.1:6801/192707876] [v2:127.0.0.1:6802/192707876,v1:127.0.0.1:6803/192707876] exists,up 2dfb53f1-dc94-43ce-9148-5c3d3efb52c6 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 1 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:02:22.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:22.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:22.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:22.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:02:22.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:22.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=389eae64-ab45-4471-b7d0-6b0be63f3f3c 2026-02-23T08:02:22.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 389eae64-ab45-4471-b7d0-6b0be63f3f3c' 2026-02-23T08:02:22.270 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 389eae64-ab45-4471-b7d0-6b0be63f3f3c 2026-02-23T08:02:22.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:22.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCOCZxpXUSIEBAAyA1iziFG0glUqpA1eLAJMQ== 2026-02-23T08:02:22.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCOCZxpXUSIEBAAyA1iziFG0glUqpA1eLAJMQ=="}' 2026-02-23T08:02:22.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 389eae64-ab45-4471-b7d0-6b0be63f3f3c -i td/osd-scrub-repair/1/new.json 2026-02-23T08:02:22.436 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:02:22.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCOCZxpXUSIEBAAyA1iziFG0glUqpA1eLAJMQ== --osd-uuid 389eae64-ab45-4471-b7d0-6b0be63f3f3c 2026-02-23T08:02:22.461 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:22.459+0000 7fc50514b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:22.462 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:22.460+0000 7fc50514b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:22.463 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:22.461+0000 7fc50514b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:22.463 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:22.461+0000 7fc50514b780 -1 bdev(0x55d8f6e3b400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:22.463 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:22.462+0000 7fc50514b780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:02:22.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:02:22.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:22.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:02:22.898 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:02:22.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:23.106 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:02:23.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:02:23.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:23.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:23.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:23.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:23.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:23.116+0000 7f6c57812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:23.120 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:23.118+0000 7f6c57812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:23.121 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:23.118+0000 7f6c57812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:23.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:02:23.310 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:23.308+0000 7f6c57812780 -1 Falling back to public interface 2026-02-23T08:02:23.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:23.677 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:23.675+0000 7f6c57812780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:02:24.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:24.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:24.436 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:24.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:24.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:24.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:02:24.604 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1808086113,v1:127.0.0.1:6811/1808086113] [v2:127.0.0.1:6812/1808086113,v1:127.0.0.1:6813/1808086113] exists,up 389eae64-ab45-4471-b7d0-6b0be63f3f3c 2026-02-23T08:02:24.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 2 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:02:24.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:24.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:24.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:24.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:02:24.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:24.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7a50bdbe-b78c-42bc-bc15-92d9ef7fbec0 2026-02-23T08:02:24.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 7a50bdbe-b78c-42bc-bc15-92d9ef7fbec0' 2026-02-23T08:02:24.613 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 7a50bdbe-b78c-42bc-bc15-92d9ef7fbec0 2026-02-23T08:02:24.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:24.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCQCZxpxkOrJBAA/ma9RzpqVemVhZYultgpGg== 2026-02-23T08:02:24.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCQCZxpxkOrJBAA/ma9RzpqVemVhZYultgpGg=="}' 2026-02-23T08:02:24.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7a50bdbe-b78c-42bc-bc15-92d9ef7fbec0 -i td/osd-scrub-repair/2/new.json 2026-02-23T08:02:24.776 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:02:24.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:02:24.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCQCZxpxkOrJBAA/ma9RzpqVemVhZYultgpGg== --osd-uuid 7a50bdbe-b78c-42bc-bc15-92d9ef7fbec0 2026-02-23T08:02:24.802 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:24.800+0000 7fea8887c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:24.803 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:24.801+0000 7fea8887c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:24.804 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:24.802+0000 7fea8887c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:24.805 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:24.802+0000 7fea8887c780 -1 bdev(0x55c7f4309400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:24.805 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:24.803+0000 7fea8887c780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:02:25.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:02:25.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:25.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:02:25.213 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:02:25.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:25.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:02:25.422 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:02:25.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:25.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:25.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:25.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:25.434 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:25.432+0000 7fe192e07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:25.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:25.433+0000 7fe192e07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:25.436 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:25.434+0000 7fe192e07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:25.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:02:25.633 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:25.630+0000 7fe192e07780 -1 Falling back to public interface 2026-02-23T08:02:25.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:26.043 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:26.041+0000 7fe192e07780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:02:26.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:26.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:26.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:26.754 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:26.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:26.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:02:26.918 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1396988815,v1:127.0.0.1:6819/1396988815] [v2:127.0.0.1:6820/1396988815,v1:127.0.0.1:6821/1396988815] exists,up 7a50bdbe-b78c-42bc-bc15-92d9ef7fbec0 2026-02-23T08:02:26.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 3 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:26.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 17250c70-b906-44dd-b1db-ee5a7cde973b' 2026-02-23T08:02:26.926 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:02:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:26.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCSCZxpT+1jNxAARSOuQ8m5ouiQLL4xSq30sA== 2026-02-23T08:02:26.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCSCZxpT+1jNxAARSOuQ8m5ouiQLL4xSq30sA=="}' 2026-02-23T08:02:26.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 17250c70-b906-44dd-b1db-ee5a7cde973b -i td/osd-scrub-repair/3/new.json 2026-02-23T08:02:27.091 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T08:02:27.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-23T08:02:27.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSCZxpT+1jNxAARSOuQ8m5ouiQLL4xSq30sA== --osd-uuid 17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:02:27.117 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.115+0000 7f8b39149780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:27.118 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.116+0000 7f8b39149780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:27.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.117+0000 7f8b39149780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:27.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.117+0000 7f8b39149780 -1 bdev(0x55622d971400 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:27.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.117+0000 7f8b39149780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-23T08:02:27.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-23T08:02:27.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:27.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T08:02:27.538 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T08:02:27.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:27.743 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T08:02:27.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T08:02:27.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:27.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:27.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:27.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:27.756 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.754+0000 7f3110946780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:27.757 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.755+0000 7f3110946780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:27.758 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.756+0000 7f3110946780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:27.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T08:02:27.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:27.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:02:27.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:27.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:27.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:27.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:27.911 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:27.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:27.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:27.963 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:27.960+0000 7f3110946780 -1 Falling back to public interface 2026-02-23T08:02:28.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:28.333 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:28.331+0000 7f3110946780 -1 osd.3 0 log_to_monitors true 2026-02-23T08:02:29.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:29.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:29.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:29.075 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:29.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:29.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:29.240 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3783088126,v1:127.0.0.1:6827/3783088126] [v2:127.0.0.1:6828/3783088126,v1:127.0.0.1:6829/3783088126] exists,up 17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 4 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-23T08:02:29.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/4 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/4' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/4/journal' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:29.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:29.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/4 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eacc9ab5-35d5-486a-9ba9-fab95c963235 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 eacc9ab5-35d5-486a-9ba9-fab95c963235' 2026-02-23T08:02:29.248 INFO:tasks.workunit.client.0.trial129.stdout:add osd4 eacc9ab5-35d5-486a-9ba9-fab95c963235 2026-02-23T08:02:29.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:29.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCVCZxpbXn9DhAAgg5xYV8T7PHMPsZ5qMd1CA== 2026-02-23T08:02:29.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCVCZxpbXn9DhAAgg5xYV8T7PHMPsZ5qMd1CA=="}' 2026-02-23T08:02:29.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eacc9ab5-35d5-486a-9ba9-fab95c963235 -i td/osd-scrub-repair/4/new.json 2026-02-23T08:02:29.414 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T08:02:29.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/4/new.json 2026-02-23T08:02:29.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCVCZxpbXn9DhAAgg5xYV8T7PHMPsZ5qMd1CA== --osd-uuid eacc9ab5-35d5-486a-9ba9-fab95c963235 2026-02-23T08:02:29.440 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:29.438+0000 7f12e314b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:29.441 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:29.440+0000 7f12e314b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:29.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:29.440+0000 7f12e314b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:29.443 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:29.441+0000 7f12e314b780 -1 bdev(0x55ba8e49d400 td/osd-scrub-repair/4/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:29.443 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:29.441+0000 7f12e314b780 -1 bluestore(td/osd-scrub-repair/4) _read_fsid unparsable uuid 2026-02-23T08:02:29.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/4/keyring 2026-02-23T08:02:29.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:29.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-23T08:02:29.857 INFO:tasks.workunit.client.0.trial129.stdout:adding osd4 key to auth repository 2026-02-23T08:02:29.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:30.066 INFO:tasks.workunit.client.0.trial129.stdout:start osd.4 2026-02-23T08:02:30.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-23T08:02:30.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:30.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:30.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:30.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:30.079 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:30.077+0000 7f0097a0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:30.080 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:30.078+0000 7f0097a0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:30.081 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:30.079+0000 7f0097a0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:30.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-23T08:02:30.292 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:30.289+0000 7f0097a0a780 -1 Falling back to public interface 2026-02-23T08:02:30.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:30.626 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:30.624+0000 7f0097a0a780 -1 osd.4 0 log_to_monitors true 2026-02-23T08:02:31.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:31.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:31.397 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:31.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:31.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:31.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-23T08:02:31.566 INFO:tasks.workunit.client.0.trial129.stdout:osd.4 up in weight 1 up_from 23 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1526157695,v1:127.0.0.1:6835/1526157695] [v2:127.0.0.1:6836/1526157695,v1:127.0.0.1:6837/1526157695] exists,up eacc9ab5-35d5-486a-9ba9-fab95c963235 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 5 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:31.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 cd80a4b5-842a-4a22-9437-6e416a8a4b40' 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stdout:add osd5 cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:02:31.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:31.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCXCZxpOv5sIhAAifGaCwji+v8LWWhzgsrXYg== 2026-02-23T08:02:31.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCXCZxpOv5sIhAAifGaCwji+v8LWWhzgsrXYg=="}' 2026-02-23T08:02:31.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cd80a4b5-842a-4a22-9437-6e416a8a4b40 -i td/osd-scrub-repair/5/new.json 2026-02-23T08:02:31.741 INFO:tasks.workunit.client.0.trial129.stdout:5 2026-02-23T08:02:31.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/5/new.json 2026-02-23T08:02:31.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCXCZxpOv5sIhAAifGaCwji+v8LWWhzgsrXYg== --osd-uuid cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:02:31.767 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:31.765+0000 7f53f5f8a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:31.768 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:31.766+0000 7f53f5f8a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:31.769 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:31.767+0000 7f53f5f8a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:31.770 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:31.767+0000 7f53f5f8a780 -1 bdev(0x55b4042eb400 td/osd-scrub-repair/5/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:31.770 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:31.768+0000 7f53f5f8a780 -1 bluestore(td/osd-scrub-repair/5) _read_fsid unparsable uuid 2026-02-23T08:02:32.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/5/keyring 2026-02-23T08:02:32.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:32.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-23T08:02:32.195 INFO:tasks.workunit.client.0.trial129.stdout:adding osd5 key to auth repository 2026-02-23T08:02:32.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:32.399 INFO:tasks.workunit.client.0.trial129.stdout:start osd.5 2026-02-23T08:02:32.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-23T08:02:32.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:32.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:32.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:32.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:32.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:32.411+0000 7f05b814f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:32.414 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:32.412+0000 7f05b814f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:32.415 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:32.413+0000 7f05b814f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:32.566 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:32.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:32.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:02:32.616 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:32.614+0000 7f05b814f780 -1 Falling back to public interface 2026-02-23T08:02:32.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:32.927 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:32.925+0000 7f05b814f780 -1 osd.5 0 log_to_monitors true 2026-02-23T08:02:33.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:33.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:33.729 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:33.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:33.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:33.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:02:33.894 INFO:tasks.workunit.client.0.trial129.stdout:osd.5 up in weight 1 up_from 27 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/696835047,v1:127.0.0.1:6843/696835047] [v2:127.0.0.1:6844/696835047,v1:127.0.0.1:6845/696835047] exists,up cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:02:33.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 6 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/6 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/6' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/6/journal' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:33.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:33.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/6 2026-02-23T08:02:33.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:33.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9109ed9b-a19f-4230-b556-395900856e71 2026-02-23T08:02:33.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 9109ed9b-a19f-4230-b556-395900856e71' 2026-02-23T08:02:33.898 INFO:tasks.workunit.client.0.trial129.stdout:add osd6 9109ed9b-a19f-4230-b556-395900856e71 2026-02-23T08:02:33.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:33.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCZCZxp27gCNhAAhCmhWKfovaeZHt/bDUtjuA== 2026-02-23T08:02:33.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCZCZxp27gCNhAAhCmhWKfovaeZHt/bDUtjuA=="}' 2026-02-23T08:02:33.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9109ed9b-a19f-4230-b556-395900856e71 -i td/osd-scrub-repair/6/new.json 2026-02-23T08:02:34.069 INFO:tasks.workunit.client.0.trial129.stdout:6 2026-02-23T08:02:34.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/6/new.json 2026-02-23T08:02:34.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCZCZxp27gCNhAAhCmhWKfovaeZHt/bDUtjuA== --osd-uuid 9109ed9b-a19f-4230-b556-395900856e71 2026-02-23T08:02:34.094 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.092+0000 7f7eb2414780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:34.096 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.093+0000 7f7eb2414780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:34.096 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.094+0000 7f7eb2414780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:34.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.095+0000 7f7eb2414780 -1 bdev(0x5634cbc05400 td/osd-scrub-repair/6/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:34.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.095+0000 7f7eb2414780 -1 bluestore(td/osd-scrub-repair/6) _read_fsid unparsable uuid 2026-02-23T08:02:34.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/6/keyring 2026-02-23T08:02:34.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:34.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-23T08:02:34.534 INFO:tasks.workunit.client.0.trial129.stdout:adding osd6 key to auth repository 2026-02-23T08:02:34.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:34.740 INFO:tasks.workunit.client.0.trial129.stdout:start osd.6 2026-02-23T08:02:34.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-23T08:02:34.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:34.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:34.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:34.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:34.753 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.751+0000 7f59d08a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:34.754 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.752+0000 7f59d08a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:34.755 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.753+0000 7f59d08a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:34.905 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-23T08:02:34.983 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:34.981+0000 7f59d08a6780 -1 Falling back to public interface 2026-02-23T08:02:35.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:35.336 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:35.334+0000 7f59d08a6780 -1 osd.6 0 log_to_monitors true 2026-02-23T08:02:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:36.070 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:36.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stdout:osd.6 up in weight 1 up_from 32 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/855895503,v1:127.0.0.1:6851/855895503] [v2:127.0.0.1:6852/855895503,v1:127.0.0.1:6853/855895503] exists,up 9109ed9b-a19f-4230-b556-395900856e71 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 7 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-23T08:02:36.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/7 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/7' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/7/journal' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/7 2026-02-23T08:02:36.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:36.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b20648cd-a766-4dbf-8e3d-7c712c5cc75f 2026-02-23T08:02:36.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 b20648cd-a766-4dbf-8e3d-7c712c5cc75f' 2026-02-23T08:02:36.240 INFO:tasks.workunit.client.0.trial129.stdout:add osd7 b20648cd-a766-4dbf-8e3d-7c712c5cc75f 2026-02-23T08:02:36.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:36.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCcCZxpUsbTDhAArXD7v8CyaaI64pIKjhaaRA== 2026-02-23T08:02:36.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCcCZxpUsbTDhAArXD7v8CyaaI64pIKjhaaRA=="}' 2026-02-23T08:02:36.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b20648cd-a766-4dbf-8e3d-7c712c5cc75f -i td/osd-scrub-repair/7/new.json 2026-02-23T08:02:36.412 INFO:tasks.workunit.client.0.trial129.stdout:7 2026-02-23T08:02:36.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/7/new.json 2026-02-23T08:02:36.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCcCZxpUsbTDhAArXD7v8CyaaI64pIKjhaaRA== --osd-uuid b20648cd-a766-4dbf-8e3d-7c712c5cc75f 2026-02-23T08:02:36.437 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:36.435+0000 7fa9dea0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:36.438 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:36.436+0000 7fa9dea0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:36.439 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:36.437+0000 7fa9dea0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:36.440 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:36.437+0000 7fa9dea0f780 -1 bdev(0x55b74e8a5400 td/osd-scrub-repair/7/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:36.440 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:36.437+0000 7fa9dea0f780 -1 bluestore(td/osd-scrub-repair/7) _read_fsid unparsable uuid 2026-02-23T08:02:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/7/keyring 2026-02-23T08:02:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:36.837 INFO:tasks.workunit.client.0.trial129.stdout:adding osd7 key to auth repository 2026-02-23T08:02:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-23T08:02:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:37.042 INFO:tasks.workunit.client.0.trial129.stdout:start osd.7 2026-02-23T08:02:37.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-23T08:02:37.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:37.054 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:37.052+0000 7f4d6294b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:37.055 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:37.053+0000 7f4d6294b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:37.056 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:37.054+0000 7f4d6294b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-23T08:02:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-23T08:02:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:37.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:37.210 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:37.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:37.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-23T08:02:37.223 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:37.221+0000 7f4d6294b780 -1 Falling back to public interface 2026-02-23T08:02:37.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:37.595 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:37.592+0000 7f4d6294b780 -1 osd.7 0 log_to_monitors true 2026-02-23T08:02:38.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:38.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:38.372 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:38.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:38.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:38.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stdout:osd.7 up in weight 1 up_from 36 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/138269879,v1:127.0.0.1:6859/138269879] [v2:127.0.0.1:6860/138269879,v1:127.0.0.1:6861/138269879] exists,up b20648cd-a766-4dbf-8e3d-7c712c5cc75f 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 8 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/8 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:38.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/8' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/8/journal' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:38.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/8 2026-02-23T08:02:38.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:38.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c244bff3-129c-4139-89ca-e4f943044776 2026-02-23T08:02:38.539 INFO:tasks.workunit.client.0.trial129.stdout:add osd8 c244bff3-129c-4139-89ca-e4f943044776 2026-02-23T08:02:38.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 c244bff3-129c-4139-89ca-e4f943044776' 2026-02-23T08:02:38.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:38.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCeCZxpN/SlIBAAm8gMVbXQmZ6hiNO5UmP3Kw== 2026-02-23T08:02:38.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCeCZxpN/SlIBAAm8gMVbXQmZ6hiNO5UmP3Kw=="}' 2026-02-23T08:02:38.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c244bff3-129c-4139-89ca-e4f943044776 -i td/osd-scrub-repair/8/new.json 2026-02-23T08:02:38.707 INFO:tasks.workunit.client.0.trial129.stdout:8 2026-02-23T08:02:38.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/8/new.json 2026-02-23T08:02:38.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCeCZxpN/SlIBAAm8gMVbXQmZ6hiNO5UmP3Kw== --osd-uuid c244bff3-129c-4139-89ca-e4f943044776 2026-02-23T08:02:38.732 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:38.729+0000 7ff5cc153780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:38.733 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:38.731+0000 7ff5cc153780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:38.734 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:38.732+0000 7ff5cc153780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:38.735 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:38.732+0000 7ff5cc153780 -1 bdev(0x555f0ec0d400 td/osd-scrub-repair/8/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:38.735 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:38.732+0000 7ff5cc153780 -1 bluestore(td/osd-scrub-repair/8) _read_fsid unparsable uuid 2026-02-23T08:02:39.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/8/keyring 2026-02-23T08:02:39.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:39.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-23T08:02:39.149 INFO:tasks.workunit.client.0.trial129.stdout:adding osd8 key to auth repository 2026-02-23T08:02:39.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:39.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-23T08:02:39.356 INFO:tasks.workunit.client.0.trial129.stdout:start osd.8 2026-02-23T08:02:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:39.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:39.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:39.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:39.368 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:39.366+0000 7eff0874f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:39.369 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:39.367+0000 7eff0874f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:39.370 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:39.368+0000 7eff0874f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:39.522 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:39.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:39.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-23T08:02:39.528 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:39.526+0000 7eff0874f780 -1 Falling back to public interface 2026-02-23T08:02:39.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:39.895 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:39.893+0000 7eff0874f780 -1 osd.8 0 log_to_monitors true 2026-02-23T08:02:40.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:40.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:40.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:40.684 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:40.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:40.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-23T08:02:40.852 INFO:tasks.workunit.client.0.trial129.stdout:osd.8 up in weight 1 up_from 40 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/1911603533,v1:127.0.0.1:6867/1911603533] [v2:127.0.0.1:6868/1911603533,v1:127.0.0.1:6869/1911603533] exists,up c244bff3-129c-4139-89ca-e4f943044776 2026-02-23T08:02:40.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:40.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 9 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:40.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:02:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:02:40.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:02:40.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:02:40.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 e1613ab8-76cd-4633-9f8c-9bce80f66ca2' 2026-02-23T08:02:40.857 INFO:tasks.workunit.client.0.trial129.stdout:add osd9 e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:02:40.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:02:40.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCgCZxpp7aJMxAAwwGFNi4LLkNhsBSU32SFow== 2026-02-23T08:02:40.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCgCZxpp7aJMxAAwwGFNi4LLkNhsBSU32SFow=="}' 2026-02-23T08:02:40.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e1613ab8-76cd-4633-9f8c-9bce80f66ca2 -i td/osd-scrub-repair/9/new.json 2026-02-23T08:02:41.026 INFO:tasks.workunit.client.0.trial129.stdout:9 2026-02-23T08:02:41.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/9/new.json 2026-02-23T08:02:41.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCgCZxpp7aJMxAAwwGFNi4LLkNhsBSU32SFow== --osd-uuid e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:02:41.051 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.049+0000 7fc3962a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:41.052 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.050+0000 7fc3962a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:41.052 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.051+0000 7fc3962a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:41.053 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.051+0000 7fc3962a6780 -1 bdev(0x5596cd3cd400 td/osd-scrub-repair/9/block) open stat got: (1) Operation not permitted 2026-02-23T08:02:41.053 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.051+0000 7fc3962a6780 -1 bluestore(td/osd-scrub-repair/9) _read_fsid unparsable uuid 2026-02-23T08:02:41.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/9/keyring 2026-02-23T08:02:41.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:02:41.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2026-02-23T08:02:41.460 INFO:tasks.workunit.client.0.trial129.stdout:adding osd9 key to auth repository 2026-02-23T08:02:41.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:02:41.668 INFO:tasks.workunit.client.0.trial129.stdout:start osd.9 2026-02-23T08:02:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2026-02-23T08:02:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:02:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:02:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:02:41.681 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.679+0000 7fcf0414d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:41.682 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.680+0000 7fcf0414d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:41.683 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.681+0000 7fcf0414d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:41.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:02:41.918 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:41.916+0000 7fcf0414d780 -1 Falling back to public interface 2026-02-23T08:02:41.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:42.338 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:42.336+0000 7fcf0414d780 -1 osd.9 0 log_to_monitors true 2026-02-23T08:02:42.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:42.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:42.997 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:02:42.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:42.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:42.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:02:43.163 INFO:tasks.workunit.client.0.trial129.stdout:osd.9 up in weight 1 up_from 45 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/2586413760,v1:127.0.0.1:6875/2586413760] [v2:127.0.0.1:6876/2586413760,v1:127.0.0.1:6877/2586413760] exists,up e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:02:43.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:43.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:43.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:43.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:893: corrupt_and_repair_lrc: create_rbd_pool 2026-02-23T08:02:43.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:02:43.321 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:02:43.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:02:43.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:02:43.545 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:02:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:02:44.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:02:44.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:894: corrupt_and_repair_lrc: wait_for_clean 2026-02-23T08:02:44.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:44.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:44.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:44.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:02:44.838 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:44.838 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:02:44.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:44.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:44.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:44.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:44.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:44.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:44.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:44.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:44.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:45.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-23T08:02:45.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-23T08:02:45.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-23T08:02:45.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:45.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T08:02:45.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T08:02:45.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670' 2026-02-23T08:02:45.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:45.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-23T08:02:45.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-23T08:02:45.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853' 2026-02-23T08:02:45.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:45.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-23T08:02:45.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-23T08:02:45.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333' 2026-02-23T08:02:45.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:02:45.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247812 2026-02-23T08:02:45.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247812 2026-02-23T08:02:45.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333 4-98784247812' 2026-02-23T08:02:45.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:02:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116996 2026-02-23T08:02:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116996 2026-02-23T08:02:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333 4-98784247812 5-115964116996' 2026-02-23T08:02:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:02:45.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953476 2026-02-23T08:02:45.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953476 2026-02-23T08:02:45.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953476' 2026-02-23T08:02:45.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:02:45.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-23T08:02:45.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-23T08:02:45.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953476 7-154618822659' 2026-02-23T08:02:45.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:02:45.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691842 2026-02-23T08:02:45.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691842 2026-02-23T08:02:45.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953476 7-154618822659 8-171798691842' 2026-02-23T08:02:45.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:45.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:02:45.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528322 2026-02-23T08:02:45.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528322 2026-02-23T08:02:45.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-55834574853 3-77309411333 4-98784247812 5-115964116996 6-137438953476 7-154618822659 8-171798691842 9-193273528322' 2026-02-23T08:02:45.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:45.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-23T08:02:45.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:45.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:45.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-23T08:02:45.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:45.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-23T08:02:45.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-23T08:02:45.829 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836486 2026-02-23T08:02:45.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:45.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836486 2026-02-23T08:02:45.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:46.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:46.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:47.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836486 2026-02-23T08:02:47.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:47.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T08:02:47.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:47.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:47.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T08:02:47.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:47.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T08:02:47.165 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705670 2026-02-23T08:02:47.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T08:02:47.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:47.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-23T08:02:47.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:47.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574853 2026-02-23T08:02:47.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:47.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:47.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574853 2026-02-23T08:02:47.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:47.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574853 2026-02-23T08:02:47.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574853' 2026-02-23T08:02:47.330 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574853 2026-02-23T08:02:47.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574853 2026-02-23T08:02:47.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:47.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411333 2026-02-23T08:02:47.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:47.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:47.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411333 2026-02-23T08:02:47.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411333 2026-02-23T08:02:47.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411333' 2026-02-23T08:02:47.498 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411333 2026-02-23T08:02:47.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:47.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-23T08:02:47.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:47.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247812 2026-02-23T08:02:47.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:47.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:02:47.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247812 2026-02-23T08:02:47.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:47.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247812 2026-02-23T08:02:47.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247812' 2026-02-23T08:02:47.664 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.4 seq 98784247812 2026-02-23T08:02:47.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:02:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247813 -lt 98784247812 2026-02-23T08:02:47.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:47.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964116996 2026-02-23T08:02:47.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:47.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:02:47.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964116996 2026-02-23T08:02:47.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:47.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116996 2026-02-23T08:02:47.830 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.5 seq 115964116996 2026-02-23T08:02:47.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964116996' 2026-02-23T08:02:47.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:02:47.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116996 -lt 115964116996 2026-02-23T08:02:47.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:47.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953476 2026-02-23T08:02:47.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:47.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:02:47.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953476 2026-02-23T08:02:47.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:47.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953476 2026-02-23T08:02:47.999 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.6 seq 137438953476 2026-02-23T08:02:48.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953476' 2026-02-23T08:02:48.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:02:48.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953477 -lt 137438953476 2026-02-23T08:02:48.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:48.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822659 2026-02-23T08:02:48.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:48.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:02:48.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822659 2026-02-23T08:02:48.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:48.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-23T08:02:48.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822659' 2026-02-23T08:02:48.167 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.7 seq 154618822659 2026-02-23T08:02:48.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:02:48.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-23T08:02:48.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:48.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691842 2026-02-23T08:02:48.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:48.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:02:48.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691842 2026-02-23T08:02:48.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:48.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691842 2026-02-23T08:02:48.334 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.8 seq 171798691842 2026-02-23T08:02:48.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691842' 2026-02-23T08:02:48.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:02:48.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691843 -lt 171798691842 2026-02-23T08:02:48.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:48.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-193273528322 2026-02-23T08:02:48.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:48.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:02:48.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-193273528322 2026-02-23T08:02:48.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:48.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528322 2026-02-23T08:02:48.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 193273528322' 2026-02-23T08:02:48.502 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.9 seq 193273528322 2026-02-23T08:02:48.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:02:48.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528322 -lt 193273528322 2026-02-23T08:02:48.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:48.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:48.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:48.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:49.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:02:49.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:49.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:49.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:896: corrupt_and_repair_lrc: create_ec_pool ecpool false k=4 m=2 l=3 plugin=lrc 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:02:49.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=4 m=2 l=3 plugin=lrc 2026-02-23T08:02:49.448 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:02:49.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:02:49.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:02:49.753 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:02:49.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:02:50.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T08:02:50.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:02:50.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:50.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:50.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:50.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:02:50.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:50.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:02:50.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:50.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:50.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:50.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:50.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:51.011 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:02:51.011 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:02:51.011 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:02:51.011 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:02:51.011 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:51.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-23T08:02:51.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-23T08:02:51.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-23T08:02:51.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:51.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-23T08:02:51.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-23T08:02:51.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-23T08:02:51.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:51.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574855 2026-02-23T08:02:51.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574855 2026-02-23T08:02:51.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855' 2026-02-23T08:02:51.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:51.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411335 2026-02-23T08:02:51.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411335 2026-02-23T08:02:51.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335' 2026-02-23T08:02:51.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:02:51.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247814 2026-02-23T08:02:51.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247814 2026-02-23T08:02:51.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247814' 2026-02-23T08:02:51.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:02:51.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116998 2026-02-23T08:02:51.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116998 2026-02-23T08:02:51.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247814 5-115964116998' 2026-02-23T08:02:51.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:02:51.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953479 2026-02-23T08:02:51.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953479 2026-02-23T08:02:51.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247814 5-115964116998 6-137438953479' 2026-02-23T08:02:51.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:02:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822661 2026-02-23T08:02:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822661 2026-02-23T08:02:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247814 5-115964116998 6-137438953479 7-154618822661' 2026-02-23T08:02:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:02:51.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691845 2026-02-23T08:02:51.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691845 2026-02-23T08:02:51.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247814 5-115964116998 6-137438953479 7-154618822661 8-171798691845' 2026-02-23T08:02:51.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:51.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:02:51.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528324 2026-02-23T08:02:51.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528324 2026-02-23T08:02:51.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-55834574855 3-77309411335 4-98784247814 5-115964116998 6-137438953479 7-154618822661 8-171798691845 9-193273528324' 2026-02-23T08:02:51.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:51.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-23T08:02:51.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:51.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:51.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-23T08:02:51.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:51.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-23T08:02:51.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-23T08:02:51.755 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836488 2026-02-23T08:02:51.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:51.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-23T08:02:51.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:51.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-23T08:02:51.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:51.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:02:51.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-23T08:02:51.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:51.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-23T08:02:51.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-23T08:02:51.927 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705672 2026-02-23T08:02:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:52.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705672 2026-02-23T08:02:52.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:02:53.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:02:53.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:02:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-23T08:02:53.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:53.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574855 2026-02-23T08:02:53.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:53.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:02:53.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574855 2026-02-23T08:02:53.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574855 2026-02-23T08:02:53.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574855' 2026-02-23T08:02:53.264 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574855 2026-02-23T08:02:53.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:02:53.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574856 -lt 55834574855 2026-02-23T08:02:53.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:53.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411335 2026-02-23T08:02:53.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:53.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:02:53.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411335 2026-02-23T08:02:53.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:53.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411335 2026-02-23T08:02:53.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411335' 2026-02-23T08:02:53.438 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411335 2026-02-23T08:02:53.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:02:53.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411335 -lt 77309411335 2026-02-23T08:02:53.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:53.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247814 2026-02-23T08:02:53.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:53.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:02:53.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247814 2026-02-23T08:02:53.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:53.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247814 2026-02-23T08:02:53.607 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.4 seq 98784247814 2026-02-23T08:02:53.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247814' 2026-02-23T08:02:53.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:02:53.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247815 -lt 98784247814 2026-02-23T08:02:53.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:53.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964116998 2026-02-23T08:02:53.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:53.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:02:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964116998 2026-02-23T08:02:53.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:53.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116998 2026-02-23T08:02:53.774 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.5 seq 115964116998 2026-02-23T08:02:53.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964116998' 2026-02-23T08:02:53.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:02:53.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116998 -lt 115964116998 2026-02-23T08:02:53.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:53.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953479 2026-02-23T08:02:53.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:53.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:02:53.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953479 2026-02-23T08:02:53.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:53.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953479 2026-02-23T08:02:53.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953479' 2026-02-23T08:02:53.947 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.6 seq 137438953479 2026-02-23T08:02:53.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:02:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953479 -lt 137438953479 2026-02-23T08:02:54.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:54.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822661 2026-02-23T08:02:54.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:54.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:02:54.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822661 2026-02-23T08:02:54.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:54.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822661 2026-02-23T08:02:54.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822661' 2026-02-23T08:02:54.112 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.7 seq 154618822661 2026-02-23T08:02:54.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:02:54.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822661 -lt 154618822661 2026-02-23T08:02:54.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:54.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691845 2026-02-23T08:02:54.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:54.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:02:54.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691845 2026-02-23T08:02:54.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:54.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691845 2026-02-23T08:02:54.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691845' 2026-02-23T08:02:54.282 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.8 seq 171798691845 2026-02-23T08:02:54.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:02:54.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691845 -lt 171798691845 2026-02-23T08:02:54.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:54.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-193273528324 2026-02-23T08:02:54.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:54.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:02:54.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-193273528324 2026-02-23T08:02:54.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:54.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528324 2026-02-23T08:02:54.451 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.9 seq 193273528324 2026-02-23T08:02:54.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 193273528324' 2026-02-23T08:02:54.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:02:54.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528324 -lt 193273528324 2026-02-23T08:02:54.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:02:54.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:54.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:54.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:02:54.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:02:54.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:02:54.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:02:54.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:02:54.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:02:54.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:02:54.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:02:54.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:02:54.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:02:54.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:02:54.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:897: corrupt_and_repair_lrc: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:02:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:02:55.375 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:02:55.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:02:55.576 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:02:55.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:02:55.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:02:55.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:02:55.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-23T08:02:55.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T08:02:55.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:02:55.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:02:55.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:02:55.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-23T08:02:55.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-23T08:02:55.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:02:55.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-23T08:02:55.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-23T08:02:55.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:02:55.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:02:55.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-23T08:02:55.940 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr:9 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr:7' 2026-02-23T08:02:55.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 6 2 1 7 2026-02-23T08:02:55.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('5' '9' '0' '6' '2' '1' '7') 2026-02-23T08:02:55.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-23T08:02:55.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=5 2026-02-23T08:02:55.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=9 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:02:55.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:02:55.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:02:55.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:02:56.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:56.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:02:56.368 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:02:56.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:02:56.435 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:02:56.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:56.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:02:56.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:02:56.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:02:56.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:02:56.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:02:56.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:02:56.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:02:56.449 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:56.447+0000 7ff933a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:56.451 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:56.449+0000 7ff933a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:56.451 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:56.451+0000 7ff933a11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:02:56.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:56.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:56.650 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:56.648+0000 7ff933a11780 -1 Falling back to public interface 2026-02-23T08:02:56.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:02:57.033 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:02:57.031+0000 7ff933a11780 -1 osd.3 64 log_to_monitors true 2026-02-23T08:02:57.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:02:57.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:02:57.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:02:57.769 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:02:57.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:02:57.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 68 up_thru 68 down_at 65 last_clean_interval [18,64) [v2:127.0.0.1:6826/148356501,v1:127.0.0.1:6827/148356501] [v2:127.0.0.1:6828/148356501,v1:127.0.0.1:6829/148356501] exists,up 17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:02:57.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:02:57.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:02:57.935 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:02:57.935 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:02:57.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:02:57.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:02:57.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:02:58.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:02:58.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:02:58.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:02:58.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:02:58.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:02:58.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:02:58.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:02:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-23T08:02:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-23T08:02:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-23T08:02:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:02:58.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-23T08:02:58.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-23T08:02:58.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-23T08:02:58.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:02:58.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574858 2026-02-23T08:02:58.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574858 2026-02-23T08:02:58.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858' 2026-02-23T08:02:58.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:02:58.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776130 2026-02-23T08:02:58.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776130 2026-02-23T08:02:58.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130' 2026-02-23T08:02:58.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:02:58.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247817 2026-02-23T08:02:58.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247817 2026-02-23T08:02:58.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130 4-98784247817' 2026-02-23T08:02:58.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:02:58.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117000 2026-02-23T08:02:58.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117000 2026-02-23T08:02:58.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130 4-98784247817 5-115964117000' 2026-02-23T08:02:58.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:02:58.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953481 2026-02-23T08:02:58.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953481 2026-02-23T08:02:58.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130 4-98784247817 5-115964117000 6-137438953481' 2026-02-23T08:02:58.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:02:58.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822664 2026-02-23T08:02:58.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822664 2026-02-23T08:02:58.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130 4-98784247817 5-115964117000 6-137438953481 7-154618822664' 2026-02-23T08:02:58.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:02:58.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691847 2026-02-23T08:02:58.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691847 2026-02-23T08:02:58.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130 4-98784247817 5-115964117000 6-137438953481 7-154618822664 8-171798691847' 2026-02-23T08:02:58.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:02:58.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:02:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=193273528327 2026-02-23T08:02:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 193273528327 2026-02-23T08:02:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574858 3-292057776130 4-98784247817 5-115964117000 6-137438953481 7-154618822664 8-171798691847 9-193273528327' 2026-02-23T08:02:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:02:58.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-23T08:02:58.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:02:58.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:02:58.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-23T08:02:58.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:02:58.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-23T08:02:58.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-23T08:02:58.924 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836491 2026-02-23T08:02:58.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:02:59.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-23T08:02:59.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:00.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-23T08:03:00.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:00.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-23T08:03:00.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:00.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:00.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-23T08:03:00.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:00.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-23T08:03:00.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-23T08:03:00.256 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705674 2026-02-23T08:03:00.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:00.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-23T08:03:00.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:00.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574858 2026-02-23T08:03:00.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:00.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:00.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574858 2026-02-23T08:03:00.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:00.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574858 2026-02-23T08:03:00.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574858' 2026-02-23T08:03:00.423 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574858 2026-02-23T08:03:00.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:00.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574858 -lt 55834574858 2026-02-23T08:03:00.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:00.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776130 2026-02-23T08:03:00.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:00.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:00.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776130 2026-02-23T08:03:00.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:00.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776130 2026-02-23T08:03:00.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776130' 2026-02-23T08:03:00.591 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 292057776130 2026-02-23T08:03:00.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:00.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776130 -lt 292057776130 2026-02-23T08:03:00.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:00.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247817 2026-02-23T08:03:00.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:00.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:00.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247817 2026-02-23T08:03:00.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:00.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247817 2026-02-23T08:03:00.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247817' 2026-02-23T08:03:00.758 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 98784247817 2026-02-23T08:03:00.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:00.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247817 -lt 98784247817 2026-02-23T08:03:00.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:00.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964117000 2026-02-23T08:03:00.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:00.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:00.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964117000 2026-02-23T08:03:00.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:00.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964117000 2026-02-23T08:03:00.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964117000' 2026-02-23T08:03:00.927 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 115964117000 2026-02-23T08:03:00.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:01.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964117001 -lt 115964117000 2026-02-23T08:03:01.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:01.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953481 2026-02-23T08:03:01.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:01.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:01.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953481 2026-02-23T08:03:01.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:01.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953481 2026-02-23T08:03:01.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953481' 2026-02-23T08:03:01.096 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 137438953481 2026-02-23T08:03:01.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:01.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953481 -lt 137438953481 2026-02-23T08:03:01.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:01.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822664 2026-02-23T08:03:01.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:01.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:01.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822664 2026-02-23T08:03:01.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:01.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822664 2026-02-23T08:03:01.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822664' 2026-02-23T08:03:01.267 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 154618822664 2026-02-23T08:03:01.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:01.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822664 -lt 154618822664 2026-02-23T08:03:01.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:01.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691847 2026-02-23T08:03:01.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:01.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:01.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691847 2026-02-23T08:03:01.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:01.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691847 2026-02-23T08:03:01.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691847' 2026-02-23T08:03:01.438 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 171798691847 2026-02-23T08:03:01.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:01.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691848 -lt 171798691847 2026-02-23T08:03:01.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:01.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-193273528327 2026-02-23T08:03:01.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:01.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:01.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-193273528327 2026-02-23T08:03:01.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:01.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=193273528327 2026-02-23T08:03:01.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 193273528327' 2026-02-23T08:03:01.609 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 193273528327 2026-02-23T08:03:01.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:01.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 193273528327 -lt 193273528327 2026-02-23T08:03:01.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:01.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:01.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:01.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:01.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:01.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:01.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:01.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:01.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:01.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:01.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:02.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:02.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:02.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:02.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:02.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:02.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:02.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:02.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:03:02.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:03:02.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:03:02.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:03:02.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:03:02.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:03:02.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:03:02.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:03:02.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:03:02.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:02.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:02.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:02.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:02.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:02.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:03:02.842 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:03:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:03:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:03:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:03:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:03.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:02:49.752066+0000 '>' 2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:03.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:04.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:04.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:04.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:04.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:04.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:04.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:04.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:04.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:02:49.752066+0000 '>' 2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:04.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:05.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:05.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:05.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:05.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:05.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:05.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:05.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:05.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:02:49.752066+0000 '>' 2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:05.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:06.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:06.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:06.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:02:49.752066+0000 '>' 2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:06.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:07.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:07.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:07.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:07.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:07.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:07.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:07.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:07.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:03.076771+0000 '>' 2026-02-23T08:02:49.752066+0000 2026-02-23T08:03:07.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:03:07.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:07.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:07.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:07.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:07.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-23T08:03:08.033 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:03:08.033 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:03:08.033 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:03:08.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:08.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:08.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:03:08.082 INFO:tasks.workunit.client.0.trial129.stderr:start osd.9 2026-02-23T08:03:08.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:03:08.083 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:03:08.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:03:08.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:08.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:08.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:08.091 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:08.090+0000 7f990b18a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:08.092 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:08.091+0000 7f990b18a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:08.093 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:08.092+0000 7f990b18a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:03:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:08.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:08.273 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:08.272+0000 7f990b18a780 -1 Falling back to public interface 2026-02-23T08:03:08.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:08.608 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:08.607+0000 7f990b18a780 -1 osd.9 70 log_to_monitors true 2026-02-23T08:03:09.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:09.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:09.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:09.413 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:03:09.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:09.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:09.578 INFO:tasks.workunit.client.0.trial129.stderr:osd.9 up in weight 1 up_from 73 up_thru 0 down_at 70 last_clean_interval [45,70) [v2:127.0.0.1:6874/2788432098,v1:127.0.0.1:6875/2788432098] [v2:127.0.0.1:6876/2788432098,v1:127.0.0.1:6877/2788432098] exists,up e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:03:09.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:09.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:09.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:09.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:09.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:09.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:09.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:09.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:09.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:09.824 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:09.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T08:03:09.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T08:03:09.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T08:03:09.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:09.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:09.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705678 2026-02-23T08:03:09.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705678 2026-02-23T08:03:09.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678' 2026-02-23T08:03:09.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:09.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:10.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574861 2026-02-23T08:03:10.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574861 2026-02-23T08:03:10.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861' 2026-02-23T08:03:10.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:10.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776133 2026-02-23T08:03:10.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776133 2026-02-23T08:03:10.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133' 2026-02-23T08:03:10.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:10.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247820 2026-02-23T08:03:10.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247820 2026-02-23T08:03:10.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133 4-98784247820' 2026-02-23T08:03:10.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:10.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964117004 2026-02-23T08:03:10.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964117004 2026-02-23T08:03:10.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133 4-98784247820 5-115964117004' 2026-02-23T08:03:10.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:10.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953484 2026-02-23T08:03:10.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953484 2026-02-23T08:03:10.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133 4-98784247820 5-115964117004 6-137438953484' 2026-02-23T08:03:10.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:10.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822667 2026-02-23T08:03:10.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822667 2026-02-23T08:03:10.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133 4-98784247820 5-115964117004 6-137438953484 7-154618822667' 2026-02-23T08:03:10.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:10.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691850 2026-02-23T08:03:10.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691850 2026-02-23T08:03:10.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133 4-98784247820 5-115964117004 6-137438953484 7-154618822667 8-171798691850' 2026-02-23T08:03:10.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:10.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:10.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612610 2026-02-23T08:03:10.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612610 2026-02-23T08:03:10.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-55834574861 3-292057776133 4-98784247820 5-115964117004 6-137438953484 7-154618822667 8-171798691850 9-313532612610' 2026-02-23T08:03:10.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:10.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T08:03:10.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:10.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:10.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T08:03:10.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:10.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T08:03:10.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T08:03:10.565 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836494 2026-02-23T08:03:10.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:10.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-23T08:03:10.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:11.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:11.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:11.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T08:03:11.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:11.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705678 2026-02-23T08:03:11.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:11.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:11.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705678 2026-02-23T08:03:11.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:11.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705678 2026-02-23T08:03:11.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705678' 2026-02-23T08:03:11.900 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705678 2026-02-23T08:03:11.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:12.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705678 -lt 38654705678 2026-02-23T08:03:12.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:12.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574861 2026-02-23T08:03:12.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:12.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:12.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574861 2026-02-23T08:03:12.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:12.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574861 2026-02-23T08:03:12.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574861' 2026-02-23T08:03:12.069 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574861 2026-02-23T08:03:12.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:12.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574861 -lt 55834574861 2026-02-23T08:03:12.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:12.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776133 2026-02-23T08:03:12.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:12.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:12.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776133 2026-02-23T08:03:12.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:12.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776133 2026-02-23T08:03:12.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776133' 2026-02-23T08:03:12.240 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 292057776133 2026-02-23T08:03:12.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:12.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776133 -lt 292057776133 2026-02-23T08:03:12.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:12.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247820 2026-02-23T08:03:12.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:12.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:12.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247820 2026-02-23T08:03:12.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:12.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247820 2026-02-23T08:03:12.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247820' 2026-02-23T08:03:12.415 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 98784247820 2026-02-23T08:03:12.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:12.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247820 -lt 98784247820 2026-02-23T08:03:12.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:12.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-115964117004 2026-02-23T08:03:12.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:12.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:12.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-115964117004 2026-02-23T08:03:12.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:12.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964117004 2026-02-23T08:03:12.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 115964117004' 2026-02-23T08:03:12.584 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 115964117004 2026-02-23T08:03:12.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:12.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964117004 -lt 115964117004 2026-02-23T08:03:12.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:12.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953484 2026-02-23T08:03:12.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:12.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:12.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953484 2026-02-23T08:03:12.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:12.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953484 2026-02-23T08:03:12.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953484' 2026-02-23T08:03:12.757 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 137438953484 2026-02-23T08:03:12.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:12.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953484 -lt 137438953484 2026-02-23T08:03:12.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:12.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822667 2026-02-23T08:03:12.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:12.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:12.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822667 2026-02-23T08:03:12.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:12.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822667 2026-02-23T08:03:12.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822667' 2026-02-23T08:03:12.925 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 154618822667 2026-02-23T08:03:12.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:13.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822667 -lt 154618822667 2026-02-23T08:03:13.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:13.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691850 2026-02-23T08:03:13.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:13.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:13.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691850 2026-02-23T08:03:13.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:13.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691850 2026-02-23T08:03:13.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691850' 2026-02-23T08:03:13.095 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 171798691850 2026-02-23T08:03:13.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:13.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691851 -lt 171798691850 2026-02-23T08:03:13.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:13.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-313532612610 2026-02-23T08:03:13.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:13.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:13.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-313532612610 2026-02-23T08:03:13.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:13.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612610 2026-02-23T08:03:13.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 313532612610' 2026-02-23T08:03:13.265 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 313532612610 2026-02-23T08:03:13.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:13.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612610 -lt 313532612610 2026-02-23T08:03:13.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:13.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:13.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:13.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:13.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:13.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:13.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:13.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:13.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:13.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:13.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:13.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:13.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:13.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:13.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:14.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:14.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:14.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:14.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:03:14.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 5 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=5 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:14.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-23T08:03:14.431 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:03:14.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:14.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:14.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:start osd.5 2026-02-23T08:03:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:03:14.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:03:14.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:03:14.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:14.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:14.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:14.524 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:14.522+0000 7fa2ba975780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:14.525 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:14.524+0000 7fa2ba975780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:14.526 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:14.525+0000 7fa2ba975780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:14.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:03:14.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:14.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:03:14.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:14.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:14.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:14.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:14.680 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:03:14.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:14.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:14.698 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:14.697+0000 7fa2ba975780 -1 Falling back to public interface 2026-02-23T08:03:14.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:15.095 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:15.093+0000 7fa2ba975780 -1 osd.5 75 log_to_monitors true 2026-02-23T08:03:15.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:15.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:15.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:15.845 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:03:15.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:15.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:16.010 INFO:tasks.workunit.client.0.trial129.stderr:osd.5 up in weight 1 up_from 78 up_thru 78 down_at 75 last_clean_interval [27,75) [v2:127.0.0.1:6842/1275833158,v1:127.0.0.1:6843/1275833158] [v2:127.0.0.1:6844/1275833158,v1:127.0.0.1:6845/1275833158] exists,up cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:16.011 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:03:16.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:16.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:16.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:16.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:16.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:16.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:16.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:16.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:16.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:03:16.254 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:03:16.255 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:03:16.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:16.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:16.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836497 2026-02-23T08:03:16.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836497 2026-02-23T08:03:16.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497' 2026-02-23T08:03:16.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:16.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-23T08:03:16.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-23T08:03:16.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680' 2026-02-23T08:03:16.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:16.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574863 2026-02-23T08:03:16.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574863 2026-02-23T08:03:16.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863' 2026-02-23T08:03:16.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:16.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776135 2026-02-23T08:03:16.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776135 2026-02-23T08:03:16.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135' 2026-02-23T08:03:16.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247822 2026-02-23T08:03:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247822 2026-02-23T08:03:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135 4-98784247822' 2026-02-23T08:03:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:16.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449090 2026-02-23T08:03:16.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449090 2026-02-23T08:03:16.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135 4-98784247822 5-335007449090' 2026-02-23T08:03:16.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:16.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953487 2026-02-23T08:03:16.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953487 2026-02-23T08:03:16.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135 4-98784247822 5-335007449090 6-137438953487' 2026-02-23T08:03:16.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:16.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822669 2026-02-23T08:03:16.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822669 2026-02-23T08:03:16.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135 4-98784247822 5-335007449090 6-137438953487 7-154618822669' 2026-02-23T08:03:16.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:16.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691853 2026-02-23T08:03:16.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691853 2026-02-23T08:03:16.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135 4-98784247822 5-335007449090 6-137438953487 7-154618822669 8-171798691853' 2026-02-23T08:03:16.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:16.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:16.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612612 2026-02-23T08:03:16.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612612 2026-02-23T08:03:16.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-55834574863 3-292057776135 4-98784247822 5-335007449090 6-137438953487 7-154618822669 8-171798691853 9-313532612612' 2026-02-23T08:03:16.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:16.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836497 2026-02-23T08:03:16.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:16.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:16.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836497 2026-02-23T08:03:16.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:16.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836497 2026-02-23T08:03:16.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836497' 2026-02-23T08:03:16.994 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836497 2026-02-23T08:03:16.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:17.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836497 2026-02-23T08:03:17.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:18.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:18.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:18.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836497 2026-02-23T08:03:18.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:18.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705680 2026-02-23T08:03:18.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:18.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:18.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-23T08:03:18.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:18.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705680 2026-02-23T08:03:18.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-23T08:03:18.328 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705680 2026-02-23T08:03:18.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:18.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-23T08:03:18.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:18.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574863 2026-02-23T08:03:18.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:18.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:18.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574863 2026-02-23T08:03:18.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:18.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574863 2026-02-23T08:03:18.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574863' 2026-02-23T08:03:18.498 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574863 2026-02-23T08:03:18.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:18.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574863 -lt 55834574863 2026-02-23T08:03:18.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:18.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776135 2026-02-23T08:03:18.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:18.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:18.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776135 2026-02-23T08:03:18.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:18.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776135 2026-02-23T08:03:18.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776135' 2026-02-23T08:03:18.666 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 292057776135 2026-02-23T08:03:18.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:18.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776136 -lt 292057776135 2026-02-23T08:03:18.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:18.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247822 2026-02-23T08:03:18.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:18.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:18.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247822 2026-02-23T08:03:18.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247822 2026-02-23T08:03:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247822' 2026-02-23T08:03:18.835 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 98784247822 2026-02-23T08:03:18.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:19.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247823 -lt 98784247822 2026-02-23T08:03:19.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:19.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-335007449090 2026-02-23T08:03:19.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:19.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:19.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-335007449090 2026-02-23T08:03:19.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:19.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449090 2026-02-23T08:03:19.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 335007449090' 2026-02-23T08:03:19.007 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 335007449090 2026-02-23T08:03:19.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:19.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449090 -lt 335007449090 2026-02-23T08:03:19.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:19.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953487 2026-02-23T08:03:19.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:19.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:19.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953487 2026-02-23T08:03:19.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:19.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953487 2026-02-23T08:03:19.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953487' 2026-02-23T08:03:19.174 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 137438953487 2026-02-23T08:03:19.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:19.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953487 -lt 137438953487 2026-02-23T08:03:19.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:19.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822669 2026-02-23T08:03:19.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:19.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:19.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822669 2026-02-23T08:03:19.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:19.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822669 2026-02-23T08:03:19.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822669' 2026-02-23T08:03:19.364 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 154618822669 2026-02-23T08:03:19.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:19.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822670 -lt 154618822669 2026-02-23T08:03:19.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:19.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691853 2026-02-23T08:03:19.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:19.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:19.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691853 2026-02-23T08:03:19.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:19.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691853 2026-02-23T08:03:19.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691853' 2026-02-23T08:03:19.533 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 171798691853 2026-02-23T08:03:19.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:19.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691853 -lt 171798691853 2026-02-23T08:03:19.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:19.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-313532612612 2026-02-23T08:03:19.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:19.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:19.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-313532612612 2026-02-23T08:03:19.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:19.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612612 2026-02-23T08:03:19.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 313532612612' 2026-02-23T08:03:19.704 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 313532612612 2026-02-23T08:03:19.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:19.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612613 -lt 313532612612 2026-02-23T08:03:19.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:19.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:19.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:20.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:20.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:20.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:20.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:20.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:20.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:20.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:20.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:20.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:20.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:20.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:20.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:20.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:20.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:20.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:20.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:03:20.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:03:20.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:03:20.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:03:20.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:03:20.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:20.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:20.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:03:03.076771+0000 2026-02-23T08:03:20.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:03:20.927 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:03:20.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:03:03.076771+0000 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:03:03.076771+0000 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:20.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:21.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:03.076771+0000 '>' 2026-02-23T08:03:03.076771+0000 2026-02-23T08:03:21.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:22.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:22.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:22.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:22.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:22.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:22.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:22.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:22.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:03.076771+0000 '>' 2026-02-23T08:03:03.076771+0000 2026-02-23T08:03:22.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:23.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:23.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:23.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:03.076771+0000 2026-02-23T08:03:23.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:03:23.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:23.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:23.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:23.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:23.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:23.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:23.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:23.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:23.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:23.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:23.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:03:23.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:23.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:23.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-23T08:03:23.794 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:03:23.794 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:03:23.794 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:03:23.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:03:23.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:23.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:23.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:23.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:03:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:03:23.842 INFO:tasks.workunit.client.0.trial129.stderr:start osd.9 2026-02-23T08:03:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:03:23.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:03:23.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:03:23.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:23.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:23.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:23.852 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:23.851+0000 7ff1c947a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:23.853 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:23.853+0000 7ff1c947a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:23.854 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:23.853+0000 7ff1c947a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:24.009 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:03:24.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:24.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:24.056 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:24.055+0000 7ff1c947a780 -1 Falling back to public interface 2026-02-23T08:03:24.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:24.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:03:24.396+0000 7ff1c947a780 -1 osd.9 80 log_to_monitors true 2026-02-23T08:03:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:25.180 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:03:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:25.346 INFO:tasks.workunit.client.0.trial129.stderr:osd.9 up in weight 1 up_from 84 up_thru 0 down_at 81 last_clean_interval [73,80) [v2:127.0.0.1:6874/3348911195,v1:127.0.0.1:6875/3348911195] [v2:127.0.0.1:6876/3348911195,v1:127.0.0.1:6877/3348911195] exists,up e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:03:25.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:25.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:25.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:25.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:25.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:25.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:25.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:25.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:25.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:25.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:25.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:25.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:25.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:03:25.593 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:03:25.594 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:03:25.594 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:03:25.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:25.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:25.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:25.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-23T08:03:25.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-23T08:03:25.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499' 2026-02-23T08:03:25.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:25.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:25.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705683 2026-02-23T08:03:25.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705683 2026-02-23T08:03:25.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683' 2026-02-23T08:03:25.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:25.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:25.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574866 2026-02-23T08:03:25.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574866 2026-02-23T08:03:25.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866' 2026-02-23T08:03:25.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:25.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:25.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776138 2026-02-23T08:03:25.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776138 2026-02-23T08:03:25.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138' 2026-02-23T08:03:25.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:25.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:25.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247825 2026-02-23T08:03:25.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247825 2026-02-23T08:03:25.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138 4-98784247825' 2026-02-23T08:03:25.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:25.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:26.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449093 2026-02-23T08:03:26.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449093 2026-02-23T08:03:26.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138 4-98784247825 5-335007449093' 2026-02-23T08:03:26.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:26.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:26.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953489 2026-02-23T08:03:26.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953489 2026-02-23T08:03:26.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138 4-98784247825 5-335007449093 6-137438953489' 2026-02-23T08:03:26.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:26.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:26.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822672 2026-02-23T08:03:26.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822672 2026-02-23T08:03:26.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138 4-98784247825 5-335007449093 6-137438953489 7-154618822672' 2026-02-23T08:03:26.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:26.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691856 2026-02-23T08:03:26.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691856 2026-02-23T08:03:26.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138 4-98784247825 5-335007449093 6-137438953489 7-154618822672 8-171798691856' 2026-02-23T08:03:26.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:26.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:26.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-23T08:03:26.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-23T08:03:26.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-38654705683 2-55834574866 3-292057776138 4-98784247825 5-335007449093 6-137438953489 7-154618822672 8-171798691856 9-360777252866' 2026-02-23T08:03:26.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:26.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836499 2026-02-23T08:03:26.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:26.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:26.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-23T08:03:26.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:26.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836499 2026-02-23T08:03:26.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-23T08:03:26.338 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836499 2026-02-23T08:03:26.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836499 2026-02-23T08:03:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:27.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:27.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:27.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836499 2026-02-23T08:03:27.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:27.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705683 2026-02-23T08:03:27.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:27.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:27.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705683 2026-02-23T08:03:27.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:27.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705683 2026-02-23T08:03:27.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705683' 2026-02-23T08:03:27.677 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705683 2026-02-23T08:03:27.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:27.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705683 -lt 38654705683 2026-02-23T08:03:27.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:27.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574866 2026-02-23T08:03:27.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:27.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:27.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574866 2026-02-23T08:03:27.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:27.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574866 2026-02-23T08:03:27.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574866' 2026-02-23T08:03:27.846 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 55834574866 2026-02-23T08:03:27.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:28.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574866 -lt 55834574866 2026-02-23T08:03:28.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:28.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776138 2026-02-23T08:03:28.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:28.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:28.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776138 2026-02-23T08:03:28.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:28.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776138 2026-02-23T08:03:28.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776138' 2026-02-23T08:03:28.019 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 292057776138 2026-02-23T08:03:28.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:28.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776139 -lt 292057776138 2026-02-23T08:03:28.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:28.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247825 2026-02-23T08:03:28.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:28.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:28.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247825 2026-02-23T08:03:28.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:28.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247825 2026-02-23T08:03:28.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247825' 2026-02-23T08:03:28.193 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 98784247825 2026-02-23T08:03:28.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:28.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247826 -lt 98784247825 2026-02-23T08:03:28.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-335007449093 2026-02-23T08:03:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:28.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:28.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-335007449093 2026-02-23T08:03:28.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:28.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=335007449093 2026-02-23T08:03:28.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 335007449093' 2026-02-23T08:03:28.367 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 335007449093 2026-02-23T08:03:28.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:28.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 335007449093 -lt 335007449093 2026-02-23T08:03:28.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:28.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953489 2026-02-23T08:03:28.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:28.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:28.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953489 2026-02-23T08:03:28.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:28.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953489 2026-02-23T08:03:28.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953489' 2026-02-23T08:03:28.535 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 137438953489 2026-02-23T08:03:28.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953490 -lt 137438953489 2026-02-23T08:03:28.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:28.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822672 2026-02-23T08:03:28.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:28.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:28.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822672 2026-02-23T08:03:28.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:28.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822672 2026-02-23T08:03:28.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822672' 2026-02-23T08:03:28.707 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 154618822672 2026-02-23T08:03:28.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:28.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822672 -lt 154618822672 2026-02-23T08:03:28.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:28.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691856 2026-02-23T08:03:28.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:28.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:28.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691856 2026-02-23T08:03:28.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691856 2026-02-23T08:03:28.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691856' 2026-02-23T08:03:28.883 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 171798691856 2026-02-23T08:03:28.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:29.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691856 -lt 171798691856 2026-02-23T08:03:29.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:29.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-360777252866 2026-02-23T08:03:29.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:29.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:29.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-360777252866 2026-02-23T08:03:29.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:29.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-23T08:03:29.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 360777252866' 2026-02-23T08:03:29.052 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 360777252866 2026-02-23T08:03:29.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:29.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252866 2026-02-23T08:03:29.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:29.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:29.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:29.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:29.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:29.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:29.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:29.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:29.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:29.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:29.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:29.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:03:29.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:03:29.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 5 9 2026-02-23T08:03:29.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:03:29.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:03:29.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=5 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=9 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 570901"' 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 570901' 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 570903"' 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 570903' 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 570901 570903' 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 570901 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/570904: /' 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:03:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/570906: /' 2026-02-23T08:03:30.305 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.305 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:30.305 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:03:30.305 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:30.306 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-23T08:03:30.307 INFO:tasks.workunit.client.0.trial129.stderr:570904: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:30.308 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:30.309 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:30.309 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:30.309 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:03:30.309 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:03:30.309 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:30.310 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:03:30.311 INFO:tasks.workunit.client.0.trial129.stderr:570904: start osd.5 2026-02-23T08:03:30.322 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.322 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:30.322 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:03:30.322 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:30.323 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:30.324 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:30.324 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:30.324 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:03:30.324 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.324 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:30.324 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING remove 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:30.325 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:30.326 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:03:30.326 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:30.326 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:30.326 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:30.326 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:30.327 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:30.328 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:03:30.329 INFO:tasks.workunit.client.0.trial129.stderr:570906: start osd.9 2026-02-23T08:03:31.820 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:03:31.820 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:03:31.821 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:03:31.821 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:31.821 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:31.821 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:31.821 INFO:tasks.workunit.client.0.trial129.stderr:570904: 2026-02-23T08:03:30.319+0000 7f1af8d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:31.822 INFO:tasks.workunit.client.0.trial129.stderr:570904: 2026-02-23T08:03:30.320+0000 7f1af8d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:31.822 INFO:tasks.workunit.client.0.trial129.stderr:570904: 2026-02-23T08:03:30.321+0000 7f1af8d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:31.822 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:03:31.822 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:31.822 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:03:31.822 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:31.823 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:31.823 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:31.823 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:31.823 INFO:tasks.workunit.client.0.trial129.stderr:570904: 0 2026-02-23T08:03:31.823 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:31.823 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:31.824 INFO:tasks.workunit.client.0.trial129.stderr:570904: 2026-02-23T08:03:30.518+0000 7f1af8d4b780 -1 Falling back to public interface 2026-02-23T08:03:31.824 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:31.824 INFO:tasks.workunit.client.0.trial129.stderr:570904: 2026-02-23T08:03:30.888+0000 7f1af8d4b780 -1 osd.5 85 log_to_monitors true 2026-02-23T08:03:31.824 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:31.824 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:31.824 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:31.825 INFO:tasks.workunit.client.0.trial129.stderr:570904: 1 2026-02-23T08:03:31.825 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:31.825 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:31.825 INFO:tasks.workunit.client.0.trial129.stderr:570904: osd.5 up in weight 1 up_from 89 up_thru 89 down_at 86 last_clean_interval [78,85) [v2:127.0.0.1:6842/318592702,v1:127.0.0.1:6843/318592702] [v2:127.0.0.1:6844/318592702,v1:127.0.0.1:6845/318592702] exists,up cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:03:31.825 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:31.825 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:31.826 INFO:tasks.workunit.client.0.trial129.stderr:570904: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:31.831 INFO:tasks.workunit.client.0.trial129.stderr:570904: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: gps 2026-02-23T08:03:31.831 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:03:31.831 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:03:31.831 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:31.831 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:31.832 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:31.832 INFO:tasks.workunit.client.0.trial129.stderr:570906: 2026-02-23T08:03:30.336+0000 7f4627214780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:31.832 INFO:tasks.workunit.client.0.trial129.stderr:570906: 2026-02-23T08:03:30.337+0000 7f4627214780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:31.832 INFO:tasks.workunit.client.0.trial129.stderr:570906: 2026-02-23T08:03:30.338+0000 7f4627214780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:31.832 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:03:31.833 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:31.833 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:03:31.833 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:31.833 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:31.833 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:31.833 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: 0 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: 2026-02-23T08:03:30.555+0000 7f4627214780 -1 Falling back to public interface 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: 2026-02-23T08:03:30.946+0000 7f4627214780 -1 osd.9 85 log_to_monitors true 2026-02-23T08:03:31.834 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:31.835 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:31.835 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:31.835 INFO:tasks.workunit.client.0.trial129.stderr:570906: 1 2026-02-23T08:03:31.835 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:31.835 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:31.835 INFO:tasks.workunit.client.0.trial129.stderr:570906: osd.9 up in weight 1 up_from 91 up_thru 0 down_at 86 last_clean_interval [84,85) [v2:127.0.0.1:6874/3775056724,v1:127.0.0.1:6875/3775056724] [v2:127.0.0.1:6876/3775056724,v1:127.0.0.1:6877/3775056724] exists,up e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:03:31.836 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:31.836 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:31.836 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:31.836 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:31.836 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:31.836 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:31.837 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:31.837 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:31.837 INFO:tasks.workunit.client.0.trial129.stderr:570906: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570906: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593et_timeout_delays: echo true 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:32.370 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 1 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 2 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 3 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 4 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 5 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 6 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 7 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 8 2026-02-23T08:03:32.371 INFO:tasks.workunit.client.0.trial129.stderr:570904: 9' 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836502 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836502 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502' 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705685 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705685 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685' 2026-02-23T08:03:32.372 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574869 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574869 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869' 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776141 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776141 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141' 2026-02-23T08:03:32.373 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/cl: get_timeout_delays: echo true 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:32.374 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 1 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 2 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 3 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 4 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 5 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 6 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 7 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 8 2026-02-23T08:03:32.375 INFO:tasks.workunit.client.0.trial129.stderr:570906: 9' 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705686 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705686 2026-02-23T08:03:32.376 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686' 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574870 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574870 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870' 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776142 2026-02-23T08:03:32.377 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776142 2026-02-23T08:03:32.378 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142' 2026-02-23T08:03:32.378 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.825 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247829 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247829 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142 4-98784247829' 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089347 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089347 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142 4-98784247829 5-382252089347' 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.826 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953493 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953493 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142 4-98784247829 5-382252089347 6-137438953493' 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822675 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822675 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142 4-98784247829 5-382252089347 6-137438953493 7-154618822675' 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:32.827 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691858 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691858 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142 4-98784247829 5-382252089347 6-137438953493 7-154618822675 8-171798691858' 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023938 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023938 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705686 2-55834574870 3-292057776142 4-98784247829 5-382252089347 6-137438953493 7-154618822675 8-171798691858 9-390842023938' 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/uone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247828 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247828 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141 4-98784247828' 2026-02-23T08:03:32.828 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089346 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089346 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141 4-98784247828 5-382252089346' 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953492 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953492 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141 4-98784247828 5-382252089346 6-137438953492' 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:32.829 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822674 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822674 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141 4-98784247828 5-382252089346 6-137438953492 7-154618822674' 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691859 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691859 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141 4-98784247828 5-382252089346 6-137438953492 7-154618822674 8-171798691859' 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=390842023939 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 390842023939 2026-02-23T08:03:32.830 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705685 2-55834574869 3-292057776141 4-98784247828 5-382252089346 6-137438953492 7-154618822674 8-171798691859 9-390842023939' 2026-02-23T08:03:34.504 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubunbuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:34.504 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-23T08:03:34.504 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.0 seq 21474836503 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836503 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:34.505 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836503 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705686 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705686 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705686 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705686' 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.1 seq 38654705686 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705686 -lt 38654705686 2026-02-23T08:03:34.506 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574870 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574870 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574870 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574870' 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.2 seq 55834574870 2026-02-23T08:03:34.507 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:34.515 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: testtu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:34.515 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836502 2026-02-23T08:03:34.515 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836502 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836502 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.0 seq 21474836502 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836502 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:34.516 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836502 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705685 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705685 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705685 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705685' 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.1 seq 38654705685 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705686 -lt 38654705685 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:34.517 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574869 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574869 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574869 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574869' 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.2 seq 55834574869 2026-02-23T08:03:34.518 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:35.023 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55 55834574870 -lt 55834574870 2026-02-23T08:03:35.023 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.023 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776142 2026-02-23T08:03:35.023 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.023 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:35.023 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776142 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776142 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776142' 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.3 seq 292057776142 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776142 -lt 292057776142 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247829 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247829 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.024 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247829 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247829' 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.4 seq 98784247829 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247829 -lt 98784247829 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-382252089347 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-382252089347 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089347 2026-02-23T08:03:35.025 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 382252089347' 2026-02-23T08:03:35.026 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.5 seq 382252089347 2026-02-23T08:03:35.026 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:35.026 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089347 -lt 382252089347 2026-02-23T08:03:35.026 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.026 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953493 2026-02-23T08:03:35.026 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.038 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/834574870 -lt 55834574869 2026-02-23T08:03:35.038 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.038 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776141 2026-02-23T08:03:35.038 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.038 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776141 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776141 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776141' 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.3 seq 292057776141 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776142 -lt 292057776141 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247828 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:35.039 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247828 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247828 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247828' 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.4 seq 98784247828 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247829 -lt 98784247828 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-382252089346 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-382252089346 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.040 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089346 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 382252089346' 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.5 seq 382252089346 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089347 -lt 382252089346 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953492 2026-02-23T08:03:35.041 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.542 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:35.542 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953493 2026-02-23T08:03:35.542 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.542 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953493 2026-02-23T08:03:35.542 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953493' 2026-02-23T08:03:35.542 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.6 seq 137438953493 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953493 -lt 137438953493 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822675 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822675 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822675 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822675' 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.7 seq 154618822675 2026-02-23T08:03:35.543 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822676 -lt 154618822675 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691858 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691858 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691858 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691858' 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.8 seq 171798691858 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:35.544 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691859 -lt 171798691858 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-390842023938 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-390842023938 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.545 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=390842023938 2026-02-23T08:03:35.557 INFO:tasks.workunit.client.0.trial129.stderr:570906standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:35.557 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953492 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953492 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953492' 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.6 seq 137438953492 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953493 -lt 137438953492 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822674 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822674 2026-02-23T08:03:35.558 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822674 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822674' 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.7 seq 154618822674 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822676 -lt 154618822674 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691859 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691859 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691859 2026-02-23T08:03:35.559 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691859' 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.8 seq 171798691859 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691859 -lt 171798691859 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-390842023939 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-390842023939 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:35.560 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=390842023939 2026-02-23T08:03:36.298 INFO:tasks.workunit.client.0.trial129.stderr:570904: /: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 390842023938' 2026-02-23T08:03:36.298 INFO:tasks.workunit.client.0.trial129.stderr:570906: waiting osd.9 seq 390842023938 2026-02-23T08:03:36.298 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:36.298 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 390842023939 -lt 390842023938 2026-02-23T08:03:36.298 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:36.299 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:36.300 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:36.300 INFO:tasks.workunit.client.0.trial129.stderr:570906: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:36.300 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:36.300 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:36.300 INFO:tasks.workunit.client.0.trial129.stderr:570906: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:36.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 390842023939' 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:570904: waiting osd.9 seq 390842023939 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 390842023939 -lt 390842023939 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:36.316 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:36.317 INFO:tasks.workunit.client.0.trial129.stderr:570904: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:36.318 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:36.318 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:36.318 INFO:tasks.workunit.client.0.trial129.stderr:570904: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:36.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:03:36.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:03:36.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 570903 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:03:36.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:03:36.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:03:36.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:03:36.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:03:36.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:03:36.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:36.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:36.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:36.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:36.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:36.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:03:36.806 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:03:36.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:36.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:03:36.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:36.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:03:36.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:03:36.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:36.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:36.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:37.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:37.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:37.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:37.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:37.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:37.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:37.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:38.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:38.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:39.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:39.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:39.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:39.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:39.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:39.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:39.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:39.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:39.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:40.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:40.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:40.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:40.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:40.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:40.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:40.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:40.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:40.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:41.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:41.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:41.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:41.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:41.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:41.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:41.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:41.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:41.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:42.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:42.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:42.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:42.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:42.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:42.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:42.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:42.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:21.234542+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:42.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:43.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:43.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:43.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:43.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:43.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:43.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:43.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:37.371206+0000 '>' 2026-02-23T08:03:21.234542+0000 2026-02-23T08:03:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:03:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:03:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 574402"' 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 574402' 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 574403"' 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 574403' 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 574402 574403' 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 574402 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/574405: /' 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/574407: /' 2026-02-23T08:03:44.372 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.372 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:44.372 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: _ 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: hinfo_key 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: snapset 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:44.373 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:44.374 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:44.374 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:44.375 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:03:44.376 INFO:tasks.workunit.client.0.trial129.stderr:574405: start osd.5 2026-02-23T08:03:44.382 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.382 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:44.382 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:03:44.382 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: _ 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: hinfo_key 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: snapset 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:44.383 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:44.385 INFO:tasks.workunit.client.0.trial129.stderr:574407: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:03:44.386 INFO:tasks.workunit.client.0.trial129.stderr:574407: start osd.9 2026-02-23T08:03:45.887 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:03:45.887 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: 2026-02-23T08:03:44.387+0000 7f5f22807780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: 2026-02-23T08:03:44.389+0000 7f5f22807780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: 2026-02-23T08:03:44.389+0000 7f5f22807780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:03:45.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:45.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:03:45.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:45.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:45.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:45.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:45.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: 0 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: 2026-02-23T08:03:44.598+0000 7f5f22807780 -1 Falling back to public interface 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: 2026-02-23T08:03:45.022+0000 7f5f22807780 -1 osd.5 92 log_to_monitors true 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:45.890 INFO:tasks.workunit.client.0.trial129.stderr:574405: 1 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: osd.5 up in weight 1 up_from 96 up_thru 96 down_at 93 last_clean_interval [89,92) [v2:127.0.0.1:6842/90537635,v1:127.0.0.1:6843/90537635] [v2:127.0.0.1:6844/90537635,v1:127.0.0.1:6845/90537635] exists,up cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:45.891 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:45.892 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:45.892 INFO:tasks.workunit.client.0.trial129.stderr:574405: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:45.892 INFO:tasks.workunit.client.0.trial129.stderr:574405: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1recovery_ops 2026-02-23T08:03:45.892 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:03:45.892 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: 2026-02-23T08:03:44.396+0000 7f154c551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: 2026-02-23T08:03:44.397+0000 7f154c551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: 2026-02-23T08:03:44.398+0000 7f154c551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:45.893 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: 0 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: 2026-02-23T08:03:44.616+0000 7f154c551780 -1 Falling back to public interface 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: 2026-02-23T08:03:45.080+0000 7f154c551780 -1 osd.9 92 log_to_monitors true 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: 1 2026-02-23T08:03:45.894 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: osd.9 up in weight 1 up_from 98 up_thru 0 down_at 93 last_clean_interval [91,92) [v2:127.0.0.1:6874/761531012,v1:127.0.0.1:6875/761531012] [v2:127.0.0.1:6876/761531012,v1:127.0.0.1:6877/761531012] exists,up e1613ab8-76cd-4633-9f8c-9bce80f66ca2 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:45.895 INFO:tasks.workunit.client.0.trial129.stderr:574407: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:46.438 INFO:tasks.workunit.client.0.trial129.stderr:574407: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:03:46.438 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:46.438 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 1 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 2 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 3 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 4 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 5 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 6 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 7 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 8 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: 9' 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705690 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705690 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690' 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.439 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574873 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574873 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873' 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776145 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776145 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145' 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/ce593: get_timeout_delays: echo true 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: 1 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: 2 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: 3 2026-02-23T08:03:46.440 INFO:tasks.workunit.client.0.trial129.stderr:574405: 4 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: 5 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: 6 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: 7 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: 8 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: 9' 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836508 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836508 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508' 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691' 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574874 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574874 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874' 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=292057776146 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 292057776146 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146' 2026-02-23T08:03:46.441 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:46.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247832 2026-02-23T08:03:46.888 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247832 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146 4-98784247832' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860419 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860419 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146 4-98784247832 5-412316860419' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953497 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953497 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146 4-98784247832 5-412316860419 6-137438953497' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822679 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822679 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146 4-98784247832 5-412316860419 6-137438953497 7-154618822679' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691863 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691863 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146 4-98784247832 5-412316860419 6-137438953497 7-154618822679 8-171798691863' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795010 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795010 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-55834574874 3-292057776146 4-98784247832 5-412316860419 6-137438953497 7-154618822679 8-171798691863 9-420906795010' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574405: /homphtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247833 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247833 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145 4-98784247833' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860418 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860418 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145 4-98784247833 5-412316860418' 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953498 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953498 2026-02-23T08:03:46.889 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145 4-98784247833 5-412316860418 6-137438953498' 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822680 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822680 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145 4-98784247833 5-412316860418 6-137438953498 7-154618822680' 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691864 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691864 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145 4-98784247833 5-412316860418 6-137438953498 7-154618822680 8-171798691864' 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795011 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795011 2026-02-23T08:03:46.890 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-55834574873 3-292057776145 4-98784247833 5-412316860418 6-137438953498 7-154618822680 8-171798691864 9-420906795011' 2026-02-23T08:03:48.572 INFO:tasks.workunit.client.0.trial129.stderr:574407: /e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836508 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836508 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836508 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836508' 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.0 seq 21474836508 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836508 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836508 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705691 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705691 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.1 seq 38654705691 2026-02-23T08:03:48.573 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705691 -lt 38654705691 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574874 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574874 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574874 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574874' 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.2 seq 55834574874 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: thome/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.0 seq 21474836507 2026-02-23T08:03:48.574 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836507 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836507 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705690 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705690 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705690 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705690' 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.1 seq 38654705690 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705691 -lt 38654705690 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574873 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574873 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574873 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574873' 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.2 seq 55834574873 2026-02-23T08:03:48.575 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats:est 55834574874 -lt 55834574874 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776146 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776146 2026-02-23T08:03:49.085 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776146 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776146' 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.3 seq 292057776146 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776147 -lt 292057776146 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247832 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247832 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247832 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247832' 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.4 seq 98784247832 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247834 -lt 98784247832 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-412316860419 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-412316860419 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=412316860419 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 412316860419' 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.5 seq 412316860419 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:49.086 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 412316860419 -lt 412316860419 2026-02-23T08:03:49.087 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.087 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953497 2026-02-23T08:03:49.087 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client test 55834574874 -lt 55834574873 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-292057776145 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-292057776145 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=292057776145 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 292057776145' 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.3 seq 292057776145 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:49.090 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 292057776147 -lt 292057776145 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247833 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247833 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247833 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247833' 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.4 seq 98784247833 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247834 -lt 98784247833 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-412316860418 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-412316860418 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=412316860418 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 412316860418' 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.5 seq 412316860418 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 412316860419 -lt 412316860418 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953498 2026-02-23T08:03:49.091 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.600 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.cli.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:49.600 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953497 2026-02-23T08:03:49.600 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953497 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953497' 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.6 seq 137438953497 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953498 -lt 137438953497 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822679 2026-02-23T08:03:49.601 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822679 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822679 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822679' 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.7 seq 154618822679 2026-02-23T08:03:49.602 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822681 -lt 154618822679 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691863 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691863 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691863 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691863' 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.8 seq 171798691863 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:49.603 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691864 -lt 171798691863 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-420906795010 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-420906795010 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.604 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795010 2026-02-23T08:03:49.606 INFO:tasks.workunit.client.0.trial129.stderr:574ent.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:49.606 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953498 2026-02-23T08:03:49.606 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.606 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953498 2026-02-23T08:03:49.606 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953498' 2026-02-23T08:03:49.606 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.6 seq 137438953498 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953498 -lt 137438953498 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822680 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822680 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822680 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822680' 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.7 seq 154618822680 2026-02-23T08:03:49.607 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822681 -lt 154618822680 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691864 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691864 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691864 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691864' 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.8 seq 171798691864 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691864 -lt 171798691864 2026-02-23T08:03:49.608 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:49.609 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-420906795011 2026-02-23T08:03:49.609 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:49.609 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:49.609 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-420906795011 2026-02-23T08:03:49.609 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:49.609 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795011 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 420906795011' 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: waiting osd.9 seq 420906795011 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795011 -lt 420906795011 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:50.354 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:574407: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:50.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:03:50.357 INFO:tasks.workunit.client.0.trial129.stderr:405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 420906795010' 2026-02-23T08:03:50.357 INFO:tasks.workunit.client.0.trial129.stderr:574405: waiting osd.9 seq 420906795010 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795011 -lt 420906795010 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:50.358 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:50.359 INFO:tasks.workunit.client.0.trial129.stderr:574405: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:03:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:03:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 574403 2026-02-23T08:03:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:03:50.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:03:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:03:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:03:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:03:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:03:50.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 5 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=5 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 577313"' 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 577313' 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 577315"' 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 577315' 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:03:50.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 577313 577315' 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 577313 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/577316: /' 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:50.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/577318: /' 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:50.842 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:50.843 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:03:50.844 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:50.844 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:03:50.844 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:50.844 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:50.844 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:50.845 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:03:50.846 INFO:tasks.workunit.client.0.trial129.stderr:577318: start osd.5 2026-02-23T08:03:50.869 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.869 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.870 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:03:50.871 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:03:50.872 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:03:50.873 INFO:tasks.workunit.client.0.trial129.stderr:577316: start osd.3 2026-02-23T08:03:52.361 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:03:52.361 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:03:52.361 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:03:52.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:52.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:52.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:52.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: 2026-02-23T08:03:50.856+0000 7f1dcfd4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:52.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: 2026-02-23T08:03:50.857+0000 7f1dcfd4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:52.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: 2026-02-23T08:03:50.858+0000 7f1dcfd4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:52.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: 0 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: 2026-02-23T08:03:51.036+0000 7f1dcfd4d780 -1 Falling back to public interface 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: 2026-02-23T08:03:51.489+0000 7f1dcfd4d780 -1 osd.5 99 log_to_monitors true 2026-02-23T08:03:52.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:52.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:52.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:52.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: 1 2026-02-23T08:03:52.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:52.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: osd.5 up in weight 1 up_from 104 up_thru 104 down_at 100 last_clean_interval [96,99) [v2:127.0.0.1:6826/123901000,v1:127.0.0.1:6827/123901000] [v2:127.0.0.1:6828/123901000,v1:127.0.0.1:6829/123901000] exists,up cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:52.366 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:52.367 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:52.367 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:52.367 INFO:tasks.workunit.client.0.trial129.stderr:577318: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:52.379 INFO:tasks.workunit.client.0.trial129.stderr:577318: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-23T08:03:52.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:03:52.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:03:52.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:03:52.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:03:52.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:03:52.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: 2026-02-23T08:03:50.883+0000 7f96b887c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:52.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: 2026-02-23T08:03:50.885+0000 7f96b887c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:52.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: 2026-02-23T08:03:50.886+0000 7f96b887c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:03:52.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:03:52.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:03:52.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:03:52.382 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:03:52.382 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:03:52.382 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:52.382 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:03:52.382 INFO:tasks.workunit.client.0.trial129.stderr:577316: 0 2026-02-23T08:03:52.382 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:52.383 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:03:52.383 INFO:tasks.workunit.client.0.trial129.stderr:577316: 2026-02-23T08:03:51.057+0000 7f96b887c780 -1 Falling back to public interface 2026-02-23T08:03:52.383 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:03:52.383 INFO:tasks.workunit.client.0.trial129.stderr:577316: 2026-02-23T08:03:51.503+0000 7f96b887c780 -1 osd.3 99 log_to_monitors true 2026-02-23T08:03:52.383 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:03:52.383 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:03:52.384 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:03:52.384 INFO:tasks.workunit.client.0.trial129.stderr:577316: 1 2026-02-23T08:03:52.384 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:03:52.384 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:03:52.384 INFO:tasks.workunit.client.0.trial129.stderr:577316: osd.3 up in weight 1 up_from 106 up_thru 106 down_at 100 last_clean_interval [68,99) [v2:127.0.0.1:6842/4061446247,v1:127.0.0.1:6843/4061446247] [v2:127.0.0.1:6844/4061446247,v1:127.0.0.1:6845/4061446247] exists,up 17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:03:52.385 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:03:52.386 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:03:52.386 INFO:tasks.workunit.client.0.trial129.stderr:577316: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:03:52.907 INFO:tasks.workunit.client.0.trial129.stderr:577316: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:: get_timeout_delays: echo true 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:52.908 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 1 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 2 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 3 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 4 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 5 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 6 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 7 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 8 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: 9' 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:52.909 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705693 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705693 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693' 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.910 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574877 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574877 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877' 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533378 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533378 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378' 2026-02-23T08:03:52.911 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.926 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest1593: get_timeout_delays: echo true 2026-02-23T08:03:52.926 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:03:52.926 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:03:52.926 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:03:52.926 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: 1 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: 2 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: 3 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: 4 2026-02-23T08:03:52.927 INFO:tasks.workunit.client.0.trial129.stderr:577316: 5 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: 6 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: 7 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: 8 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: 9' 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.928 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705694 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705694 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694' 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574878 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574878 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878' 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=455266533379 2026-02-23T08:03:52.929 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 455266533379 2026-02-23T08:03:52.930 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379' 2026-02-23T08:03:52.930 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.362 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/ceph/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:53.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247836 2026-02-23T08:03:53.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247836 2026-02-23T08:03:53.362 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378 4-98784247836' 2026-02-23T08:03:53.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:53.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598786 2026-02-23T08:03:53.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598786 2026-02-23T08:03:53.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378 4-98784247836 5-446676598786' 2026-02-23T08:03:53.363 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953500 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953500 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378 4-98784247836 5-446676598786 6-137438953500' 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822682 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822682 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378 4-98784247836 5-446676598786 6-137438953500 7-154618822682' 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.364 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691866 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691866 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378 4-98784247836 5-446676598786 6-137438953500 7-154618822682 8-171798691866' 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795013 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795013 2026-02-23T08:03:53.365 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-55834574877 3-455266533378 4-98784247836 5-446676598786 6-137438953500 7-154618822682 8-171798691866 9-420906795013' 2026-02-23T08:03:53.378 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/utest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247837 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247837 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379 4-98784247837' 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598787 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598787 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379 4-98784247837 5-446676598787' 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:03:53.379 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953501 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953501 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379 4-98784247837 5-446676598787 6-137438953501' 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822683 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822683 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379 4-98784247837 5-446676598787 6-137438953501 7-154618822683' 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691867 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691867 2026-02-23T08:03:53.380 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379 4-98784247837 5-446676598787 6-137438953501 7-154618822683 8-171798691867' 2026-02-23T08:03:53.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:03:53.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:03:53.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795014 2026-02-23T08:03:53.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795014 2026-02-23T08:03:53.381 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-55834574878 3-455266533379 4-98784247837 5-446676598787 6-137438953501 7-154618822683 8-171798691867 9-420906795014' 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577316: /hobuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.0 seq 21474836510 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836510 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705693 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705693 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705693 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705693' 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.1 seq 38654705693 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:53.883 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705694 -lt 38654705693 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574877 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574877 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574877 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574877' 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.2 seq 55834574877 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574878 -lt 55834574877 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-455266533378 2026-02-23T08:03:53.884 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3me/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.0 seq 21474836511 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836511 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705694 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705694 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705694 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705694' 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.1 seq 38654705694 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705694 -lt 38654705694 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574878 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574878 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:53.895 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574878 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574878' 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.2 seq 55834574878 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574878 -lt 55834574878 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-455266533379 2026-02-23T08:03:53.896 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.397 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: o 2026-02-23T08:03:54.397 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-455266533378 2026-02-23T08:03:54.397 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.397 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533378 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 455266533378' 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.3 seq 455266533378 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533379 -lt 455266533378 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247836 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247836 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.398 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247836 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247836' 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.4 seq 98784247836 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247837 -lt 98784247836 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-446676598786 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-446676598786 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598786 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 446676598786' 2026-02-23T08:03:54.399 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.5 seq 446676598786 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598786 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953500 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953500 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.400 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953500 2026-02-23T08:03:54.414 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helperssd=3 2026-02-23T08:03:54.414 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-455266533379 2026-02-23T08:03:54.414 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=455266533379 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 455266533379' 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.3 seq 455266533379 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 455266533379 -lt 455266533379 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247837 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247837 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.415 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247837 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247837' 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.4 seq 98784247837 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247837 -lt 98784247837 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-446676598787 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-446676598787 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598787 2026-02-23T08:03:54.416 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 446676598787' 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.5 seq 446676598787 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598787 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953501 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953501 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:54.417 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953501 2026-02-23T08:03:56.084 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-hel.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953500' 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.6 seq 137438953500 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953499 -lt 137438953500 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953501 -lt 137438953500 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822682 2026-02-23T08:03:56.085 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822682 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822682 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822682' 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.7 seq 154618822682 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822684 -lt 154618822682 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691866 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:56.086 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691866 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691866 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691866' 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.8 seq 171798691866 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691867 -lt 171798691866 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-420906795013 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-420906795013 2026-02-23T08:03:56.087 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:56.088 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795013 2026-02-23T08:03:56.093 INFO:tasks.workunit.client.0.trial129.stderr:5773pers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953501' 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.6 seq 137438953501 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953499 -lt 137438953501 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953501 -lt 137438953501 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822683 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:56.094 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822683 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822683 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822683' 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.7 seq 154618822683 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822684 -lt 154618822683 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691867 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691867 2026-02-23T08:03:56.095 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691867 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691867' 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.8 seq 171798691867 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691867 -lt 171798691867 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-420906795014 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-420906795014 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:03:56.096 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795014 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:18: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 420906795013' 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: waiting osd.9 seq 420906795013 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795014 -lt 420906795013 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:56.837 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:56.838 INFO:tasks.workunit.client.0.trial129.stderr:577318: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:56.839 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:56.839 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:56.839 INFO:tasks.workunit.client.0.trial129.stderr:577318: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:56.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 420906795014' 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: waiting osd.9 seq 420906795014 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795014 -lt 420906795014 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:03:56.846 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:03:56.847 INFO:tasks.workunit.client.0.trial129.stderr:577316: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:03:56.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:03:56.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:03:56.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 577315 2026-02-23T08:03:56.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:03:56.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:03:56.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:03:57.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:03:57.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:03:57.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:03:57.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:03:57.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:57.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:57.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:57.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:57.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:03:37.371206+0000 2026-02-23T08:03:57.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:03:57.330 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:03:37.371206+0000 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:03:37.371206+0000 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:57.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:57.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:37.371206+0000 '>' 2026-02-23T08:03:37.371206+0000 2026-02-23T08:03:57.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:58.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:58.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:58.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:58.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:58.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:58.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:58.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:58.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:37.371206+0000 '>' 2026-02-23T08:03:37.371206+0000 2026-02-23T08:03:58.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:03:59.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:03:59.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:03:59.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:03:59.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:03:59.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:03:59.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:03:59.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:03:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:37.371206+0000 '>' 2026-02-23T08:03:37.371206+0000 2026-02-23T08:03:59.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:00.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:00.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:00.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:00.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:00.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:00.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:00.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:01.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:37.371206+0000 '>' 2026-02-23T08:03:37.371206+0000 2026-02-23T08:04:01.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:02.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:02.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:02.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:02.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:02.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:02.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:02.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:02.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:37.371206+0000 '>' 2026-02-23T08:03:37.371206+0000 2026-02-23T08:04:02.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:03.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:03.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:03.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:03.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:03.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:03.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:03.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:03:57.525809+0000 '>' 2026-02-23T08:03:37.371206+0000 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 580789"' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 580789' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 580790"' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 580790' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 580789 580790' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 580789 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/580792: /' 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:04:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/580794: /' 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:04:03.765 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: _ 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: hinfo_key 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: snapset 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:03.766 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:03.767 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:03.767 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:04:03.768 INFO:tasks.workunit.client.0.trial129.stderr:580794: start osd.5 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:04:03.771 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:04:03.772 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: _ 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: hinfo_key 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: snapset 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:04:03.773 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:03.774 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:03.775 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:04:03.776 INFO:tasks.workunit.client.0.trial129.stderr:580792: start osd.3 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$nrecovery_ops 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:04:05.273 INFO:tasks.workunit.client.0.trial129.stderr:580794: 2026-02-23T08:04:03.779+0000 7fa263f54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: 2026-02-23T08:04:03.780+0000 7fa263f54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: 2026-02-23T08:04:03.781+0000 7fa263f54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: 0 2026-02-23T08:04:05.274 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: 2026-02-23T08:04:04.001+0000 7fa263f54780 -1 Falling back to public interface 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: 2026-02-23T08:04:04.411+0000 7fa263f54780 -1 osd.5 107 log_to_monitors true 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: 1 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: osd.5 up in weight 1 up_from 111 up_thru 111 down_at 108 last_clean_interval [104,107) [v2:127.0.0.1:6842/1688546424,v1:127.0.0.1:6843/1688546424] [v2:127.0.0.1:6844/1688546424,v1:127.0.0.1:6845/1688546424] exists,up cd80a4b5-842a-4a22-9437-6e416a8a4b40 2026-02-23T08:04:05.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:04:05.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580794: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/cepame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: 2026-02-23T08:04:03.784+0000 7f1f9c753780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: 2026-02-23T08:04:03.785+0000 7f1f9c753780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: 2026-02-23T08:04:03.786+0000 7f1f9c753780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:05.277 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: 0 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: 2026-02-23T08:04:03.991+0000 7f1f9c753780 -1 Falling back to public interface 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: 2026-02-23T08:04:04.405+0000 7f1f9c753780 -1 osd.3 107 log_to_monitors true 2026-02-23T08:04:05.278 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: 1 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: osd.3 up in weight 1 up_from 113 up_thru 113 down_at 108 last_clean_interval [106,107) [v2:127.0.0.1:6826/1924429454,v1:127.0.0.1:6827/1924429454] [v2:127.0.0.1:6828/1924429454,v1:127.0.0.1:6829/1924429454] exists,up 17250c70-b906-44dd-b1db-ee5a7cde973b 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:05.279 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:05.280 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:04:05.280 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:04:05.280 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:04:05.280 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:04:05.825 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_th-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:04:05.825 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: 1 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: 2 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: 3 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: 4 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: 5 2026-02-23T08:04:05.826 INFO:tasks.workunit.client.0.trial129.stderr:580794: 6 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: 7 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: 8 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: 9' 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514' 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705698 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705698 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698' 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:04:05.827 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574882 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574882 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882' 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=485331304450 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 485331304450 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450' 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580794: //homimeout_delays 90 .1 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580792: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:04:05.828 INFO:tasks.workunit.client.0.trial129.stderr:580792: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 1 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 2 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 3 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 4 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 5 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 6 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 7 2026-02-23T08:04:05.829 INFO:tasks.workunit.client.0.trial129.stderr:580792: 8 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: 9' 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836515 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836515 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515' 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705699 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705699 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699' 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574881 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574881 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881' 2026-02-23T08:04:05.830 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:05.831 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:04:05.831 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=485331304451 2026-02-23T08:04:05.831 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 485331304451 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451' 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247841 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247841 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451 4-98784247841' 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=476741369859 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 476741369859 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451 4-98784247841 5-476741369859' 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953505 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953505 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451 4-98784247841 5-476741369859 6-137438953505' 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822687 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822687 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451 4-98784247841 5-476741369859 6-137438953505 7-154618822687' 2026-02-23T08:04:06.274 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691871 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691871 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451 4-98784247841 5-476741369859 6-137438953505 7-154618822687 8-171798691871' 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795018 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795018 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.e/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247840 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247840 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450 4-98784247840' 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=476741369858 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 476741369858 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450 4-98784247840 5-476741369858' 2026-02-23T08:04:06.275 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953504 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953504 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450 4-98784247840 5-476741369858 6-137438953504' 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822688 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822688 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450 4-98784247840 5-476741369858 6-137438953504 7-154618822688' 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=171798691872 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 171798691872 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450 4-98784247840 5-476741369858 6-137438953504 7-154618822688 8-171798691872' 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=420906795019 2026-02-23T08:04:06.276 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 420906795019 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705698 2-55834574882 3-485331304450 4-98784247840 5-476741369858 6-137438953504 7-154618822688 8-171798691872 9-4209067950190/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705699 2-55834574881 3-485331304451 4-98784247841 5-476741369859 6-137438953505 7-154618822687 8-171798691871 9-420906795018' 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836515 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836515 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836515 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.0 seq 21474836515 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836513 -lt 21474836515 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836515 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705699 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705699 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705699 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705699' 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.1 seq 38654705699 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705699 -lt 38654705699 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:07.794 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574881 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574881 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574881 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574881' 2026-02-23T08:04:07.795 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.2 seq 55834574881 2026-02-23T08:04:07.961 INFO:tasks.workunit.client.0.trial129.stderr:58' 2026-02-23T08:04:07.961 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:07.961 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836514 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836514 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.0 seq 21474836514 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836513 -lt 21474836514 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836514 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705698 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705698 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705698 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705698' 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.1 seq 38654705698 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705699 -lt 38654705698 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574882 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574882 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574882 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574882' 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.2 seq 55834574882 2026-02-23T08:04:07.962 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:04:08.475 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flus0792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:04:08.475 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574882 -lt 55834574881 2026-02-23T08:04:08.475 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-485331304451 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-485331304451 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=485331304451 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 485331304451' 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.3 seq 485331304451 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 485331304451 -lt 485331304451 2026-02-23T08:04:08.476 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247841 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247841 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247841 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247841' 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.4 seq 98784247841 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247842 -lt 98784247841 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.477 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-476741369859 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-476741369859 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=476741369859 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 476741369859' 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.5 seq 476741369859 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 476741369859 -lt 476741369859 2026-02-23T08:04:08.478 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.479 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/stanh_pg_stats: test 55834574882 -lt 55834574882 2026-02-23T08:04:08.479 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.479 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-485331304450 2026-02-23T08:04:08.479 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-485331304450 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=485331304450 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 485331304450' 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.3 seq 485331304450 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 485331304451 -lt 485331304450 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-98784247840 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.480 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-98784247840 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247840 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 98784247840' 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.4 seq 98784247840 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247842 -lt 98784247840 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-476741369858 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:04:08.481 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-476741369858 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=476741369858 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 476741369858' 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.5 seq 476741369858 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 476741369859 -lt 476741369858 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953504 2026-02-23T08:04:08.482 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.993 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:04:08.993 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953504 2026-02-23T08:04:08.993 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.993 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953504 2026-02-23T08:04:08.993 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953504' 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.6 seq 137438953504 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953506 -lt 137438953504 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822688 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822688 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822688 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822688' 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.7 seq 154618822688 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822688 -lt 154618822688 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691872 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691872 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691872 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691872' 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.8 seq 171798691872 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691872 -lt 171798691872 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-420906795019 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-420906795019 2026-02-23T08:04:08.994 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42dalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-137438953505 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-137438953505 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953505 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 137438953505' 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.6 seq 137438953505 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953506 -lt 137438953505 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-154618822687 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-154618822687 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822687 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 154618822687' 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.7 seq 154618822687 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:04:08.995 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822688 -lt 154618822687 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-171798691871 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-171798691871 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=171798691871 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 171798691871' 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.8 seq 171798691871 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 171798691872 -lt 171798691871 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-420906795018 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:04:08.996 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-420906795018 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580792: //0906795019 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 420906795019' 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: waiting osd.9 seq 420906795019 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795019 -lt 420906795019 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:09.746 INFO:tasks.workunit.client.0.trial129.stderr:580794: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:09.747 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:04:09.747 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:04:09.747 INFO:tasks.workunit.client.0.trial129.stderr:580794: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:04:09.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:04:09.749 INFO:tasks.workunit.client.0.trial129.stderr:home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:09.749 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=420906795018 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 420906795018' 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: waiting osd.9 seq 420906795018 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 420906795019 -lt 420906795018 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:04:09.750 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:580792: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 580790 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:04:09.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:04:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:04:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:04:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:04:09.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:04:09.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:04:09.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:04:09.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:04:09.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:04:09.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:04:09.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:04:09.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:04:09.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:04:09.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:04:09.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:04:09.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:04:09.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:04:09.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:04:09.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:04:09.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:04:09.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:04:09.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:04:09.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:04:09.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:04:09.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:04:09.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:04:09.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:04:09.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:04:09.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:04:09.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:09.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:09.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:04:09.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:04:09.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:04:09.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:04:09.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:04:09.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:04:09.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:04:09.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:04:09.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:04:09.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:04:09.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:04:09.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:04:09.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:04:09.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:04:09.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:04:09.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:04:09.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:04:09.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:04:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:09.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:04:09.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:04:09.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:04:09.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:04:09.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:04:09.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:09.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:09.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:04:09.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:04:09.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:04:09.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_lrc_overwrites td/osd-scrub-repair 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:905: TEST_corrupt_and_repair_lrc_overwrites: '[' true = true ']' 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:906: TEST_corrupt_and_repair_lrc_overwrites: corrupt_and_repair_lrc td/osd-scrub-repair true 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:884: corrupt_and_repair_lrc: local dir=td/osd-scrub-repair 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:885: corrupt_and_repair_lrc: local allow_overwrites=true 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:886: corrupt_and_repair_lrc: local poolname=ecpool 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:888: corrupt_and_repair_lrc: run_mon td/osd-scrub-repair a 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:04:09.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:04:09.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:04:09.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:09.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:09.951 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:09.952 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:09.952 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:09.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:04:09.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:04:09.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:04:09.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:04:09.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:04:09.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:09.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:04:09.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:04:09.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:04:10.038 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:04:10.039 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:04:10.039 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:10.039 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:10.039 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:04:10.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:04:10.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:889: corrupt_and_repair_lrc: run_mgr td/osd-scrub-repair x 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:04:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:10.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:10.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:04:10.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:04:10.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: seq 0 9 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 0 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:10.207 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:10.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:10.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:10.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:10.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:10.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=87755db2-ac39-46fa-990e-35e3aadc3e39 2026-02-23T08:04:10.209 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 87755db2-ac39-46fa-990e-35e3aadc3e39 2026-02-23T08:04:10.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 87755db2-ac39-46fa-990e-35e3aadc3e39' 2026-02-23T08:04:10.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:10.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD6CZxpZhr0DBAAAMNSxdywFOoXTNi8GXZLnQ== 2026-02-23T08:04:10.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD6CZxpZhr0DBAAAMNSxdywFOoXTNi8GXZLnQ=="}' 2026-02-23T08:04:10.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 87755db2-ac39-46fa-990e-35e3aadc3e39 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:04:10.304 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:10.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:04:10.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6CZxpZhr0DBAAAMNSxdywFOoXTNi8GXZLnQ== --osd-uuid 87755db2-ac39-46fa-990e-35e3aadc3e39 2026-02-23T08:04:10.328 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.327+0000 7f780db57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:10.330 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.329+0000 7f780db57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:10.330 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.329+0000 7f780db57780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:10.331 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.330+0000 7f780db57780 -1 bdev(0x55dd83bfd400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:10.331 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.330+0000 7f780db57780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:04:10.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:04:10.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:10.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:04:10.752 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:04:10.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:10.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:04:10.848 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:04:10.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:10.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:10.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:10.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:10.860 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.859+0000 7f6e5c37f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:10.861 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.860+0000 7f6e5c37f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:10.862 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:10.861+0000 7f6e5c37f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:04:11.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:11.047 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:11.046+0000 7f6e5c37f780 -1 Falling back to public interface 2026-02-23T08:04:11.404 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:11.403+0000 7f6e5c37f780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:04:12.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:12.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:12.033 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:12.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:12.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:12.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:04:12.124 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2444195109,v1:127.0.0.1:6801/2444195109] [v2:127.0.0.1:6802/2444195109,v1:127.0.0.1:6803/2444195109] exists,up 87755db2-ac39-46fa-990e-35e3aadc3e39 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 1 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:12.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:04:12.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:12.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=752e15bd-995d-42cc-91d0-e1412c18017a 2026-02-23T08:04:12.128 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 752e15bd-995d-42cc-91d0-e1412c18017a 2026-02-23T08:04:12.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 752e15bd-995d-42cc-91d0-e1412c18017a' 2026-02-23T08:04:12.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:12.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD8CZxpkrYiCBAAeK5fHf1wulYFwzyLPoEfog== 2026-02-23T08:04:12.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD8CZxpkrYiCBAAeK5fHf1wulYFwzyLPoEfog=="}' 2026-02-23T08:04:12.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 752e15bd-995d-42cc-91d0-e1412c18017a -i td/osd-scrub-repair/1/new.json 2026-02-23T08:04:12.228 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:12.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:04:12.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD8CZxpkrYiCBAAeK5fHf1wulYFwzyLPoEfog== --osd-uuid 752e15bd-995d-42cc-91d0-e1412c18017a 2026-02-23T08:04:12.252 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.251+0000 7f7f5620a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:12.253 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.252+0000 7f7f5620a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:12.254 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.253+0000 7f7f5620a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:12.255 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.254+0000 7f7f5620a780 -1 bdev(0x558fcaaab400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:12.255 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.254+0000 7f7f5620a780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:04:12.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:04:12.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:12.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:04:12.697 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:04:12.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:12.902 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:04:12.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:04:12.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:12.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:12.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:12.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:12.915 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.914+0000 7f09efa11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:12.916 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.915+0000 7f09efa11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:12.917 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:12.916+0000 7f09efa11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:13.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:04:13.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:13.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:04:13.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:13.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:13.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:13.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:13.066 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:13.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:13.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:04:13.083 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:13.083+0000 7f09efa11780 -1 Falling back to public interface 2026-02-23T08:04:13.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:13.459 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:13.458+0000 7f09efa11780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:04:14.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:14.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:14.231 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:14.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:14.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:14.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:04:14.394 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2254472590,v1:127.0.0.1:6811/2254472590] [v2:127.0.0.1:6812/2254472590,v1:127.0.0.1:6813/2254472590] exists,up 752e15bd-995d-42cc-91d0-e1412c18017a 2026-02-23T08:04:14.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:14.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:14.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:14.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 2 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:14.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:14.401 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:14.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=911dc818-f8ec-486e-ad17-8f3b0c505e3a 2026-02-23T08:04:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 911dc818-f8ec-486e-ad17-8f3b0c505e3a' 2026-02-23T08:04:14.404 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 911dc818-f8ec-486e-ad17-8f3b0c505e3a 2026-02-23T08:04:14.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:14.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD+CZxpyTo6GBAArqUGfbeIMbqdTj0iEjBFQw== 2026-02-23T08:04:14.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD+CZxpyTo6GBAArqUGfbeIMbqdTj0iEjBFQw=="}' 2026-02-23T08:04:14.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 911dc818-f8ec-486e-ad17-8f3b0c505e3a -i td/osd-scrub-repair/2/new.json 2026-02-23T08:04:14.570 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:04:14.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:04:14.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD+CZxpyTo6GBAArqUGfbeIMbqdTj0iEjBFQw== --osd-uuid 911dc818-f8ec-486e-ad17-8f3b0c505e3a 2026-02-23T08:04:14.595 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:14.594+0000 7fe20bc12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:14.596 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:14.596+0000 7fe20bc12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:14.597 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:14.596+0000 7fe20bc12780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:14.598 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:14.597+0000 7fe20bc12780 -1 bdev(0x55b5727b9400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:14.598 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:14.597+0000 7fe20bc12780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:04:15.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:04:15.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:15.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:04:15.014 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:04:15.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:15.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:04:15.222 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:04:15.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:15.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:15.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:15.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:15.235 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:15.233+0000 7f0625b4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:15.236 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:15.235+0000 7f0625b4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:15.236 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:15.235+0000 7f0625b4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:15.378 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:15.376+0000 7f0625b4c780 -1 Falling back to public interface 2026-02-23T08:04:15.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:04:15.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:15.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:04:15.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:15.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:15.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:15.391 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:15.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:15.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:15.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:04:15.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:15.713 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:15.712+0000 7f0625b4c780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:04:16.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:16.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:16.555 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:16.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:16.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:16.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:04:16.719 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/200941865,v1:127.0.0.1:6819/200941865] [v2:127.0.0.1:6820/200941865,v1:127.0.0.1:6821/200941865] exists,up 911dc818-f8ec-486e-ad17-8f3b0c505e3a 2026-02-23T08:04:16.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 3 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:16.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:16.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:16.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:16.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:04:16.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:16.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:04:16.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 b80f5aef-b503-4374-bf6f-4ffd6ddae76d' 2026-02-23T08:04:16.727 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:04:16.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:16.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAACpxp0AyMKxAAMRUY2ttb6UOrjYooQYdFYQ== 2026-02-23T08:04:16.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAACpxp0AyMKxAAMRUY2ttb6UOrjYooQYdFYQ=="}' 2026-02-23T08:04:16.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b80f5aef-b503-4374-bf6f-4ffd6ddae76d -i td/osd-scrub-repair/3/new.json 2026-02-23T08:04:16.891 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T08:04:16.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-23T08:04:16.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAACpxp0AyMKxAAMRUY2ttb6UOrjYooQYdFYQ== --osd-uuid b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:04:16.917 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:16.915+0000 7faa3fd4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:16.918 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:16.916+0000 7faa3fd4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:16.919 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:16.917+0000 7faa3fd4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:16.919 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:16.918+0000 7faa3fd4f780 -1 bdev(0x55d82dfc7400 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:16.919 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:16.918+0000 7faa3fd4f780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-23T08:04:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-23T08:04:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:17.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T08:04:17.343 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T08:04:17.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:17.552 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T08:04:17.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T08:04:17.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:17.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:17.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:17.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:17.566 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:17.565+0000 7f751ba06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:17.567 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:17.566+0000 7f751ba06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:17.568 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:17.567+0000 7f751ba06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T08:04:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:04:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:17.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:17.719 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:17.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:17.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:04:17.773 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:17.771+0000 7f751ba06780 -1 Falling back to public interface 2026-02-23T08:04:17.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:18.100 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:18.099+0000 7f751ba06780 -1 osd.3 0 log_to_monitors true 2026-02-23T08:04:18.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:18.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:18.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:18.882 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:18.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:18.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:04:19.046 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1182694775,v1:127.0.0.1:6827/1182694775] [v2:127.0.0.1:6828/1182694775,v1:127.0.0.1:6829/1182694775] exists,up b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:04:19.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:19.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:19.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 4 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=4 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/4 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/4' 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/4/journal' 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:19.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:19.053 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:19.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:19.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:19.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:19.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/4 2026-02-23T08:04:19.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:19.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4e44e281-3650-4de9-a60e-c70e0e4e3619 2026-02-23T08:04:19.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd4 4e44e281-3650-4de9-a60e-c70e0e4e3619' 2026-02-23T08:04:19.056 INFO:tasks.workunit.client.0.trial129.stdout:add osd4 4e44e281-3650-4de9-a60e-c70e0e4e3619 2026-02-23T08:04:19.056 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:19.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADCpxpCaZzAxAAxPAdIAlCY5SnU0/A4WVAsg== 2026-02-23T08:04:19.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADCpxpCaZzAxAAxPAdIAlCY5SnU0/A4WVAsg=="}' 2026-02-23T08:04:19.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4e44e281-3650-4de9-a60e-c70e0e4e3619 -i td/osd-scrub-repair/4/new.json 2026-02-23T08:04:19.217 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T08:04:19.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/4/new.json 2026-02-23T08:04:19.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 4 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADCpxpCaZzAxAAxPAdIAlCY5SnU0/A4WVAsg== --osd-uuid 4e44e281-3650-4de9-a60e-c70e0e4e3619 2026-02-23T08:04:19.240 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.240+0000 7f30ce34f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:19.242 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.241+0000 7f30ce34f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:19.243 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.242+0000 7f30ce34f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:19.243 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.242+0000 7f30ce34f780 -1 bdev(0x55e682f95400 td/osd-scrub-repair/4/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:19.243 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.242+0000 7f30ce34f780 -1 bluestore(td/osd-scrub-repair/4) _read_fsid unparsable uuid 2026-02-23T08:04:19.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/4/keyring 2026-02-23T08:04:19.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:19.668 INFO:tasks.workunit.client.0.trial129.stdout:adding osd4 key to auth repository 2026-02-23T08:04:19.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd4 key to auth repository 2026-02-23T08:04:19.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/4/keyring auth add osd.4 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:19.874 INFO:tasks.workunit.client.0.trial129.stdout:start osd.4 2026-02-23T08:04:19.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.4 2026-02-23T08:04:19.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 4 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/4 --osd-journal=td/osd-scrub-repair/4/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:19.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:19.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:19.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:19.887 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.886+0000 7f5ded755780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:19.888 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.887+0000 7f5ded755780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:19.889 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:19.888+0000 7f5ded755780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:20.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 4 2026-02-23T08:04:20.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:20.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=4 2026-02-23T08:04:20.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:20.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:20.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:20.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:20.043 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:20.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:20.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-23T08:04:20.105 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:20.104+0000 7f5ded755780 -1 Falling back to public interface 2026-02-23T08:04:20.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:20.498 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:20.497+0000 7f5ded755780 -1 osd.4 0 log_to_monitors true 2026-02-23T08:04:21.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:21.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:21.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:21.207 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:21.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:21.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.4 up' 2026-02-23T08:04:21.374 INFO:tasks.workunit.client.0.trial129.stdout:osd.4 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/1544799413,v1:127.0.0.1:6835/1544799413] [v2:127.0.0.1:6836/1544799413,v1:127.0.0.1:6837/1544799413] exists,up 4e44e281-3650-4de9-a60e-c70e0e4e3619 2026-02-23T08:04:21.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:21.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:21.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:21.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:21.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 5 2026-02-23T08:04:21.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:21.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:21.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=5 2026-02-23T08:04:21.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:21.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:04:21.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:21.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:21.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:21.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:04:21.384 INFO:tasks.workunit.client.0.trial129.stdout:add osd5 cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:04:21.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd5 cbdc38de-b88d-4bb8-b38c-e235d2cad3a7' 2026-02-23T08:04:21.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:21.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAFCpxpZc/9FhAA13RRk8BH/47DiFaRb1KmQg== 2026-02-23T08:04:21.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAFCpxpZc/9FhAA13RRk8BH/47DiFaRb1KmQg=="}' 2026-02-23T08:04:21.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 -i td/osd-scrub-repair/5/new.json 2026-02-23T08:04:21.548 INFO:tasks.workunit.client.0.trial129.stdout:5 2026-02-23T08:04:21.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/5/new.json 2026-02-23T08:04:21.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAFCpxpZc/9FhAA13RRk8BH/47DiFaRb1KmQg== --osd-uuid cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:04:21.576 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:21.575+0000 7f1371eba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:21.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:21.576+0000 7f1371eba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:21.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:21.577+0000 7f1371eba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:21.578 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:21.577+0000 7f1371eba780 -1 bdev(0x55b7917f7400 td/osd-scrub-repair/5/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:21.578 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:21.577+0000 7f1371eba780 -1 bluestore(td/osd-scrub-repair/5) _read_fsid unparsable uuid 2026-02-23T08:04:21.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/5/keyring 2026-02-23T08:04:21.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:21.969 INFO:tasks.workunit.client.0.trial129.stdout:adding osd5 key to auth repository 2026-02-23T08:04:21.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd5 key to auth repository 2026-02-23T08:04:21.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/5/keyring auth add osd.5 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:22.176 INFO:tasks.workunit.client.0.trial129.stdout:start osd.5 2026-02-23T08:04:22.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.5 2026-02-23T08:04:22.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:22.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:22.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:22.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:22.188 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:22.187+0000 7f057141a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:22.189 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:22.188+0000 7f057141a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:22.190 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:22.189+0000 7f057141a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:22.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 5 2026-02-23T08:04:22.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:22.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:04:22.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:22.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:22.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:22.347 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:22.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:22.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:22.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:04:22.349 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:22.348+0000 7f057141a780 -1 Falling back to public interface 2026-02-23T08:04:22.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:22.691 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:22.690+0000 7f057141a780 -1 osd.5 0 log_to_monitors true 2026-02-23T08:04:23.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:23.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:23.511 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:23.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:23.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:23.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:04:23.680 INFO:tasks.workunit.client.0.trial129.stdout:osd.5 up in weight 1 up_from 26 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6842/3247512375,v1:127.0.0.1:6843/3247512375] [v2:127.0.0.1:6844/3247512375,v1:127.0.0.1:6845/3247512375] exists,up cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:04:23.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:23.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:23.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:23.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:23.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 6 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=6 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/6 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/6' 2026-02-23T08:04:23.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/6/journal' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:23.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/6 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:23.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=157d6da3-0b01-4461-8ced-2bccf5c369b8 2026-02-23T08:04:23.688 INFO:tasks.workunit.client.0.trial129.stdout:add osd6 157d6da3-0b01-4461-8ced-2bccf5c369b8 2026-02-23T08:04:23.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd6 157d6da3-0b01-4461-8ced-2bccf5c369b8' 2026-02-23T08:04:23.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:23.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAHCpxpxpg7KRAA/RuffN0o77345a589YKI8A== 2026-02-23T08:04:23.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAHCpxpxpg7KRAA/RuffN0o77345a589YKI8A=="}' 2026-02-23T08:04:23.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 157d6da3-0b01-4461-8ced-2bccf5c369b8 -i td/osd-scrub-repair/6/new.json 2026-02-23T08:04:23.852 INFO:tasks.workunit.client.0.trial129.stdout:6 2026-02-23T08:04:23.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/6/new.json 2026-02-23T08:04:23.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 6 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAHCpxpxpg7KRAA/RuffN0o77345a589YKI8A== --osd-uuid 157d6da3-0b01-4461-8ced-2bccf5c369b8 2026-02-23T08:04:23.878 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:23.877+0000 7f7cef951780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:23.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:23.878+0000 7f7cef951780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:23.880 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:23.879+0000 7f7cef951780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:23.880 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:23.879+0000 7f7cef951780 -1 bdev(0x557b5fa7d400 td/osd-scrub-repair/6/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:23.880 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:23.879+0000 7f7cef951780 -1 bluestore(td/osd-scrub-repair/6) _read_fsid unparsable uuid 2026-02-23T08:04:24.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/6/keyring 2026-02-23T08:04:24.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:24.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd6 key to auth repository 2026-02-23T08:04:24.300 INFO:tasks.workunit.client.0.trial129.stdout:adding osd6 key to auth repository 2026-02-23T08:04:24.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/6/keyring auth add osd.6 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:24.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.6 2026-02-23T08:04:24.508 INFO:tasks.workunit.client.0.trial129.stdout:start osd.6 2026-02-23T08:04:24.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 6 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/6 --osd-journal=td/osd-scrub-repair/6/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:24.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:24.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:24.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:24.521 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:24.520+0000 7feb58894780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:24.522 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:24.521+0000 7feb58894780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:24.523 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:24.522+0000 7feb58894780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 6 2026-02-23T08:04:24.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:24.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=6 2026-02-23T08:04:24.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:24.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:24.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:24.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:24.674 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:24.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:24.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-23T08:04:24.732 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:24.730+0000 7feb58894780 -1 Falling back to public interface 2026-02-23T08:04:24.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:25.019 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:25.018+0000 7feb58894780 -1 osd.6 0 log_to_monitors true 2026-02-23T08:04:25.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:25.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:25.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:25.836 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:25.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:25.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.6 up' 2026-02-23T08:04:26.001 INFO:tasks.workunit.client.0.trial129.stdout:osd.6 up in weight 1 up_from 31 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6850/1076821610,v1:127.0.0.1:6851/1076821610] [v2:127.0.0.1:6852/1076821610,v1:127.0.0.1:6853/1076821610] exists,up 157d6da3-0b01-4461-8ced-2bccf5c369b8 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 7 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=7 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/7 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/7' 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/7/journal' 2026-02-23T08:04:26.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:26.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/7 2026-02-23T08:04:26.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:26.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e1a1475a-44a6-4f4b-812f-4441a4a888c6 2026-02-23T08:04:26.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd7 e1a1475a-44a6-4f4b-812f-4441a4a888c6' 2026-02-23T08:04:26.005 INFO:tasks.workunit.client.0.trial129.stdout:add osd7 e1a1475a-44a6-4f4b-812f-4441a4a888c6 2026-02-23T08:04:26.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:26.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAKCpxpnsrMABAA5xxcNUrXfGwUxPLoZPNHTw== 2026-02-23T08:04:26.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAKCpxpnsrMABAA5xxcNUrXfGwUxPLoZPNHTw=="}' 2026-02-23T08:04:26.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e1a1475a-44a6-4f4b-812f-4441a4a888c6 -i td/osd-scrub-repair/7/new.json 2026-02-23T08:04:26.173 INFO:tasks.workunit.client.0.trial129.stdout:7 2026-02-23T08:04:26.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/7/new.json 2026-02-23T08:04:26.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 7 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAKCpxpnsrMABAA5xxcNUrXfGwUxPLoZPNHTw== --osd-uuid e1a1475a-44a6-4f4b-812f-4441a4a888c6 2026-02-23T08:04:26.198 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.197+0000 7f2476954780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:26.199 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.198+0000 7f2476954780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:26.200 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.199+0000 7f2476954780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:26.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.199+0000 7f2476954780 -1 bdev(0x55edbd75b400 td/osd-scrub-repair/7/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:26.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.199+0000 7f2476954780 -1 bluestore(td/osd-scrub-repair/7) _read_fsid unparsable uuid 2026-02-23T08:04:26.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/7/keyring 2026-02-23T08:04:26.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:26.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd7 key to auth repository 2026-02-23T08:04:26.629 INFO:tasks.workunit.client.0.trial129.stdout:adding osd7 key to auth repository 2026-02-23T08:04:26.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/7/keyring auth add osd.7 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:26.835 INFO:tasks.workunit.client.0.trial129.stdout:start osd.7 2026-02-23T08:04:26.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.7 2026-02-23T08:04:26.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 7 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/7 --osd-journal=td/osd-scrub-repair/7/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:26.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:26.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:26.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:26.849 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.848+0000 7f975e74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:26.850 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.849+0000 7f975e74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:26.851 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:26.850+0000 7f975e74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:27.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 7 2026-02-23T08:04:27.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:27.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=7 2026-02-23T08:04:27.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:27.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:27.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:27.001 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:27.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:27.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:27.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-23T08:04:27.056 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:27.054+0000 7f975e74f780 -1 Falling back to public interface 2026-02-23T08:04:27.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:27.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:27.412+0000 7f975e74f780 -1 osd.7 0 log_to_monitors true 2026-02-23T08:04:28.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:28.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:28.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:28.168 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:28.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:28.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.7 up' 2026-02-23T08:04:28.336 INFO:tasks.workunit.client.0.trial129.stdout:osd.7 up in weight 1 up_from 35 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6858/4089882128,v1:127.0.0.1:6859/4089882128] [v2:127.0.0.1:6860/4089882128,v1:127.0.0.1:6861/4089882128] exists,up e1a1475a-44a6-4f4b-812f-4441a4a888c6 2026-02-23T08:04:28.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 8 2026-02-23T08:04:28.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:28.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:28.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=8 2026-02-23T08:04:28.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:28.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/8 2026-02-23T08:04:28.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/8' 2026-02-23T08:04:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/8/journal' 2026-02-23T08:04:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:28.348 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:28.349 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:28.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:28.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:28.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:28.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:28.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:28.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:28.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:28.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:28.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:28.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:28.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:28.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:28.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:28.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/8 2026-02-23T08:04:28.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:28.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bbed3181-70ee-4991-b28b-2f7e442aa220 2026-02-23T08:04:28.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd8 bbed3181-70ee-4991-b28b-2f7e442aa220' 2026-02-23T08:04:28.352 INFO:tasks.workunit.client.0.trial129.stdout:add osd8 bbed3181-70ee-4991-b28b-2f7e442aa220 2026-02-23T08:04:28.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:28.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAMCpxpYCO+FBAAyeYp43nLAA0fcSwe8KzdIA== 2026-02-23T08:04:28.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAMCpxpYCO+FBAAyeYp43nLAA0fcSwe8KzdIA=="}' 2026-02-23T08:04:28.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bbed3181-70ee-4991-b28b-2f7e442aa220 -i td/osd-scrub-repair/8/new.json 2026-02-23T08:04:28.508 INFO:tasks.workunit.client.0.trial129.stdout:8 2026-02-23T08:04:28.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/8/new.json 2026-02-23T08:04:28.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 8 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAMCpxpYCO+FBAAyeYp43nLAA0fcSwe8KzdIA== --osd-uuid bbed3181-70ee-4991-b28b-2f7e442aa220 2026-02-23T08:04:28.535 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:28.534+0000 7f981d750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:28.536 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:28.535+0000 7f981d750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:28.537 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:28.536+0000 7f981d750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:28.538 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:28.536+0000 7f981d750780 -1 bdev(0x55be8d1b1400 td/osd-scrub-repair/8/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:28.538 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:28.537+0000 7f981d750780 -1 bluestore(td/osd-scrub-repair/8) _read_fsid unparsable uuid 2026-02-23T08:04:28.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/8/keyring 2026-02-23T08:04:28.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:28.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd8 key to auth repository 2026-02-23T08:04:28.969 INFO:tasks.workunit.client.0.trial129.stdout:adding osd8 key to auth repository 2026-02-23T08:04:28.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/8/keyring auth add osd.8 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:29.174 INFO:tasks.workunit.client.0.trial129.stdout:start osd.8 2026-02-23T08:04:29.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.8 2026-02-23T08:04:29.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 8 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/8 --osd-journal=td/osd-scrub-repair/8/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:29.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:29.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:29.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:29.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:29.185+0000 7f4a70f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:29.187 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:29.186+0000 7f4a70f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:29.188 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:29.187+0000 7f4a70f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:29.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 8 2026-02-23T08:04:29.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:29.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=8 2026-02-23T08:04:29.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:29.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:29.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:29.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:29.343 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:29.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:29.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-23T08:04:29.405 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:29.404+0000 7f4a70f4b780 -1 Falling back to public interface 2026-02-23T08:04:29.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:29.721 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:29.720+0000 7f4a70f4b780 -1 osd.8 0 log_to_monitors true 2026-02-23T08:04:30.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:30.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:30.509 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:30.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:30.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:30.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.8 up' 2026-02-23T08:04:30.678 INFO:tasks.workunit.client.0.trial129.stdout:osd.8 up in weight 1 up_from 39 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6866/4210428791,v1:127.0.0.1:6867/4210428791] [v2:127.0.0.1:6868/4210428791,v1:127.0.0.1:6869/4210428791] exists,up bbed3181-70ee-4991-b28b-2f7e442aa220 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:890: corrupt_and_repair_lrc: for id in $(seq 0 9) 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:891: corrupt_and_repair_lrc: run_osd td/osd-scrub-repair 9 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:04:30.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=9 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:04:30.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:04:30.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:04:30.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:04:30.687 INFO:tasks.workunit.client.0.trial129.stdout:add osd9 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:04:30.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd9 867c0021-2e15-48f1-baf6-e71b211ab65c' 2026-02-23T08:04:30.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:04:30.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAOCpxpSTYgKRAABn7X2g1q+SwASb7Iaen0nQ== 2026-02-23T08:04:30.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAOCpxpSTYgKRAABn7X2g1q+SwASb7Iaen0nQ=="}' 2026-02-23T08:04:30.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 867c0021-2e15-48f1-baf6-e71b211ab65c -i td/osd-scrub-repair/9/new.json 2026-02-23T08:04:30.854 INFO:tasks.workunit.client.0.trial129.stdout:9 2026-02-23T08:04:30.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/9/new.json 2026-02-23T08:04:30.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAOCpxpSTYgKRAABn7X2g1q+SwASb7Iaen0nQ== --osd-uuid 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:04:30.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:30.878+0000 7fae6b34d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:30.880 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:30.879+0000 7fae6b34d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:30.881 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:30.880+0000 7fae6b34d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:30.881 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:30.880+0000 7fae6b34d780 -1 bdev(0x55b2bab8b400 td/osd-scrub-repair/9/block) open stat got: (1) Operation not permitted 2026-02-23T08:04:30.881 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:30.880+0000 7fae6b34d780 -1 bluestore(td/osd-scrub-repair/9) _read_fsid unparsable uuid 2026-02-23T08:04:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/9/keyring 2026-02-23T08:04:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:04:31.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd9 key to auth repository 2026-02-23T08:04:31.311 INFO:tasks.workunit.client.0.trial129.stdout:adding osd9 key to auth repository 2026-02-23T08:04:31.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/9/keyring auth add osd.9 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:04:31.519 INFO:tasks.workunit.client.0.trial129.stdout:start osd.9 2026-02-23T08:04:31.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.9 2026-02-23T08:04:31.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:31.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:04:31.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:04:31.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:04:31.532 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:31.530+0000 7fd849b4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:31.533 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:31.531+0000 7fd849b4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:31.534 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:31.532+0000 7fd849b4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:31.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 9 2026-02-23T08:04:31.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:31.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:04:31.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:31.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:31.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:31.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:31.683 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:04:31.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:31.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:04:31.749 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:31.747+0000 7fd849b4b780 -1 Falling back to public interface 2026-02-23T08:04:31.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:32.122 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:32.120+0000 7fd849b4b780 -1 osd.9 0 log_to_monitors true 2026-02-23T08:04:32.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:32.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:32.846 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:04:32.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:32.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:32.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:04:33.009 INFO:tasks.workunit.client.0.trial129.stdout:osd.9 up in weight 1 up_from 43 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6874/1251460844,v1:127.0.0.1:6875/1251460844] [v2:127.0.0.1:6876/1251460844,v1:127.0.0.1:6877/1251460844] exists,up 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:04:33.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:33.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:33.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:33.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:893: corrupt_and_repair_lrc: create_rbd_pool 2026-02-23T08:04:33.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:04:33.164 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:04:33.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:04:33.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:04:33.353 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:04:33.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:04:34.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:894: corrupt_and_repair_lrc: wait_for_clean 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:04:34.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:04:34.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:04:34.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:04:34.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:04:34.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:04:34.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:04:34.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:04:34.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:04:34.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:04:35.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:04:35.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:04:35.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-23T08:04:35.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-23T08:04:35.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-23T08:04:35.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:04:35.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T08:04:35.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T08:04:35.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670' 2026-02-23T08:04:35.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:04:35.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-23T08:04:35.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-23T08:04:35.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149' 2026-02-23T08:04:35.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:04:35.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411333 2026-02-23T08:04:35.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411333 2026-02-23T08:04:35.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333' 2026-02-23T08:04:35.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:04:35.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280517 2026-02-23T08:04:35.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280517 2026-02-23T08:04:35.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333 4-94489280517' 2026-02-23T08:04:35.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:04:35.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149700 2026-02-23T08:04:35.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149700 2026-02-23T08:04:35.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333 4-94489280517 5-111669149700' 2026-02-23T08:04:35.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:04:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-23T08:04:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-23T08:04:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333 4-94489280517 5-111669149700 6-133143986179' 2026-02-23T08:04:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:04:35.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-23T08:04:35.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-23T08:04:35.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333 4-94489280517 5-111669149700 6-133143986179 7-150323855363' 2026-02-23T08:04:35.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:04:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-23T08:04:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-23T08:04:35.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333 4-94489280517 5-111669149700 6-133143986179 7-150323855363 8-167503724547' 2026-02-23T08:04:35.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:35.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:04:35.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593730 2026-02-23T08:04:35.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593730 2026-02-23T08:04:35.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705670 2-60129542149 3-77309411333 4-94489280517 5-111669149700 6-133143986179 7-150323855363 8-167503724547 9-184683593730' 2026-02-23T08:04:35.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:35.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-23T08:04:35.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:35.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:04:35.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-23T08:04:35.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:35.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-23T08:04:35.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-23T08:04:35.838 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836486 2026-02-23T08:04:35.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:36.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836486 2026-02-23T08:04:36.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:04:37.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:04:37.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:37.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836486 2026-02-23T08:04:37.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T08:04:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:37.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:04:37.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T08:04:37.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T08:04:37.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T08:04:37.176 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705670 2026-02-23T08:04:37.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:04:37.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-23T08:04:37.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:37.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-23T08:04:37.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:37.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:04:37.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-23T08:04:37.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:37.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-23T08:04:37.346 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542149 2026-02-23T08:04:37.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-23T08:04:37.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:04:37.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542149 2026-02-23T08:04:37.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:37.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411333 2026-02-23T08:04:37.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:37.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:04:37.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411333 2026-02-23T08:04:37.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:37.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411333 2026-02-23T08:04:37.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411333' 2026-02-23T08:04:37.514 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411333 2026-02-23T08:04:37.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:04:37.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411333 -lt 77309411333 2026-02-23T08:04:37.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:37.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280517 2026-02-23T08:04:37.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:37.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:04:37.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280517 2026-02-23T08:04:37.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:37.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280517 2026-02-23T08:04:37.682 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.4 seq 94489280517 2026-02-23T08:04:37.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280517' 2026-02-23T08:04:37.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:04:37.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280517 -lt 94489280517 2026-02-23T08:04:37.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:37.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-111669149700 2026-02-23T08:04:37.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:37.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:04:37.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-111669149700 2026-02-23T08:04:37.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:37.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149700 2026-02-23T08:04:37.849 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.5 seq 111669149700 2026-02-23T08:04:37.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 111669149700' 2026-02-23T08:04:37.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:04:38.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149700 -lt 111669149700 2026-02-23T08:04:38.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:38.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986179 2026-02-23T08:04:38.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:38.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:04:38.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986179 2026-02-23T08:04:38.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:38.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-23T08:04:38.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986179' 2026-02-23T08:04:38.017 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.6 seq 133143986179 2026-02-23T08:04:38.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:04:38.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986179 2026-02-23T08:04:38.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:38.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855363 2026-02-23T08:04:38.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:38.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:04:38.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855363 2026-02-23T08:04:38.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:38.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-23T08:04:38.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855363' 2026-02-23T08:04:38.189 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.7 seq 150323855363 2026-02-23T08:04:38.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:04:38.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-23T08:04:38.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:38.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724547 2026-02-23T08:04:38.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:38.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:04:38.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724547 2026-02-23T08:04:38.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:38.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724547 2026-02-23T08:04:38.361 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.8 seq 167503724547 2026-02-23T08:04:38.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724547' 2026-02-23T08:04:38.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:04:38.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724548 -lt 167503724547 2026-02-23T08:04:38.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:38.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-184683593730 2026-02-23T08:04:38.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:38.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:04:38.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-184683593730 2026-02-23T08:04:38.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:38.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593730 2026-02-23T08:04:38.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 184683593730' 2026-02-23T08:04:38.529 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.9 seq 184683593730 2026-02-23T08:04:38.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:04:38.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593730 -lt 184683593730 2026-02-23T08:04:38.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:04:38.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:38.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:04:38.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:04:39.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:04:39.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:04:39.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:39.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:39.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:04:39.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:04:39.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:04:39.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:896: corrupt_and_repair_lrc: create_ec_pool ecpool true k=4 m=2 l=3 plugin=lrc 2026-02-23T08:04:39.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:04:39.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:04:39.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-23T08:04:39.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:04:39.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=4 m=2 l=3 plugin=lrc 2026-02-23T08:04:39.479 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:04:39.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:04:39.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:04:39.785 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:04:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:04:40.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-23T08:04:40.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-23T08:04:41.007 INFO:tasks.workunit.client.0.trial129.stderr:set pool 2 allow_ec_overwrites to true 2026-02-23T08:04:41.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:04:41.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:04:41.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:04:41.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:04:41.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:04:41.020 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:04:41.020 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:04:41.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:04:41.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:04:41.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:04:41.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:04:41.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:04:41.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:04:41.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:04:41.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:04:41.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:04:41.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:04:41.266 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:04:41.267 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:04:41.267 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:04:41.267 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:04:41.267 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:04:41.267 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:04:41.267 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:04:41.268 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:04:41.268 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:04:41.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:04:41.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:04:41.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-23T08:04:41.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-23T08:04:41.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-23T08:04:41.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:04:41.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-23T08:04:41.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-23T08:04:41.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672' 2026-02-23T08:04:41.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:04:41.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-23T08:04:41.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-23T08:04:41.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151' 2026-02-23T08:04:41.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:04:41.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411335 2026-02-23T08:04:41.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411335 2026-02-23T08:04:41.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335' 2026-02-23T08:04:41.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:04:41.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280519 2026-02-23T08:04:41.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280519 2026-02-23T08:04:41.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335 4-94489280519' 2026-02-23T08:04:41.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:04:41.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149702 2026-02-23T08:04:41.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149702 2026-02-23T08:04:41.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335 4-94489280519 5-111669149702' 2026-02-23T08:04:41.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:04:41.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986182 2026-02-23T08:04:41.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986182 2026-02-23T08:04:41.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335 4-94489280519 5-111669149702 6-133143986182' 2026-02-23T08:04:41.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:04:41.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855365 2026-02-23T08:04:41.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855365 2026-02-23T08:04:41.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335 4-94489280519 5-111669149702 6-133143986182 7-150323855365' 2026-02-23T08:04:41.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:04:41.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724550 2026-02-23T08:04:41.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724550 2026-02-23T08:04:41.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335 4-94489280519 5-111669149702 6-133143986182 7-150323855365 8-167503724550' 2026-02-23T08:04:41.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:41.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:04:42.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593732 2026-02-23T08:04:42.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593732 2026-02-23T08:04:42.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-38654705672 2-60129542151 3-77309411335 4-94489280519 5-111669149702 6-133143986182 7-150323855365 8-167503724550 9-184683593732' 2026-02-23T08:04:42.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:42.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-23T08:04:42.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:42.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:04:42.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-23T08:04:42.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:42.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-23T08:04:42.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-23T08:04:42.004 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836488 2026-02-23T08:04:42.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:42.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836488 2026-02-23T08:04:42.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:04:43.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:04:43.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-23T08:04:43.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:43.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-23T08:04:43.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:43.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:04:43.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-23T08:04:43.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-23T08:04:43.344 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705672 2026-02-23T08:04:43.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-23T08:04:43.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:04:43.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-23T08:04:43.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:43.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-23T08:04:43.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:43.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:04:43.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-23T08:04:43.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:43.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-23T08:04:43.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-23T08:04:43.514 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542151 2026-02-23T08:04:43.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:04:43.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-23T08:04:43.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:43.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411335 2026-02-23T08:04:43.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:43.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:04:43.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411335 2026-02-23T08:04:43.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411335 2026-02-23T08:04:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411335' 2026-02-23T08:04:43.683 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411335 2026-02-23T08:04:43.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:04:43.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411335 -lt 77309411335 2026-02-23T08:04:43.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:43.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280519 2026-02-23T08:04:43.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:04:43.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280519 2026-02-23T08:04:43.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280519 2026-02-23T08:04:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280519' 2026-02-23T08:04:43.856 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.4 seq 94489280519 2026-02-23T08:04:43.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:04:44.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280520 -lt 94489280519 2026-02-23T08:04:44.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-111669149702 2026-02-23T08:04:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:44.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:04:44.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-111669149702 2026-02-23T08:04:44.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:44.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149702 2026-02-23T08:04:44.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 111669149702' 2026-02-23T08:04:44.024 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.5 seq 111669149702 2026-02-23T08:04:44.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:04:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149702 -lt 111669149702 2026-02-23T08:04:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:44.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986182 2026-02-23T08:04:44.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:04:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986182 2026-02-23T08:04:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986182 2026-02-23T08:04:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986182' 2026-02-23T08:04:44.193 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.6 seq 133143986182 2026-02-23T08:04:44.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:04:44.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986182 -lt 133143986182 2026-02-23T08:04:44.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:44.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855365 2026-02-23T08:04:44.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:44.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:04:44.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855365 2026-02-23T08:04:44.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855365 2026-02-23T08:04:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855365' 2026-02-23T08:04:44.361 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.7 seq 150323855365 2026-02-23T08:04:44.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:04:44.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855366 -lt 150323855365 2026-02-23T08:04:44.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:44.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724550 2026-02-23T08:04:44.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:44.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:04:44.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724550 2026-02-23T08:04:44.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:44.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724550 2026-02-23T08:04:44.533 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.8 seq 167503724550 2026-02-23T08:04:44.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724550' 2026-02-23T08:04:44.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:04:44.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724550 -lt 167503724550 2026-02-23T08:04:44.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:44.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-184683593732 2026-02-23T08:04:44.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:44.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:04:44.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-184683593732 2026-02-23T08:04:44.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:44.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593732 2026-02-23T08:04:44.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 184683593732' 2026-02-23T08:04:44.704 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.9 seq 184683593732 2026-02-23T08:04:44.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:04:44.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593733 -lt 184683593732 2026-02-23T08:04:44.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:04:44.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:44.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:45.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:04:45.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:04:45.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:04:45.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:04:45.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:04:45.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:04:45.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:04:45.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:04:45.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:04:45.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:04:45.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:45.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:04:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:04:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:04:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:04:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:897: corrupt_and_repair_lrc: corrupt_and_repair_erasure_coded td/osd-scrub-repair ecpool 2026-02-23T08:04:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:308: corrupt_and_repair_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:309: corrupt_and_repair_erasure_coded: local poolname=ecpool 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:311: corrupt_and_repair_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:04:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:04:45.651 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:04:45.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:04:45.855 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:04:45.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:04:45.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:04:45.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:04:45.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: get_primary ecpool SOMETHING 2026-02-23T08:04:45.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T08:04:45.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:04:45.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:04:45.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:04:46.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:313: corrupt_and_repair_erasure_coded: local primary=3 2026-02-23T08:04:46.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: get_osds ecpool SOMETHING 2026-02-23T08:04:46.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: sed -e s/3// 2026-02-23T08:04:46.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:04:46.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-23T08:04:46.055 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:04:46.055 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:04:46.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=3 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:9 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr:7' 2026-02-23T08:04:46.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 3 5 9 0 6 2 1 7 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: osds=('5' '9' '0' '6' '2' '1' '7') 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:314: corrupt_and_repair_erasure_coded: local -a osds 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:315: corrupt_and_repair_erasure_coded: local not_primary_first=5 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:316: corrupt_and_repair_erasure_coded: local not_primary_second=9 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:319: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 3 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=3 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:04:46.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:04:46.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:04:46.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:04:46.647 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:46.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:start osd.3 2026-02-23T08:04:46.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:46.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:04:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:04:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:04:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:04:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:04:46.715 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:46.713+0000 7f88e7413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:46.716 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:46.714+0000 7f88e7413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:46.717 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:46.715+0000 7f88e7413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:46.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:46.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:04:46.898 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:46.895+0000 7f88e7413780 -1 Falling back to public interface 2026-02-23T08:04:47.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:04:47.252 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:47.250+0000 7f88e7413780 -1 osd.3 59 log_to_monitors true 2026-02-23T08:04:48.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:04:48.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:48.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:04:48.035 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:04:48.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:48.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:04:48.200 INFO:tasks.workunit.client.0.trial129.stderr:osd.3 up in weight 1 up_from 63 up_thru 63 down_at 60 last_clean_interval [18,59) [v2:127.0.0.1:6826/1145137331,v1:127.0.0.1:6827/1145137331] [v2:127.0.0.1:6828/1145137331,v1:127.0.0.1:6829/1145137331] exists,up b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:04:48.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:04:48.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:04:48.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:04:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:04:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:04:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:04:48.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:04:48.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:04:48.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:04:48.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:04:48.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:04:48.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:04:48.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:04:48.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:04:48.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:04:48.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:04:48.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:04:48.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:04:48.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:04:48.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:04:48.446 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:04:48.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-23T08:04:48.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-23T08:04:48.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-23T08:04:48.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:04:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-23T08:04:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-23T08:04:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-23T08:04:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:04:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-23T08:04:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-23T08:04:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154' 2026-02-23T08:04:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:04:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939650 2026-02-23T08:04:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939650 2026-02-23T08:04:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650' 2026-02-23T08:04:48.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:04:48.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280522 2026-02-23T08:04:48.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280522 2026-02-23T08:04:48.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650 4-94489280522' 2026-02-23T08:04:48.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:04:48.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149705 2026-02-23T08:04:48.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149705 2026-02-23T08:04:48.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650 4-94489280522 5-111669149705' 2026-02-23T08:04:48.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:04:48.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986184 2026-02-23T08:04:48.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986184 2026-02-23T08:04:48.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650 4-94489280522 5-111669149705 6-133143986184' 2026-02-23T08:04:48.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:48.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:04:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855368 2026-02-23T08:04:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855368 2026-02-23T08:04:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650 4-94489280522 5-111669149705 6-133143986184 7-150323855368' 2026-02-23T08:04:49.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:49.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:04:49.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724552 2026-02-23T08:04:49.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724552 2026-02-23T08:04:49.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650 4-94489280522 5-111669149705 6-133143986184 7-150323855368 8-167503724552' 2026-02-23T08:04:49.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:04:49.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:04:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593735 2026-02-23T08:04:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593735 2026-02-23T08:04:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-60129542154 3-270582939650 4-94489280522 5-111669149705 6-133143986184 7-150323855368 8-167503724552 9-184683593735' 2026-02-23T08:04:49.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:49.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-23T08:04:49.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:49.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:04:49.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-23T08:04:49.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-23T08:04:49.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-23T08:04:49.195 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836491 2026-02-23T08:04:49.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:49.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-23T08:04:49.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:04:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:04:50.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:04:50.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-23T08:04:50.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:50.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-23T08:04:50.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:50.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:04:50.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-23T08:04:50.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:50.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-23T08:04:50.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-23T08:04:50.531 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705674 2026-02-23T08:04:50.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:04:50.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705675 -lt 38654705674 2026-02-23T08:04:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:50.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-23T08:04:50.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:50.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:04:50.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-23T08:04:50.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:50.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-23T08:04:50.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-23T08:04:50.700 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542154 2026-02-23T08:04:50.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:04:50.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-23T08:04:50.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939650 2026-02-23T08:04:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:50.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:04:50.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939650 2026-02-23T08:04:50.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:50.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939650 2026-02-23T08:04:50.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939650' 2026-02-23T08:04:50.870 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 270582939650 2026-02-23T08:04:50.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:04:51.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939650 -lt 270582939650 2026-02-23T08:04:51.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:51.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280522 2026-02-23T08:04:51.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:51.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:04:51.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280522 2026-02-23T08:04:51.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:51.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280522 2026-02-23T08:04:51.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280522' 2026-02-23T08:04:51.037 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 94489280522 2026-02-23T08:04:51.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:04:51.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280522 -lt 94489280522 2026-02-23T08:04:51.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:51.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-111669149705 2026-02-23T08:04:51.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:51.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:04:51.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-111669149705 2026-02-23T08:04:51.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149705 2026-02-23T08:04:51.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 111669149705' 2026-02-23T08:04:51.205 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 111669149705 2026-02-23T08:04:51.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:04:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149705 -lt 111669149705 2026-02-23T08:04:51.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:51.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986184 2026-02-23T08:04:51.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:51.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:04:51.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986184 2026-02-23T08:04:51.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:51.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986184 2026-02-23T08:04:51.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986184' 2026-02-23T08:04:51.371 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 133143986184 2026-02-23T08:04:51.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:04:51.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986184 -lt 133143986184 2026-02-23T08:04:51.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:51.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855368 2026-02-23T08:04:51.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:51.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:04:51.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855368 2026-02-23T08:04:51.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:51.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855368 2026-02-23T08:04:51.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855368' 2026-02-23T08:04:51.541 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 150323855368 2026-02-23T08:04:51.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:04:51.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855368 -lt 150323855368 2026-02-23T08:04:51.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:51.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724552 2026-02-23T08:04:51.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:51.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:04:51.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724552 2026-02-23T08:04:51.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:51.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724552 2026-02-23T08:04:51.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724552' 2026-02-23T08:04:51.709 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 167503724552 2026-02-23T08:04:51.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:04:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724552 -lt 167503724552 2026-02-23T08:04:51.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:04:51.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-184683593735 2026-02-23T08:04:51.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:04:51.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:04:51.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-184683593735 2026-02-23T08:04:51.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:04:51.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593735 2026-02-23T08:04:51.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 184683593735' 2026-02-23T08:04:51.875 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 184683593735 2026-02-23T08:04:51.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:04:52.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593735 -lt 184683593735 2026-02-23T08:04:52.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:04:52.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:52.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:04:52.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:04:52.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:04:52.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:04:52.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:04:52.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:04:52.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:04:52.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:04:52.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:04:52.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:04:52.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:04:52.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:04:52.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:04:52.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:04:52.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:04:52.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:04:52.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:04:52.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:04:52.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:04:52.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:04:52.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:04:52.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:04:52.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:04:52.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:04:52.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:52.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:52.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:52.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:52.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:52.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:04:53.098 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:04:53.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:53.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:04:53.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:53.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:53.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:39.782906+0000 '>' 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:53.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:54.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:54.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:54.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:54.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:54.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:54.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:54.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:54.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:39.782906+0000 '>' 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:54.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:55.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:55.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:55.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:55.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:55.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:55.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:55.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:55.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:39.782906+0000 '>' 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:55.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:56.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:56.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:56.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:56.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:56.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:56.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:56.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:56.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:39.782906+0000 '>' 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:56.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:57.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:57.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:57.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:57.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:57.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:57.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:57.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:57.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:39.782906+0000 '>' 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:57.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:04:58.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:04:58.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:04:58.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:04:58.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:04:58.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:04:58.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:04:58.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:04:59.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:53.132004+0000 '>' 2026-02-23T08:04:39.782906+0000 2026-02-23T08:04:59.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:04:59.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:04:59.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:04:59.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-23T08:04:59.484 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:04:59.484 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:04:59.484 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:04:59.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:04:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:start osd.9 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:04:59.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:04:59.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:04:59.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:04:59.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:04:59.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:04:59.554 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:59.552+0000 7fdf82681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:59.555 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:59.553+0000 7fdf82681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:59.556 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:59.554+0000 7fdf82681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:04:59.708 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:04:59.705+0000 7fdf82681780 -1 Falling back to public interface 2026-02-23T08:04:59.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:04:59.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:04:59.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:04:59.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:04:59.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:04:59.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:04:59.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:04:59.712 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:04:59.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:04:59.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:04:59.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:00.080 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:00.078+0000 7fdf82681780 -1 osd.9 66 log_to_monitors true 2026-02-23T08:05:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:00.879 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:05:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:01.049 INFO:tasks.workunit.client.0.trial129.stderr:osd.9 up in weight 1 up_from 69 up_thru 0 down_at 66 last_clean_interval [43,66) [v2:127.0.0.1:6874/1567041678,v1:127.0.0.1:6875/1567041678] [v2:127.0.0.1:6876/1567041678,v1:127.0.0.1:6877/1567041678] exists,up 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:05:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:01.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:01.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:01.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:01.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T08:05:01.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T08:05:01.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T08:05:01.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:01.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705678 2026-02-23T08:05:01.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705678 2026-02-23T08:05:01.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678' 2026-02-23T08:05:01.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-23T08:05:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-23T08:05:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157' 2026-02-23T08:05:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:01.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939653 2026-02-23T08:05:01.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939653 2026-02-23T08:05:01.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653' 2026-02-23T08:05:01.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:01.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280525 2026-02-23T08:05:01.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280525 2026-02-23T08:05:01.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653 4-94489280525' 2026-02-23T08:05:01.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:01.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149708 2026-02-23T08:05:01.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149708 2026-02-23T08:05:01.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653 4-94489280525 5-111669149708' 2026-02-23T08:05:01.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:01.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986188 2026-02-23T08:05:01.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986188 2026-02-23T08:05:01.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653 4-94489280525 5-111669149708 6-133143986188' 2026-02-23T08:05:01.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:01.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-23T08:05:01.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-23T08:05:01.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653 4-94489280525 5-111669149708 6-133143986188 7-150323855371' 2026-02-23T08:05:01.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:01.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724556 2026-02-23T08:05:01.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724556 2026-02-23T08:05:01.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653 4-94489280525 5-111669149708 6-133143986188 7-150323855371 8-167503724556' 2026-02-23T08:05:01.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:01.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:02.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743426 2026-02-23T08:05:02.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743426 2026-02-23T08:05:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494 1-38654705678 2-60129542157 3-270582939653 4-94489280525 5-111669149708 6-133143986188 7-150323855371 8-167503724556 9-296352743426' 2026-02-23T08:05:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:02.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T08:05:02.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:02.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:02.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T08:05:02.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T08:05:02.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T08:05:02.031 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836494 2026-02-23T08:05:02.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:02.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-23T08:05:02.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:03.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:03.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:03.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T08:05:03.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:03.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705678 2026-02-23T08:05:03.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:03.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:03.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705678 2026-02-23T08:05:03.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:03.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705678 2026-02-23T08:05:03.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705678' 2026-02-23T08:05:03.364 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705678 2026-02-23T08:05:03.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:03.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705678 -lt 38654705678 2026-02-23T08:05:03.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:03.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-23T08:05:03.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:03.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:03.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-23T08:05:03.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:03.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-23T08:05:03.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-23T08:05:03.536 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542157 2026-02-23T08:05:03.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:03.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542158 -lt 60129542157 2026-02-23T08:05:03.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:03.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939653 2026-02-23T08:05:03.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:03.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:03.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939653 2026-02-23T08:05:03.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:03.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939653 2026-02-23T08:05:03.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939653' 2026-02-23T08:05:03.707 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 270582939653 2026-02-23T08:05:03.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:03.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939653 -lt 270582939653 2026-02-23T08:05:03.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:03.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280525 2026-02-23T08:05:03.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:03.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:03.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280525 2026-02-23T08:05:03.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:03.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280525 2026-02-23T08:05:03.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280525' 2026-02-23T08:05:03.880 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 94489280525 2026-02-23T08:05:03.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:04.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280526 -lt 94489280525 2026-02-23T08:05:04.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:04.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-111669149708 2026-02-23T08:05:04.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:04.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:04.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-111669149708 2026-02-23T08:05:04.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:04.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149708 2026-02-23T08:05:04.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 111669149708' 2026-02-23T08:05:04.051 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 111669149708 2026-02-23T08:05:04.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:04.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149708 -lt 111669149708 2026-02-23T08:05:04.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:04.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986188 2026-02-23T08:05:04.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:04.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:04.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986188 2026-02-23T08:05:04.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:04.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986188 2026-02-23T08:05:04.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986188' 2026-02-23T08:05:04.218 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 133143986188 2026-02-23T08:05:04.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:04.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986188 -lt 133143986188 2026-02-23T08:05:04.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:04.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855371 2026-02-23T08:05:04.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:04.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:04.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855371 2026-02-23T08:05:04.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:04.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-23T08:05:04.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855371' 2026-02-23T08:05:04.386 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 150323855371 2026-02-23T08:05:04.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855372 -lt 150323855371 2026-02-23T08:05:04.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:04.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724556 2026-02-23T08:05:04.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:04.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:04.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724556 2026-02-23T08:05:04.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:04.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724556 2026-02-23T08:05:04.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724556' 2026-02-23T08:05:04.557 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 167503724556 2026-02-23T08:05:04.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:04.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724556 -lt 167503724556 2026-02-23T08:05:04.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:04.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-296352743426 2026-02-23T08:05:04.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:04.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:04.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-296352743426 2026-02-23T08:05:04.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:04.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743426 2026-02-23T08:05:04.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 296352743426' 2026-02-23T08:05:04.727 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 296352743426 2026-02-23T08:05:04.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:04.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743426 -lt 296352743426 2026-02-23T08:05:04.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:04.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:04.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:05.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:05.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:05.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:05.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:05.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:05.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:05.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:05.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:05.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:05.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:05.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:05.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:05.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:05.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:05.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:05.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:05:05.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:05:05.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:321: corrupt_and_repair_erasure_coded: corrupt_and_repair_one td/osd-scrub-repair ecpool 5 2026-02-23T08:05:05.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:05:05.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=ecpool 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=5 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:05.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:05.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:05.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:05.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:05.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:05.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:05:05.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:05.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:05.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-23T08:05:05.928 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:05.975 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:05.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:start osd.5 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:05.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:05:05.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:05:05.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:05.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:05.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:05.989 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:05.987+0000 7f9d11c09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:05.991 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:05.989+0000 7f9d11c09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:05.991 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:05.989+0000 7f9d11c09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:06.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:05:06.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:06.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:06.202 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:06.200+0000 7f9d11c09780 -1 Falling back to public interface 2026-02-23T08:05:06.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:06.554 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:06.552+0000 7f9d11c09780 -1 osd.5 71 log_to_monitors true 2026-02-23T08:05:07.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:07.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:07.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:07.313 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:05:07.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:07.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:osd.5 up in weight 1 up_from 74 up_thru 74 down_at 71 last_clean_interval [26,71) [v2:127.0.0.1:6842/492954177,v1:127.0.0.1:6843/492954177] [v2:127.0.0.1:6844/492954177,v1:127.0.0.1:6845/492954177] exists,up cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:07.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:07.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:07.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:07.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:07.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:07.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:07.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:07.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:07.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:07.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:07.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836497 2026-02-23T08:05:07.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836497 2026-02-23T08:05:07.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497' 2026-02-23T08:05:07.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:07.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:07.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705680 2026-02-23T08:05:07.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705680 2026-02-23T08:05:07.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680' 2026-02-23T08:05:07.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:07.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:07.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542160 2026-02-23T08:05:07.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542160 2026-02-23T08:05:07.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160' 2026-02-23T08:05:07.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:07.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:08.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939656 2026-02-23T08:05:08.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939656 2026-02-23T08:05:08.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656' 2026-02-23T08:05:08.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:08.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:08.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280528 2026-02-23T08:05:08.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280528 2026-02-23T08:05:08.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656 4-94489280528' 2026-02-23T08:05:08.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:08.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:08.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=317827579906 2026-02-23T08:05:08.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 317827579906 2026-02-23T08:05:08.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656 4-94489280528 5-317827579906' 2026-02-23T08:05:08.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:08.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:08.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986190 2026-02-23T08:05:08.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986190 2026-02-23T08:05:08.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656 4-94489280528 5-317827579906 6-133143986190' 2026-02-23T08:05:08.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:08.236 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:08.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855373 2026-02-23T08:05:08.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855373 2026-02-23T08:05:08.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656 4-94489280528 5-317827579906 6-133143986190 7-150323855373' 2026-02-23T08:05:08.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:08.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:08.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724558 2026-02-23T08:05:08.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724558 2026-02-23T08:05:08.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656 4-94489280528 5-317827579906 6-133143986190 7-150323855373 8-167503724558' 2026-02-23T08:05:08.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:08.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:08.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743428 2026-02-23T08:05:08.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743428 2026-02-23T08:05:08.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836497 1-38654705680 2-60129542160 3-270582939656 4-94489280528 5-317827579906 6-133143986190 7-150323855373 8-167503724558 9-296352743428' 2026-02-23T08:05:08.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:08.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836497 2026-02-23T08:05:08.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:08.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:08.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836497 2026-02-23T08:05:08.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:08.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836497 2026-02-23T08:05:08.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836497' 2026-02-23T08:05:08.462 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836497 2026-02-23T08:05:08.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:08.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836497 2026-02-23T08:05:08.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:08.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705680 2026-02-23T08:05:08.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:08.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:08.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705680 2026-02-23T08:05:08.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:08.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705680 2026-02-23T08:05:08.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705680' 2026-02-23T08:05:08.627 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705680 2026-02-23T08:05:08.627 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:08.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705680 -lt 38654705680 2026-02-23T08:05:08.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:08.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542160 2026-02-23T08:05:08.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:08.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:08.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542160 2026-02-23T08:05:08.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:08.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542160 2026-02-23T08:05:08.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542160' 2026-02-23T08:05:08.796 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542160 2026-02-23T08:05:08.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:08.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542160 -lt 60129542160 2026-02-23T08:05:08.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:08.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939656 2026-02-23T08:05:08.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:08.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:08.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939656 2026-02-23T08:05:08.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:08.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939656 2026-02-23T08:05:08.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939656' 2026-02-23T08:05:08.964 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 270582939656 2026-02-23T08:05:08.965 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:09.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939656 -lt 270582939656 2026-02-23T08:05:09.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:09.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280528 2026-02-23T08:05:09.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:09.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:09.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280528 2026-02-23T08:05:09.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:09.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280528 2026-02-23T08:05:09.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280528' 2026-02-23T08:05:09.130 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 94489280528 2026-02-23T08:05:09.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:09.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280528 -lt 94489280528 2026-02-23T08:05:09.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:09.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-317827579906 2026-02-23T08:05:09.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:09.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:09.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-317827579906 2026-02-23T08:05:09.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:09.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=317827579906 2026-02-23T08:05:09.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 317827579906' 2026-02-23T08:05:09.302 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 317827579906 2026-02-23T08:05:09.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:09.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 317827579906 -lt 317827579906 2026-02-23T08:05:09.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:09.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986190 2026-02-23T08:05:09.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:09.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:09.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986190 2026-02-23T08:05:09.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:09.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986190 2026-02-23T08:05:09.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986190' 2026-02-23T08:05:09.470 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 133143986190 2026-02-23T08:05:09.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:09.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986189 -lt 133143986190 2026-02-23T08:05:09.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:10.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:10.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:10.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986190 -lt 133143986190 2026-02-23T08:05:10.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:10.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855373 2026-02-23T08:05:10.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:10.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855373 2026-02-23T08:05:10.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:10.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855373 2026-02-23T08:05:10.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855373' 2026-02-23T08:05:10.812 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 150323855373 2026-02-23T08:05:10.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:10.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855374 -lt 150323855373 2026-02-23T08:05:10.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:10.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724558 2026-02-23T08:05:10.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:10.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:10.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724558 2026-02-23T08:05:10.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:10.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724558 2026-02-23T08:05:10.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724558' 2026-02-23T08:05:10.980 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 167503724558 2026-02-23T08:05:10.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:11.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724558 -lt 167503724558 2026-02-23T08:05:11.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:11.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-296352743428 2026-02-23T08:05:11.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:11.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:11.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-296352743428 2026-02-23T08:05:11.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:11.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743428 2026-02-23T08:05:11.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 296352743428' 2026-02-23T08:05:11.153 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 296352743428 2026-02-23T08:05:11.153 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:11.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743429 -lt 296352743428 2026-02-23T08:05:11.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:11.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:11.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:11.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:11.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:11.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:11.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:11.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:11.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:11.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:11.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:11.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:11.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:11.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:11.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:11.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg ecpool SOMETHING 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:05:11.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:05:12.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=2.0 2026-02-23T08:05:12.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 2.0 2026-02-23T08:05:12.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:05:12.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:05:12.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:12.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:12.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:12.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:12.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:12.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:05:12.378 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:05:12.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:12.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:12.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:53.132004+0000 '>' 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:12.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:13.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:13.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:53.132004+0000 '>' 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:13.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:14.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:14.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:14.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:14.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:14.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:14.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:14.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:14.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:53.132004+0000 '>' 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:14.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:15.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:15.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:15.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:15.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:15.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:15.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:15.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:16.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:53.132004+0000 '>' 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:16.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:17.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:17.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:17.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:17.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:17.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:17.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:17.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:17.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:04:53.132004+0000 '>' 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:17.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:18.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:18.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:18.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:18.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:18.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:18.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:18.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:18.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:13.039414+0000 '>' 2026-02-23T08:04:53.132004+0000 2026-02-23T08:05:18.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:18.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:05:18.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:18.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:18.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:18.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:18.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:18.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:18.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:18.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:18.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:18.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:05:18.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:18.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:05:18.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-23T08:05:18.563 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:05:18.563 INFO:tasks.workunit.client.0.trial129.stdout:hinfo_key 2026-02-23T08:05:18.563 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:18.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:18.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:start osd.9 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:18.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:05:18.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:05:18.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:18.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:18.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:18.621 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:18.619+0000 7f8ffeb7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:18.623 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:18.621+0000 7f8ffeb7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:18.623 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:18.622+0000 7f8ffeb7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:18.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:05:18.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:18.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:18.819 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:18.817+0000 7f8ffeb7b780 -1 Falling back to public interface 2026-02-23T08:05:18.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:19.174 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:19.172+0000 7f8ffeb7b780 -1 osd.9 75 log_to_monitors true 2026-02-23T08:05:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:19.942 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:05:19.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:19.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:20.109 INFO:tasks.workunit.client.0.trial129.stderr:osd.9 up in weight 1 up_from 79 up_thru 0 down_at 76 last_clean_interval [69,75) [v2:127.0.0.1:6874/1818973103,v1:127.0.0.1:6875/1818973103] [v2:127.0.0.1:6876/1818973103,v1:127.0.0.1:6877/1818973103] exists,up 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:05:20.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:20.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:20.111 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:20.111 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:20.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:20.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:20.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:20.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:20.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:20.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:20.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:20.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:20.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:20.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:20.355 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:3 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:4 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:5 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:6 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:7 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:8 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:9' 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:20.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836500 2026-02-23T08:05:20.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836500 2026-02-23T08:05:20.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500' 2026-02-23T08:05:20.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:20.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705684 2026-02-23T08:05:20.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705684 2026-02-23T08:05:20.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684' 2026-02-23T08:05:20.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:20.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542163 2026-02-23T08:05:20.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542163 2026-02-23T08:05:20.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163' 2026-02-23T08:05:20.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:20.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939659 2026-02-23T08:05:20.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939659 2026-02-23T08:05:20.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659' 2026-02-23T08:05:20.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:20.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280531 2026-02-23T08:05:20.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280531 2026-02-23T08:05:20.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659 4-94489280531' 2026-02-23T08:05:20.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:20.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=317827579909 2026-02-23T08:05:20.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 317827579909 2026-02-23T08:05:20.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659 4-94489280531 5-317827579909' 2026-02-23T08:05:20.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:20.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986193 2026-02-23T08:05:20.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986193 2026-02-23T08:05:20.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659 4-94489280531 5-317827579909 6-133143986193' 2026-02-23T08:05:20.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:20.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855377 2026-02-23T08:05:20.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855377 2026-02-23T08:05:20.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659 4-94489280531 5-317827579909 6-133143986193 7-150323855377' 2026-02-23T08:05:20.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:20.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:21.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724562 2026-02-23T08:05:21.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724562 2026-02-23T08:05:21.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659 4-94489280531 5-317827579909 6-133143986193 7-150323855377 8-167503724562' 2026-02-23T08:05:21.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:21.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:21.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=339302416386 2026-02-23T08:05:21.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 339302416386 2026-02-23T08:05:21.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500 1-38654705684 2-60129542163 3-270582939659 4-94489280531 5-317827579909 6-133143986193 7-150323855377 8-167503724562 9-339302416386' 2026-02-23T08:05:21.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:21.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836500 2026-02-23T08:05:21.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:21.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:21.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836500 2026-02-23T08:05:21.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:21.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836500 2026-02-23T08:05:21.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2026-02-23T08:05:21.100 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836500 2026-02-23T08:05:21.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:21.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836500 2026-02-23T08:05:21.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:22.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:22.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836500 2026-02-23T08:05:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:22.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705684 2026-02-23T08:05:22.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:22.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705684 2026-02-23T08:05:22.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:22.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705684 2026-02-23T08:05:22.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705684' 2026-02-23T08:05:22.434 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 38654705684 2026-02-23T08:05:22.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:22.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705684 -lt 38654705684 2026-02-23T08:05:22.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:22.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542163 2026-02-23T08:05:22.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:22.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:22.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542163 2026-02-23T08:05:22.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:22.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542163 2026-02-23T08:05:22.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542163' 2026-02-23T08:05:22.600 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542163 2026-02-23T08:05:22.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:22.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542164 -lt 60129542163 2026-02-23T08:05:22.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:22.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939659 2026-02-23T08:05:22.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:22.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:22.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939659 2026-02-23T08:05:22.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:22.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939659 2026-02-23T08:05:22.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939659' 2026-02-23T08:05:22.770 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.3 seq 270582939659 2026-02-23T08:05:22.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:22.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939659 -lt 270582939659 2026-02-23T08:05:22.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:22.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280531 2026-02-23T08:05:22.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:22.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:22.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280531 2026-02-23T08:05:22.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:22.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280531 2026-02-23T08:05:22.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280531' 2026-02-23T08:05:22.943 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.4 seq 94489280531 2026-02-23T08:05:22.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:23.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280532 -lt 94489280531 2026-02-23T08:05:23.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:23.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-317827579909 2026-02-23T08:05:23.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:23.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:23.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-317827579909 2026-02-23T08:05:23.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:23.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=317827579909 2026-02-23T08:05:23.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 317827579909' 2026-02-23T08:05:23.115 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.5 seq 317827579909 2026-02-23T08:05:23.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:23.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 317827579910 -lt 317827579909 2026-02-23T08:05:23.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:23.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986193 2026-02-23T08:05:23.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:23.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:23.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986193 2026-02-23T08:05:23.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:23.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986193 2026-02-23T08:05:23.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986193' 2026-02-23T08:05:23.287 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.6 seq 133143986193 2026-02-23T08:05:23.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:23.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986194 -lt 133143986193 2026-02-23T08:05:23.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:23.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855377 2026-02-23T08:05:23.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:23.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:23.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855377 2026-02-23T08:05:23.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:23.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855377 2026-02-23T08:05:23.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855377' 2026-02-23T08:05:23.455 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.7 seq 150323855377 2026-02-23T08:05:23.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:23.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855377 -lt 150323855377 2026-02-23T08:05:23.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:23.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724562 2026-02-23T08:05:23.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:23.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:23.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724562 2026-02-23T08:05:23.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:23.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724562 2026-02-23T08:05:23.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724562' 2026-02-23T08:05:23.624 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.8 seq 167503724562 2026-02-23T08:05:23.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:23.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724562 -lt 167503724562 2026-02-23T08:05:23.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:23.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-339302416386 2026-02-23T08:05:23.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:23.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:23.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-339302416386 2026-02-23T08:05:23.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:23.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=339302416386 2026-02-23T08:05:23.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 339302416386' 2026-02-23T08:05:23.793 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.9 seq 339302416386 2026-02-23T08:05:23.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:23.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 339302416386 -lt 339302416386 2026-02-23T08:05:23.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:23.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:23.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:24.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:24.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:24.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:24.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:24.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:24.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:24.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:24.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:24.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:24.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:05:24.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:05:24.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:322: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 5 9 2026-02-23T08:05:24.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:05:24.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:05:24.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=5 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=9 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 605857"' 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 605857' 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 605858"' 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 605858' 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 605857 605858' 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 605857 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/605860: /' 2026-02-23T08:05:24.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:05:24.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/605862: /' 2026-02-23T08:05:25.050 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.050 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:25.050 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:05:25.050 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:25.051 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:25.053 INFO:tasks.workunit.client.0.trial129.stderr:605860: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:05:25.054 INFO:tasks.workunit.client.0.trial129.stderr:605860: start osd.5 2026-02-23T08:05:25.082 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:25.083 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING remove 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING remove 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: remove 2#2:eb822e21:::SOMETHING:head# 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:25.084 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:25.085 INFO:tasks.workunit.client.0.trial129.stderr:605862: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:05:25.086 INFO:tasks.workunit.client.0.trial129.stderr:605862: start osd.9 2026-02-23T08:05:26.558 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 2026-02-23T08:05:25.063+0000 7f9913f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 2026-02-23T08:05:25.064+0000 7f9913f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 2026-02-23T08:05:25.065+0000 7f9913f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 0 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 2026-02-23T08:05:25.287+0000 7f9913f4b780 -1 Falling back to public interface 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 2026-02-23T08:05:25.709+0000 7f9913f4b780 -1 osd.5 80 log_to_monitors true 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: 1 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: osd.5 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [74,80) [v2:127.0.0.1:6842/1670865542,v1:127.0.0.1:6843/1670865542] [v2:127.0.0.1:6844/1670865542,v1:127.0.0.1:6845/1670865542] exists,up cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:26.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:26.560 INFO:tasks.workunit.client.0.trial129.stderr:605860: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605860: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: 2026-02-23T08:05:25.095+0000 7ffbfb67c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: 2026-02-23T08:05:25.097+0000 7ffbfb67c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: 2026-02-23T08:05:25.098+0000 7ffbfb67c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:26.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: 0 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: 2026-02-23T08:05:25.322+0000 7ffbfb67c780 -1 Falling back to public interface 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: 2026-02-23T08:05:25.759+0000 7ffbfb67c780 -1 osd.9 80 log_to_monitors true 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: 1 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: osd.9 up in weight 1 up_from 85 up_thru 0 down_at 81 last_clean_interval [79,80) [v2:127.0.0.1:6874/2125401849,v1:127.0.0.1:6875/2125401849] [v2:127.0.0.1:6876/2125401849,v1:127.0.0.1:6877/2125401849] exists,up 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:26.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:27.106 INFO:tasks.workunit.client.0.trial129.stderr:605862: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:15933: get_timeout_delays: echo true 2026-02-23T08:05:27.106 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:27.106 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:27.106 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:27.106 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: 1 2026-02-23T08:05:27.107 INFO:tasks.workunit.client.0.trial129.stderr:605860: 2 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 3 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 4 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 5 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 6 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 7 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 8 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: 9' 2026-02-23T08:05:27.108 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836502 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836502 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502' 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:27.109 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705686 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705686 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686' 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542166 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542166 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166' 2026-02-23T08:05:27.110 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.111 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:27.111 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939661 2026-02-23T08:05:27.111 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939661 2026-02-23T08:05:27.111 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661' 2026-02-23T08:05:27.111 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.139 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtes: get_timeout_delays: echo true 2026-02-23T08:05:27.139 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:27.139 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:27.139 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 1 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 2 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 3 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 4 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 5 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 6 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 7 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 8 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: 9' 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836503 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836503 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503' 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705687 2026-02-23T08:05:27.140 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705687 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687' 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542167 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542167 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167' 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939662 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939662 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662' 2026-02-23T08:05:27.141 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtestt/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280534 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280534 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661 4-94489280534' 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661 4-94489280534 5-360777252866' 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986196 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986196 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661 4-94489280534 5-360777252866 6-133143986196' 2026-02-23T08:05:27.558 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855379 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855379 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661 4-94489280534 5-360777252866 6-133143986196 7-150323855379' 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724564 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724564 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661 4-94489280534 5-360777252866 6-133143986196 7-150323855379 8-167503724564' 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220162 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220162 2026-02-23T08:05:27.559 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836502 1-38654705686 2-60129542166 3-270582939661 4-94489280534 5-360777252866 6-133143986196 7-150323855379 8-167503724564 9-365072220162' 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home//clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280535 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280535 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662 4-94489280535' 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662 4-94489280535 5-360777252867' 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986197 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986197 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662 4-94489280535 5-360777252867 6-133143986197' 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855380 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855380 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662 4-94489280535 5-360777252867 6-133143986197 7-150323855380' 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724565 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724565 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662 4-94489280535 5-360777252867 6-133143986197 7-150323855380 8-167503724565' 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:27.591 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:27.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=365072220163 2026-02-23T08:05:27.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 365072220163 2026-02-23T08:05:27.592 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836503 1-38654705687 2-60129542167 3-270582939662 4-94489280535 5-360777252867 6-133143986197 7-150323855380 8-167503724565 9-365072220163' 2026-02-23T08:05:29.250 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/uubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.250 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836502 2026-02-23T08:05:29.250 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.250 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:29.250 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836502 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836502 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836502' 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.0 seq 21474836502 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836502 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:29.251 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836502 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705686 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705686 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705686 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705686' 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.1 seq 38654705686 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705687 -lt 38654705686 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.252 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542166 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542166 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542166 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542166' 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.2 seq 60129542166 2026-02-23T08:05:29.253 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:29.278 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: tesbuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.278 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836503 2026-02-23T08:05:29.278 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.278 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:29.278 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836503 2026-02-23T08:05:29.279 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.279 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836503 2026-02-23T08:05:29.279 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836503' 2026-02-23T08:05:29.279 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.0 seq 21474836503 2026-02-23T08:05:29.279 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:29.279 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836501 -lt 21474836503 2026-02-23T08:05:29.280 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:29.280 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:29.280 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:29.280 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836504 -lt 21474836503 2026-02-23T08:05:29.280 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.280 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705687 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705687 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705687 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705687' 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.1 seq 38654705687 2026-02-23T08:05:29.281 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705687 -lt 38654705687 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542167 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542167 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542167 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542167' 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.2 seq 60129542167 2026-02-23T08:05:29.282 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: testt 60129542167 -lt 60129542166 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939661 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939661 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939661 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939661' 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.3 seq 270582939661 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939663 -lt 270582939661 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280534 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.771 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280534 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280534 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280534' 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.4 seq 94489280534 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280535 -lt 94489280534 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-360777252866 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-360777252866 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 360777252866' 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.5 seq 360777252866 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252866 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986196 2026-02-23T08:05:29.772 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0 60129542167 -lt 60129542167 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939662 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939662 2026-02-23T08:05:29.798 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939662 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939662' 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.3 seq 270582939662 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939663 -lt 270582939662 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280535 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280535 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280535 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280535' 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.4 seq 94489280535 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280535 -lt 94489280535 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-360777252867 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-360777252867 2026-02-23T08:05:29.799 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 360777252867' 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.5 seq 360777252867 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252867 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986197 2026-02-23T08:05:29.800 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0//qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986196 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986196 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986196' 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.6 seq 133143986196 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986197 -lt 133143986196 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855379 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855379 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.289 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855379 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855379' 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.7 seq 150323855379 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855380 -lt 150323855379 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724564 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724564 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724564 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724564' 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.8 seq 167503724564 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724565 -lt 167503724564 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-365072220162 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-365072220162 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.290 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=365072220162 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:60586qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986197 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986197 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986197' 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.6 seq 133143986197 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986197 -lt 133143986197 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855380 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.319 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855380 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855380 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855380' 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.7 seq 150323855380 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855380 -lt 150323855380 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724565 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724565 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724565 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724565' 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.8 seq 167503724565 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724565 -lt 167503724565 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-365072220163 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-365072220163 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:30.320 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=365072220163 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:6058620: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 365072220162' 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: waiting osd.9 seq 365072220162 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 365072220163 -lt 365072220162 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:31.044 INFO:tasks.workunit.client.0.trial129.stderr:605860: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:31.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:31.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:31.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 605858 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 365072220163' 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: waiting osd.9 seq 365072220163 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 365072220163 -lt 365072220163 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:31.075 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:605862: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:605862: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:05:31.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:05:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:05:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:05:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:05:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:05:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:05:31.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:05:31.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:05:31.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:05:31.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:05:31.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:31.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:31.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:31.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:31.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:31.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:05:31.558 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:31.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:31.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:13.039414+0000 '>' 2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:32.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:32.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:32.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:32.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:32.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:32.735 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:32.735 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:32.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:13.039414+0000 '>' 2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:32.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:33.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:33.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:33.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:33.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:33.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:33.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:33.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:34.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:13.039414+0000 '>' 2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:34.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:35.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:35.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:35.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:35.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:35.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:35.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:35.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:32.145748+0000 '>' 2026-02-23T08:05:13.039414+0000 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 609282"' 2026-02-23T08:05:35.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 609282' 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 609283"' 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 609283' 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 609282 609283' 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 609282 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/609285: /' 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:35.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/609287: /' 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:35.659 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: _ 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: hinfo_key 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: snapset 2026-02-23T08:05:35.660 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:35.661 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:35.662 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:35.663 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:05:35.664 INFO:tasks.workunit.client.0.trial129.stderr:609285: start osd.5 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=9 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=9 2026-02-23T08:05:35.665 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.9 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 9 SOMETHING list-attrs 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=9 2026-02-23T08:05:35.666 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/9 SOMETHING list-attrs 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: _ 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: hinfo_key 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: snapset 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 9 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=9 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/9 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:35.667 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/9' 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/9/journal' 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:35.668 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:35.669 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/9 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.9 2026-02-23T08:05:35.670 INFO:tasks.workunit.client.0.trial129.stderr:609287: start osd.9 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 9 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/9 --osd-journal=td/osd-scrub-repair/9/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: 2026-02-23T08:05:35.672+0000 7ff07937f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:37.170 INFO:tasks.workunit.client.0.trial129.stderr:609285: 2026-02-23T08:05:35.674+0000 7ff07937f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: 2026-02-23T08:05:35.675+0000 7ff07937f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: 0 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:37.171 INFO:tasks.workunit.client.0.trial129.stderr:609285: 2026-02-23T08:05:35.893+0000 7ff07937f780 -1 Falling back to public interface 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: 2026-02-23T08:05:36.314+0000 7ff07937f780 -1 osd.5 86 log_to_monitors true 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: 1 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: osd.5 up in weight 1 up_from 90 up_thru 90 down_at 87 last_clean_interval [84,86) [v2:127.0.0.1:6846/3944911274,v1:127.0.0.1:6848/3944911274] [v2:127.0.0.1:6874/3944911274,v1:127.0.0.1:6876/3944911274] exists,up cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:37.172 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:37.173 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:37.173 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:37.173 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:37.173 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:37.173 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:37.173 INFO:tasks.workunit.client.0.trial129.stderr:609285: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609285: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helprecovery_ops 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/9/whoami 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 9 = 9 ']' 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: 2026-02-23T08:05:35.676+0000 7f50dd80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: 2026-02-23T08:05:35.677+0000 7f50dd80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:37.174 INFO:tasks.workunit.client.0.trial129.stderr:609287: 2026-02-23T08:05:35.678+0000 7f50dd80f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 9 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=9 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: 0 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: 2026-02-23T08:05:35.892+0000 7f50dd80f780 -1 Falling back to public interface 2026-02-23T08:05:37.175 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: 2026-02-23T08:05:36.309+0000 7f50dd80f780 -1 osd.9 86 log_to_monitors true 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: 1 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.9 up' 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: osd.9 up in weight 1 up_from 90 up_thru 0 down_at 87 last_clean_interval [85,86) [v2:127.0.0.1:6842/1517619294,v1:127.0.0.1:6843/1517619294] [v2:127.0.0.1:6844/1517619294,v1:127.0.0.1:6845/1517619294] exists,up 867c0021-2e15-48f1-baf6-e71b211ab65c 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:37.176 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:37.177 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:37.177 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:37.177 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:37.177 INFO:tasks.workunit.client.0.trial129.stderr:609287: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 1 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 2 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 3 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 4 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 5 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 6 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 7 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 8 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: 9' 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836508 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836508 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508' 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705691 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705691 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691' 2026-02-23T08:05:37.719 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542170 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542170 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170' 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939666 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939666 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666' 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubunters.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 1 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 2 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 3 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 4 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 5 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 6 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 7 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 8 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: 9' 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705690 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705690 2026-02-23T08:05:37.720 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690' 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542171 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542171 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171' 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939667 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939667 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667' 2026-02-23T08:05:37.721 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280539 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280539 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667 4-94489280539' 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:38.165 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056642 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056642 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667 4-94489280539 5-386547056642' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986201 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986201 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667 4-94489280539 5-386547056642 6-133143986201' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855383 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855383 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667 4-94489280539 5-386547056642 6-133143986201 7-150323855383' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724568 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724568 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667 4-94489280539 5-386547056642 6-133143986201 7-150323855383 8-167503724568' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690 2-60129542171 3-270582939667 4-94489280539 5-386547056642 6-133143986201 7-150323855383 8-167503724568 9-386547056643' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:6092u/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280538 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280538 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666 4-94489280538' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666 4-94489280538 5-386547056643' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986200 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986200 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666 4-94489280538 5-386547056643 6-133143986200' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855384 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855384 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666 4-94489280538 5-386547056643 6-133143986200 7-150323855384' 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.166 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724569 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724569 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666 4-94489280538 5-386547056643 6-133143986200 7-150323855384 8-167503724569' 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056642 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056642 2026-02-23T08:05:38.167 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836508 1-38654705691 2-60129542170 3-270582939666 4-94489280538 5-386547056643 6-133143986200 7-150323855384 8-167503724569 9-386547056642' 2026-02-23T08:05:38.679 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.679 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836508 2026-02-23T08:05:38.679 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.679 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836508 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836508 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836508' 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.0 seq 21474836508 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836508 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705691 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705691 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:38.680 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705691 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705691' 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.1 seq 38654705691 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705691 -lt 38654705691 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542170 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542170 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542170 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542170' 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.2 seq 60129542170 2026-02-23T08:05:38.681 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:38.682 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542171 -lt 60129542170 2026-02-23T08:05:38.682 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.682 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939666 2026-02-23T08:05:38.682 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.683 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_sta85: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.683 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.0 seq 21474836507 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836507 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705690 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:38.684 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705690 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705690 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705690' 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.1 seq 38654705690 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705691 -lt 38654705690 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542171 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542171 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542171 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542171' 2026-02-23T08:05:38.685 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.2 seq 60129542171 2026-02-23T08:05:38.686 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:38.686 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542171 -lt 60129542171 2026-02-23T08:05:38.686 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:38.686 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-270582939667 2026-02-23T08:05:38.686 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.192 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stts: osd=3 2026-02-23T08:05:39.192 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939666 2026-02-23T08:05:39.192 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.192 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939666 2026-02-23T08:05:39.192 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939666' 2026-02-23T08:05:39.192 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.3 seq 270582939666 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939667 -lt 270582939666 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280538 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280538 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280538 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280538' 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.4 seq 94489280538 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:39.193 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280539 -lt 94489280538 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-386547056643 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-386547056643 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056643 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 386547056643' 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.5 seq 386547056643 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986200 2026-02-23T08:05:39.194 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.195 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:39.195 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986200 2026-02-23T08:05:39.195 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.195 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986200 2026-02-23T08:05:39.197 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceats: osd=3 2026-02-23T08:05:39.197 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-270582939667 2026-02-23T08:05:39.197 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939667 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 270582939667' 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.3 seq 270582939667 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939667 -lt 270582939667 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280539 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280539 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280539 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280539' 2026-02-23T08:05:39.198 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.4 seq 94489280539 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280539 -lt 94489280539 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-386547056642 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-386547056642 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056642 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 386547056642' 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.5 seq 386547056642 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056643 -lt 386547056642 2026-02-23T08:05:39.199 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.200 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986201 2026-02-23T08:05:39.200 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.200 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:39.200 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986201 2026-02-23T08:05:39.200 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.200 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986201 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/cph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986200' 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.6 seq 133143986200 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986201 -lt 133143986200 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855384 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855384 2026-02-23T08:05:39.878 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855384 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855384' 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.7 seq 150323855384 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855384 -lt 150323855384 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724569 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724569 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724569 2026-02-23T08:05:39.879 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724569' 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.8 seq 167503724569 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724569 -lt 167503724569 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-386547056642 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056642 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056642 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 386547056642' 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: waiting osd.9 seq 386547056642 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:39.880 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056643 -lt 386547056642 2026-02-23T08:05:39.881 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.clieeph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986201' 2026-02-23T08:05:39.881 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.6 seq 133143986201 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986201 -lt 133143986201 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855383 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855383 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855383 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855383' 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.7 seq 150323855383 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855384 -lt 150323855383 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724568 2026-02-23T08:05:39.882 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724568 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724568 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724568' 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.8 seq 167503724568 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724569 -lt 167503724568 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-386547056643 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056643 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056643 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 386547056643' 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: waiting osd.9 seq 386547056643 2026-02-23T08:05:39.883 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:39.884 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-23T08:05:40.465 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.clint.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:40.465 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:40.465 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:40.466 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:40.467 INFO:tasks.workunit.client.0.trial129.stderr:609287: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:40.467 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:40.467 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:40.467 INFO:tasks.workunit.client.0.trial129.stderr:609287: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:40.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:ent.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:40.469 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:609285: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:40.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 609283 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:05:40.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:05:40.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:05:40.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:323: corrupt_and_repair_erasure_coded: corrupt_and_repair_two td/osd-scrub-repair ecpool 3 5 2026-02-23T08:05:40.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:245: corrupt_and_repair_two: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:246: corrupt_and_repair_two: local poolname=ecpool 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:247: corrupt_and_repair_two: local first=3 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:248: corrupt_and_repair_two: local second=5 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:253: corrupt_and_repair_two: pids= 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:254: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 612147"' 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 612147' 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:255: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:40.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 612148"' 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 612148' 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:256: corrupt_and_repair_two: wait_background pids 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 612147 612148' 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 612147 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/612150: /' 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:40.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/612152: /' 2026-02-23T08:05:40.973 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.973 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:05:40.974 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: remove 0#2:eb822e21:::SOMETHING:head# 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:40.975 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: 612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.976 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING remove 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING remove 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: remove 1#2:eb822e21:::SOMETHING:head# 2026-02-23T08:05:40.977 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:05:40.978 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:40.979 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612150: start osd.3 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_oactivate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:40.980 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:05:40.981 INFO:tasks.workunit.client.0.trial129.stderr:612152: start osd.5 2026-02-23T08:05:42.480 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:42.480 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 2026-02-23T08:05:40.986+0000 7ff17ff4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 2026-02-23T08:05:40.988+0000 7ff17ff4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 2026-02-23T08:05:40.989+0000 7ff17ff4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 0 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 2026-02-23T08:05:41.237+0000 7ff17ff4d780 -1 Falling back to public interface 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 2026-02-23T08:05:41.654+0000 7ff17ff4d780 -1 osd.5 92 log_to_monitors true 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: 1 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: osd.5 up in weight 1 up_from 97 up_thru 97 down_at 93 last_clean_interval [90,92) [v2:127.0.0.1:6826/2160086690,v1:127.0.0.1:6827/2160086690] [v2:127.0.0.1:6828/2160086690,v1:127.0.0.1:6829/2160086690] exists,up cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:42.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612152: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159ps 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: 2026-02-23T08:05:40.987+0000 7f1a34e94780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: 2026-02-23T08:05:40.988+0000 7f1a34e94780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: 2026-02-23T08:05:40.989+0000 7f1a34e94780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: 0 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:05:42.484 INFO:tasks.workunit.client.0.trial129.stderr:612150: 2026-02-23T08:05:41.253+0000 7f1a34e94780 -1 Falling back to public interface 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: 2026-02-23T08:05:41.669+0000 7f1a34e94780 -1 osd.3 92 log_to_monitors true 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: 1 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: osd.3 up in weight 1 up_from 97 up_thru 97 down_at 93 last_clean_interval [63,92) [v2:127.0.0.1:6846/2936688299,v1:127.0.0.1:6848/2936688299] [v2:127.0.0.1:6874/2936688299,v1:127.0.0.1:6876/2936688299] exists,up b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:42.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:43.030 INFO:tasks.workunit.client.0.trial129.stderr:612150: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:43.030 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:43.030 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:43.030 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 1 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 2 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 3 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 4 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 5 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 6 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 7 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 8 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: 9' 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836510 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836510 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510' 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705693 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705693 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693' 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.031 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542173 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542173 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173' 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=416611827714 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 416611827714 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714' 2026-02-23T08:05:43.032 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.036 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtes3: get_timeout_delays: echo true 2026-02-23T08:05:43.036 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:43.036 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:43.036 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:43.036 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:43.036 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 1 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 2 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 3 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 4 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 5 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 6 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 7 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 8 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: 9' 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705694 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705694 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694' 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542174 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542174 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174' 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=416611827715 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 416611827715 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715' 2026-02-23T08:05:43.037 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280541 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280541 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714 4-94489280541' 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=416611827714 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 416611827714 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714 4-94489280541 5-416611827714' 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986203 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986203 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714 4-94489280541 5-416611827714 6-133143986203' 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855386 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855386 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714 4-94489280541 5-416611827714 6-133143986203 7-150323855386' 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724571 2026-02-23T08:05:43.481 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724571 2026-02-23T08:05:43.482 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714 4-94489280541 5-416611827714 6-133143986203 7-150323855386 8-167503724571' 2026-02-23T08:05:43.482 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.482 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:43.482 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056645 2026-02-23T08:05:43.482 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056645 2026-02-23T08:05:43.482 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836510 1-38654705693 2-60129542173 3-416611827714 4-94489280541 5-416611827714 6-133143986203 7-150323855386 8-167503724571 9-386547056645' 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/t/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280542 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280542 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715 4-94489280542' 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=416611827715 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 416611827715 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715 4-94489280542 5-416611827715' 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986204 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986204 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715 4-94489280542 5-416611827715 6-133143986204' 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855387 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855387 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715 4-94489280542 5-416611827715 6-133143986204 7-150323855387' 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724572 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724572 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715 4-94489280542 5-416611827715 6-133143986204 7-150323855387 8-167503724572' 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056646 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056646 2026-02-23T08:05:43.485 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705694 2-60129542174 3-416611827715 4-94489280542 5-416611827715 6-133143986204 7-150323855387 8-167503724572 9-386547056646' 2026-02-23T08:05:45.165 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.165 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836510 2026-02-23T08:05:45.165 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.165 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:45.165 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836510 2026-02-23T08:05:45.165 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836510 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836510' 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.0 seq 21474836510 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836510 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836510 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705693 2026-02-23T08:05:45.166 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705693 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705693 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705693' 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.1 seq 38654705693 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705694 -lt 38654705693 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542173 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.167 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542173 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542173 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542173' 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.2 seq 60129542173 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: tesubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.168 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.0 seq 21474836511 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836511 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836511 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705694 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.169 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705694 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705694 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705694' 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.1 seq 38654705694 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705694 -lt 38654705694 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542174 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542174 2026-02-23T08:05:45.170 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.171 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542174 2026-02-23T08:05:45.171 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542174' 2026-02-23T08:05:45.171 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.2 seq 60129542174 2026-02-23T08:05:45.171 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542174 -lt 60129542174 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-416611827715 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-416611827715 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=416611827715 2026-02-23T08:05:45.677 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 416611827715' 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.3 seq 416611827715 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 416611827715 -lt 416611827715 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280542 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280542 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280542 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280542' 2026-02-23T08:05:45.678 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.4 seq 94489280542 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280542 -lt 94489280542 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-416611827715 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-416611827715 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=416611827715 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 416611827715' 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.5 seq 416611827715 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:45.679 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 416611827715 -lt 416611827715 2026-02-23T08:05:45.680 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.680 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986204 2026-02-23T08:05:45.680 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0t 60129542174 -lt 60129542173 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-416611827714 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-416611827714 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=416611827714 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 416611827714' 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.3 seq 416611827714 2026-02-23T08:05:45.683 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 416611827715 -lt 416611827714 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280541 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280541 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280541 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280541' 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.4 seq 94489280541 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:45.684 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280542 -lt 94489280541 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-416611827714 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-416611827714 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=416611827714 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 416611827714' 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.5 seq 416611827714 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 416611827715 -lt 416611827714 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:45.685 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986203 2026-02-23T08:05:45.686 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986204 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986204 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986204' 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.6 seq 133143986204 2026-02-23T08:05:46.197 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986204 -lt 133143986204 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855387 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855387 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855387 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855387' 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.7 seq 150323855387 2026-02-23T08:05:46.198 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855388 -lt 150323855387 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724572 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724572 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724572 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724572' 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.8 seq 167503724572 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724572 -lt 167503724572 2026-02-23T08:05:46.199 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:46.200 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-386547056646 2026-02-23T08:05:46.200 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.200 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:46.200 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056646 2026-02-23T08:05:46.200 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.200 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056646 2026-02-23T08:05:46.202 INFO:tasks.workunit.client.0.trial129.stderr:61215/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:46.202 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986203 2026-02-23T08:05:46.202 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.202 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986203 2026-02-23T08:05:46.202 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986203' 2026-02-23T08:05:46.202 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.6 seq 133143986203 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986204 -lt 133143986203 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855386 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855386 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855386 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855386' 2026-02-23T08:05:46.203 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.7 seq 150323855386 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855388 -lt 150323855386 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724571 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724571 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724571 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724571' 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.8 seq 167503724571 2026-02-23T08:05:46.204 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724572 -lt 167503724571 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-386547056645 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056645 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:46.205 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056645 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 386547056646' 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: waiting osd.9 seq 386547056646 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056646 -lt 386547056646 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:46.963 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612150: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 612148 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:2: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 386547056645' 2026-02-23T08:05:46.964 INFO:tasks.workunit.client.0.trial129.stderr:612152: waiting osd.9 seq 386547056645 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056646 -lt 386547056645 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:612152: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:46.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:257: corrupt_and_repair_two: return_code=0 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:258: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: get_pg ecpool SOMETHING 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:05:46.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:263: corrupt_and_repair_two: local pg=2.0 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:264: corrupt_and_repair_two: repair 2.0 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:47.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:47.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:47.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:05:47.452 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.3 to repair 2026-02-23T08:05:47.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:05:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:05:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:05:47.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:47.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:47.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:47.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:47.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:47.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:47.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:32.145748+0000 '>' 2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:47.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:48.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:48.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:48.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:48.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:48.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:48.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:48.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:48.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:32.145748+0000 '>' 2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:48.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:49.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:49.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:49.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:49.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:49.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:49.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:49.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:49.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:32.145748+0000 '>' 2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:49.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:50.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:50.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:50.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:50.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:50.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:50.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:50.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:51.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:32.145748+0000 '>' 2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:51.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:05:52.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:05:52.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:05:52.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:05:52.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:05:52.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:05:52.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:05:52.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:05:52.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:05:47.676199+0000 '>' 2026-02-23T08:05:32.145748+0000 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:268: corrupt_and_repair_two: pids= 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:269: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 615597"' 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 615597' 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:270: corrupt_and_repair_two: run_in_background pids objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 615598"' 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 615598' 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:271: corrupt_and_repair_two: wait_background pids 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 615597 615598' 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 615597 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:05:52.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/615600: /' 2026-02-23T08:05:52.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:52.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/615602: /' 2026-02-23T08:05:52.701 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.702 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:52.702 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:05:52.702 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:52.702 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:05:52.702 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.702 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:52.703 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING list-attrs 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:05:52.704 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING list-attrs 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: Error getting attr on : 2.0s0_head,0#-4:00000000:::deep_scrub_2.0s0:head#, (61) No data available 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: Error getting attr on : 2.0s0_head,0#-4:00000000:::scrub_2.0s0:head#, (61) No data available 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: _ 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: hinfo_key 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: snapset 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.705 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:52.706 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:05:52.706 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:52.706 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:05:52.706 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:52.707 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:52.707 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:52.707 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:52.707 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:52.708 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:52.709 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:05:52.710 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615600: start osd.3 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$n615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=5 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:52.711 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.712 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:05:52.712 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=5 2026-02-23T08:05:52.712 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:05:52.712 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.5 2026-02-23T08:05:52.713 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:52.713 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:52.714 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:52.714 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:52.714 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:52.714 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:52.714 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 5 SOMETHING list-attrs 2026-02-23T08:05:52.714 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=5 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/5 SOMETHING list-attrs 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: _ 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: hinfo_key 2026-02-23T08:05:52.715 INFO:tasks.workunit.client.0.trial129.stderr:615602: snapset 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 5 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=5 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/5 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:52.716 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/5' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/5/journal' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/5 2026-02-23T08:05:52.717 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.5 2026-02-23T08:05:52.718 INFO:tasks.workunit.client.0.trial129.stderr:615602: start osd.5 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 5 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/5 --osd-journal=td/osd-scrub-repair/5/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_ame.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 2026-02-23T08:05:52.713+0000 7f7e2a74a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 2026-02-23T08:05:52.714+0000 7f7e2a74a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 2026-02-23T08:05:52.715+0000 7f7e2a74a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 0 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 2026-02-23T08:05:52.925+0000 7f7e2a74a780 -1 Falling back to public interface 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 2026-02-23T08:05:53.363+0000 7f7e2a74a780 -1 osd.3 98 log_to_monitors true 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: 1 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: osd.3 up in weight 1 up_from 102 up_thru 102 down_at 99 last_clean_interval [97,98) [v2:127.0.0.1:6826/1216411804,v1:127.0.0.1:6827/1216411804] [v2:127.0.0.1:6828/1216411804,v1:127.0.0.1:6829/1216411804] exists,up b80f5aef-b503-4374-bf6f-4ffd6ddae76d 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:54.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeorecovery_ops 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/5/whoami 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 5 = 5 ']' 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 2026-02-23T08:05:52.719+0000 7fdef3d8a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 2026-02-23T08:05:52.721+0000 7fdef3d8a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 2026-02-23T08:05:52.722+0000 7fdef3d8a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 5 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=5 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 0 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 2026-02-23T08:05:52.932+0000 7fdef3d8a780 -1 Falling back to public interface 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 2026-02-23T08:05:53.368+0000 7fdef3d8a780 -1 osd.5 98 log_to_monitors true 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: 1 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.5 up' 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: osd.5 up in weight 1 up_from 102 up_thru 102 down_at 99 last_clean_interval [97,98) [v2:127.0.0.1:6846/2515302531,v1:127.0.0.1:6848/2515302531] [v2:127.0.0.1:6874/2515302531,v1:127.0.0.1:6876/2515302531] exists,up cbdc38de-b88d-4bb8-b38c-e235d2cad3a7 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:05:54.220 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:05:54.221 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:05:54.221 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:05:54.221 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:05:54.221 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:05:54.221 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:05:54.221 INFO:tasks.workunit.client.0.trial129.stderr:615602: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:54.768 INFO:tasks.workunit.client.0.trial129.stderr:615602: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-heut_delays 90 .1 2026-02-23T08:05:54.768 INFO:tasks.workunit.client.0.trial129.stderr:615600: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:05:54.768 INFO:tasks.workunit.client.0.trial129.stderr:615600: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:54.768 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:54.768 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 1 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 2 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 3 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 4 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 5 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 6 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 7 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 8 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: 9' 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:54.769 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836515 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836515 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515' 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705698 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705698 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698' 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542178 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542178 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178' 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664194 2026-02-23T08:05:54.770 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664194 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_lpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 1 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 2 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 3 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 4 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 5 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 6 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 7 2026-02-23T08:05:54.771 INFO:tasks.workunit.client.0.trial129.stderr:615602: 8 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: 9' 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514' 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705697 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705697 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697' 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542177 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542177 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177' 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664195 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664195 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195' 2026-02-23T08:05:54.772 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.214 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280546 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280546 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195 4-94489280546' 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664195 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664195 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195 4-94489280546 5-438086664195' 2026-02-23T08:05:55.215 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986208 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986208 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195 4-94489280546 5-438086664195 6-133143986208' 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855392 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855392 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195 4-94489280546 5-438086664195 6-133143986208 7-150323855392' 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.216 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724576 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724576 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195 4-94489280546 5-438086664195 6-133143986208 7-150323855392 8-167503724576' 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056649 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056649 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705697 2-60129542177 3-438086664195 4-94489280546 5-438086664195 6-133143986208 7-150323855392 8-167503724576 9-386547056649' 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:61pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194' 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.4 flush_pg_stats 2026-02-23T08:05:55.217 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=94489280545 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 94489280545 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194 4-94489280545' 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.5 flush_pg_stats 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=438086664194 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 438086664194 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194 4-94489280545 5-438086664194' 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.6 flush_pg_stats 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986207 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986207 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194 4-94489280545 5-438086664194 6-133143986207' 2026-02-23T08:05:55.218 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.7 flush_pg_stats 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855391 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855391 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194 4-94489280545 5-438086664194 6-133143986207 7-150323855391' 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.8 flush_pg_stats 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724575 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724575 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194 4-94489280545 5-438086664194 6-133143986207 7-150323855391 8-167503724575' 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.9 flush_pg_stats 2026-02-23T08:05:55.219 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056650 2026-02-23T08:05:55.220 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056650 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836515 1-38654705698 2-60129542178 3-438086664194 4-94489280545 5-438086664194 6-133143986207 7-150323855391 8-167503724575 9-386547056650' 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836515 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836515 2026-02-23T08:05:56.728 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836515 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836515' 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.0 seq 21474836515 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836513 -lt 21474836515 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836515 -lt 21474836515 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705698 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705698 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705698 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705698' 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.1 seq 38654705698 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705699 -lt 38654705698 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542178 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542178 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542178 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542178' 2026-02-23T08:05:56.729 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.2 seq 60129542178 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:6156005602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836514 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836514 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.0 seq 21474836514 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836513 -lt 21474836514 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836515 -lt 21474836514 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705697 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705697 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705697 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705697' 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.1 seq 38654705697 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705699 -lt 38654705697 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542177 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542177 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542177 2026-02-23T08:05:56.897 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542177' 2026-02-23T08:05:56.898 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.2 seq 60129542177 2026-02-23T08:05:56.898 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542178 -lt 60129542178 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-438086664194 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-438086664194 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664194 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 438086664194' 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.3 seq 438086664194 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664195 -lt 438086664194 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280545 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280545 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280545 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280545' 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.4 seq 94489280545 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280546 -lt 94489280545 2026-02-23T08:05:57.413 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-438086664194 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-438086664194 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664194 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 438086664194' 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.5 seq 438086664194 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664195 -lt 438086664194 2026-02-23T08:05:57.414 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalo_stats: test 60129542178 -lt 60129542177 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-438086664195 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-438086664195 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664195 2026-02-23T08:05:57.415 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 438086664195' 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.3 seq 438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664195 -lt 438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 4-94489280546 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=4 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 4-94489280546 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=94489280546 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.4 seq 94489280546' 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.4 seq 94489280546 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 4 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 94489280546 -lt 94489280546 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 5-438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=5 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 5-438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.5 seq 438086664195' 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.5 seq 438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 5 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 438086664195 -lt 438086664195 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986208 2026-02-23T08:05:57.416 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clne/ceph-helpers.sh:2266: flush_pg_stats: echo 6-133143986207 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986207 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986207 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986207' 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.6 seq 133143986207 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986209 -lt 133143986207 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855391 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855391 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855391 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855391' 2026-02-23T08:05:57.932 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.7 seq 150323855391 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855392 -lt 150323855391 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724575 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724575 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724575 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724575' 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.8 seq 167503724575 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724577 -lt 167503724575 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-386547056650 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:57.933 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056650 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615600: //homeone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=6 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 6-133143986208 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986208 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.6 seq 133143986208' 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.6 seq 133143986208 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 6 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986209 -lt 133143986208 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 7-150323855392 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=7 2026-02-23T08:05:57.934 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 7-150323855392 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855392 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.7 seq 150323855392' 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.7 seq 150323855392 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 7 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855392 -lt 150323855392 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 8-167503724576 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=8 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 8-167503724576 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724576 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.8 seq 167503724576' 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.8 seq 167503724576 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 8 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724577 -lt 167503724576 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 9-386547056649 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=9 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 9-386547056649 2026-02-23T08:05:57.935 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056649 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 386547056649' 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: waiting osd.9 seq 386547056649 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056650 -lt 386547056649 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:58.687 INFO:tasks.workunit.client.0.trial129.stderr:615602: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:58.688 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:58.688 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:58.688 INFO:tasks.workunit.client.0.trial129.stderr:615602: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:58.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056650 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.9 seq 386547056650' 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: waiting osd.9 seq 386547056650 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 9 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056650 -lt 386547056650 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:58.720 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:05:58.721 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:615600: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 615598 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:272: corrupt_and_repair_two: return_code=0 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:273: corrupt_and_repair_two: '[' 0 -ne 0 ']' 2026-02-23T08:05:58.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:275: corrupt_and_repair_two: rados --pool ecpool get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:05:58.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:276: corrupt_and_repair_two: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:05:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:05:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:05:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:05:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:05:58.736 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:58.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:58.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:58.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:58.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:58.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:58.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:05:58.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:05:58.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:05:58.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:05:58.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:05:58.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:05:58.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:05:58.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:05:58.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:05:58.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:05:58.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:05:58.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:05:58.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:05:58.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:05:58.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:58.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:05:58.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:05:58.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:05:58.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:05:58.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:05:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:05:58.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:05:58.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:05:58.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:05:58.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:05:58.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:05:58.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:05:58.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:05:58.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:05:58.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:05:58.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:05:58.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:05:58.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:05:58.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:05:58.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:05:58.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:58.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:05:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:05:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:05:58.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:05:58.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:05:58.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:58.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:58.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:05:58.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:05:58.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_and_repair_replicated td/osd-scrub-repair 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:94: TEST_corrupt_and_repair_replicated: local dir=td/osd-scrub-repair 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:95: TEST_corrupt_and_repair_replicated: local poolname=rbd 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:97: TEST_corrupt_and_repair_replicated: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:05:58.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:05:58.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-23T08:05:58.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:05:58.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:58.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:58.921 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:58.921 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:58.921 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:58.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:05:58.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:05:58.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:05:58.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:05:58.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:05:58.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:05:58.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:58.947 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:05:58.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:05:58.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:05:59.006 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:05:59.007 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:05:59.007 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:05:59.007 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:59.007 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:59.007 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:05:59.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:05:59.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:05:59.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:98: TEST_corrupt_and_repair_replicated: run_mgr td/osd-scrub-repair x 2026-02-23T08:05:59.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:05:59.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:05:59.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:05:59.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:05:59.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:05:59.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:59.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:05:59.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:05:59.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:99: TEST_corrupt_and_repair_replicated: run_osd td/osd-scrub-repair 0 2026-02-23T08:05:59.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:05:59.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:05:59.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:05:59.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:05:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:05:59.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:05:59.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:05:59.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=55c3e5a4-5b54-4049-b3e7-c65b10886828 2026-02-23T08:05:59.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 55c3e5a4-5b54-4049-b3e7-c65b10886828' 2026-02-23T08:05:59.181 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 55c3e5a4-5b54-4049-b3e7-c65b10886828 2026-02-23T08:05:59.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:05:59.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBnCpxppppJCxAALjT2IiOtBz2VvaswTP0TOw== 2026-02-23T08:05:59.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBnCpxppppJCxAALjT2IiOtBz2VvaswTP0TOw=="}' 2026-02-23T08:05:59.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 55c3e5a4-5b54-4049-b3e7-c65b10886828 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:05:59.279 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:05:59.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:05:59.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBnCpxppppJCxAALjT2IiOtBz2VvaswTP0TOw== --osd-uuid 55c3e5a4-5b54-4049-b3e7-c65b10886828 2026-02-23T08:05:59.305 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.303+0000 7f329d808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:59.306 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.304+0000 7f329d808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:59.307 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.305+0000 7f329d808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:59.307 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.305+0000 7f329d808780 -1 bdev(0x559ef0c3f400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:05:59.307 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.306+0000 7f329d808780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:05:59.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:05:59.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:05:59.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:05:59.759 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:05:59.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:05:59.854 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:05:59.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:05:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:05:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:05:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:05:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:05:59.867 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.865+0000 7f0fb3150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:59.868 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.867+0000 7f0fb3150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:59.869 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:05:59.867+0000 7f0fb3150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:05:59.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:05:59.948 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:05:59.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:05:59.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:06:00.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:00.091 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:00.089+0000 7f0fb3150780 -1 Falling back to public interface 2026-02-23T08:06:00.378 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:00.376+0000 7f0fb3150780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:06:01.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:01.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:01.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:01.043 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:01.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:01.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:06:01.134 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3823906396,v1:127.0.0.1:6801/3823906396] [v2:127.0.0.1:6802/3823906396,v1:127.0.0.1:6803/3823906396] exists,up 55c3e5a4-5b54-4049-b3e7-c65b10886828 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:100: TEST_corrupt_and_repair_replicated: run_osd td/osd-scrub-repair 1 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:06:01.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:01.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:01.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b3d86a33-ac50-4f78-b9cc-622c083d2e2a' 2026-02-23T08:06:01.139 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:01.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:06:01.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBpCpxpjJq1CBAA7pz/qnNvMzw0oowgRB0IAg== 2026-02-23T08:06:01.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBpCpxpjJq1CBAA7pz/qnNvMzw0oowgRB0IAg=="}' 2026-02-23T08:06:01.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b3d86a33-ac50-4f78-b9cc-622c083d2e2a -i td/osd-scrub-repair/1/new.json 2026-02-23T08:06:01.233 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:01.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:06:01.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBpCpxpjJq1CBAA7pz/qnNvMzw0oowgRB0IAg== --osd-uuid b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:01.256 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.254+0000 7f4f37409780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:01.257 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.255+0000 7f4f37409780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:01.258 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.256+0000 7f4f37409780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:01.259 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.256+0000 7f4f37409780 -1 bdev(0x5586293ad400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:06:01.259 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.256+0000 7f4f37409780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:06:01.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:06:01.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:06:01.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:06:01.660 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:06:01.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:06:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:06:01.864 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:06:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:06:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:06:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:06:01.877 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.875+0000 7f3bec209780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:01.878 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.876+0000 7f3bec209780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:01.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:01.877+0000 7f3bec209780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:02.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:02.029 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:06:02.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:02.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:02.030 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:02.027+0000 7f3bec209780 -1 Falling back to public interface 2026-02-23T08:06:02.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:02.354 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:02.351+0000 7f3bec209780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:06:03.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:03.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:03.192 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:03.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:03.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:03.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:03.356 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4085555426,v1:127.0.0.1:6811/4085555426] [v2:127.0.0.1:6812/4085555426,v1:127.0.0.1:6813/4085555426] exists,up b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:03.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:03.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:03.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:03.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:101: TEST_corrupt_and_repair_replicated: create_rbd_pool 2026-02-23T08:06:03.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:06:03.512 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:06:03.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:06:03.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:06:03.731 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:06:03.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:06:04.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:06:05.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:102: TEST_corrupt_and_repair_replicated: wait_for_clean 2026-02-23T08:06:05.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:05.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:05.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:05.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:05.024 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:05.024 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:05.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:05.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:05.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:05.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:05.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:05.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:05.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:05.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:05.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:05.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:05.271 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:06:05.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:05.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:05.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:06:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:06:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:06:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:05.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:05.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-23T08:06:05.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-23T08:06:05.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-23T08:06:05.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:05.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:06:05.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:05.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:05.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:06:05.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:05.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:06:05.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:06:05.420 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:06:05.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:05.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:06:05.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:06.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:06.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:06.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:06:06.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:07.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:06:07.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:07.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-23T08:06:07.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:07.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-23T08:06:07.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:07.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:07.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-23T08:06:07.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:07.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-23T08:06:07.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-23T08:06:07.922 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672962 2026-02-23T08:06:07.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:08.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-23T08:06:08.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:08.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:08.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:08.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:06:08.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:08.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:08.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:08.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:08.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:08.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:08.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:06:08.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:06:08.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:06:08.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:08.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:08.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:06:08.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:06:08.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:06:08.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:104: TEST_corrupt_and_repair_replicated: add_something td/osd-scrub-repair rbd 2026-02-23T08:06:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:06:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-23T08:06:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:06:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:06:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:06:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:06:08.867 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:06:08.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:06:09.071 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:06:09.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:06:09.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:06:09.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:06:09.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:105: TEST_corrupt_and_repair_replicated: get_not_primary rbd SOMETHING 2026-02-23T08:06:09.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-23T08:06:09.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T08:06:09.101 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-23T08:06:09.101 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-23T08:06:09.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:06:09.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T08:06:09.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:06:09.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:06:09.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T08:06:09.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:06:09.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:105: TEST_corrupt_and_repair_replicated: corrupt_and_repair_one td/osd-scrub-repair rbd 0 2026-02-23T08:06:09.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:06:09.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=rbd 2026-02-23T08:06:09.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=0 2026-02-23T08:06:09.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:06:09.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:06:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:06:09.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:06:09.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:06:09.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:06:09.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T08:06:09.888 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:06:09.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:09.949 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:06:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:06:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:06:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:06:09.951 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:06:09.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:09.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:06:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:06:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:06:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:06:09.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:06:09.959 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:09.957+0000 7fd6a5c0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:09.961 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:09.959+0000 7fd6a5c0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:09.961 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:09.959+0000 7fd6a5c0d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:10.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:06:10.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:10.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:06:10.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:10.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:10.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:10.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:10.119 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:06:10.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:10.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:06:10.158 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:10.156+0000 7fd6a5c0d780 -1 Falling back to public interface 2026-02-23T08:06:10.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:10.526 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:10.524+0000 7fd6a5c0d780 -1 osd.0 20 log_to_monitors true 2026-02-23T08:06:11.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:11.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:11.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:11.280 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:06:11.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:11.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:06:11.447 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 24 up_thru 24 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/4189452319,v1:127.0.0.1:6801/4189452319] [v2:127.0.0.1:6802/4189452319,v1:127.0.0.1:6803/4189452319] exists,up 55c3e5a4-5b54-4049-b3e7-c65b10886828 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:11.448 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:11.449 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:11.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:11.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:11.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:11.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:11.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:11.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:11.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:11.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:11.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:11.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:11.688 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:06:11.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:11.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:11.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:11.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-23T08:06:11.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-23T08:06:11.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-23T08:06:11.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:11.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:11.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T08:06:11.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T08:06:11.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-42949672964' 2026-02-23T08:06:11.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:11.833 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-23T08:06:11.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:11.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:11.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-23T08:06:11.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:11.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-23T08:06:11.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-23T08:06:11.838 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215106 2026-02-23T08:06:11.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:12.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T08:06:12.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:13.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:13.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:13.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T08:06:13.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:14.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:06:14.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:14.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-23T08:06:14.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:14.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T08:06:14.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:14.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:14.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T08:06:14.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:14.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T08:06:14.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T08:06:14.343 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672964 2026-02-23T08:06:14.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:14.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-23T08:06:14.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:14.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:14.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:14.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:06:14.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:14.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:14.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:14.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:14.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:14.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:14.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:06:14.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:06:14.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:06:14.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:14.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:15.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:06:15.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:06:15.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:06:15.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg rbd SOMETHING 2026-02-23T08:06:15.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-23T08:06:15.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:06:15.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-23T08:06:15.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:06:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=1.3 2026-02-23T08:06:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 1.3 2026-02-23T08:06:15.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.3 2026-02-23T08:06:15.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.3 2026-02-23T08:06:15.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:15.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:15.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:15.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:15.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:15.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.3 2026-02-23T08:06:15.556 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T08:06:15.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.3 2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:15.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:15.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:15.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:15.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:03.729686+0000 '>' 2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:15.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:16.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:16.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:16.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:16.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:16.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:16.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:16.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:16.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:03.729686+0000 '>' 2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:16.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:17.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:17.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:17.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:17.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:17.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:17.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:17.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:18.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:03.729686+0000 '>' 2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:18.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:19.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:19.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:19.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:19.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:19.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:19.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:19.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:03.729686+0000 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:06:19.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:06:19.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:06:19.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:06:19.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:06:19.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:06:19.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:19.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T08:06:19.608 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T08:06:19.608 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T08:06:19.608 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:06:19.608 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:06:19.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:06:19.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:19.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:06:19.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:19.663 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:06:19.664 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:06:19.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:19.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:06:19.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:06:19.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:06:19.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:06:19.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:06:19.675 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:19.673+0000 7f8dad679780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:19.676 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:19.674+0000 7f8dad679780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:19.677 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:19.675+0000 7f8dad679780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:19.833 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:06:19.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:19.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:19.870 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:19.868+0000 7f8dad679780 -1 Falling back to public interface 2026-02-23T08:06:19.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:20.240 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:20.238+0000 7f8dad679780 -1 osd.1 27 log_to_monitors true 2026-02-23T08:06:20.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:21.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:21.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:21.000 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:06:21.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:21.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 30 up_thru 30 down_at 27 last_clean_interval [10,27) [v2:127.0.0.1:6810/402936486,v1:127.0.0.1:6811/402936486] [v2:127.0.0.1:6812/402936486,v1:127.0.0.1:6813/402936486] exists,up b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:21.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:21.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:21.167 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:21.167 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:21.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:21.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:21.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:21.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:21.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:21.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:21.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:21.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:21.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:21.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:21.412 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:06:21.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:21.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:21.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:21.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215109 2026-02-23T08:06:21.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215109 2026-02-23T08:06:21.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109' 2026-02-23T08:06:21.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:21.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:21.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018882 2026-02-23T08:06:21.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018882 2026-02-23T08:06:21.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109 1-128849018882' 2026-02-23T08:06:21.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:21.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215109 2026-02-23T08:06:21.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:21.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:21.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215109 2026-02-23T08:06:21.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:21.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215109 2026-02-23T08:06:21.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215109' 2026-02-23T08:06:21.565 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215109 2026-02-23T08:06:21.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:21.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215109 2026-02-23T08:06:21.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:22.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:22.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:22.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215109 2026-02-23T08:06:22.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:23.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:06:23.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:24.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215109 2026-02-23T08:06:24.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:24.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-128849018882 2026-02-23T08:06:24.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:24.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:24.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018882 2026-02-23T08:06:24.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:24.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=128849018882 2026-02-23T08:06:24.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 128849018882' 2026-02-23T08:06:24.071 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 128849018882 2026-02-23T08:06:24.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:24.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 128849018882 -lt 128849018882 2026-02-23T08:06:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:24.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:24.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:06:24.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:24.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:24.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:24.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:24.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:24.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:24.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:06:24.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:06:24.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:06:24.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:24.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:24.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:06:24.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:06:24.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:06:24.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:06:24.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:06:24.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:107: TEST_corrupt_and_repair_replicated: get_primary rbd SOMETHING 2026-02-23T08:06:24.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-23T08:06:24.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:06:24.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T08:06:24.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:107: TEST_corrupt_and_repair_replicated: corrupt_and_repair_one td/osd-scrub-repair rbd 1 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:286: corrupt_and_repair_one: local dir=td/osd-scrub-repair 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:287: corrupt_and_repair_one: local poolname=rbd 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:288: corrupt_and_repair_one: local osd=1 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:293: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:06:24.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:06:24.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING remove 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:06:25.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:25.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING remove 2026-02-23T08:06:25.224 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eb822e21:::SOMETHING:head# 2026-02-23T08:06:25.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:25.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:25.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:06:25.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:06:25.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:06:25.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:06:25.289 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:25.287+0000 7f9347966780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:25.291 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:25.289+0000 7f9347966780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:25.292 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:25.290+0000 7f9347966780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:25.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:25.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:25.462 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:25.459+0000 7f9347966780 -1 Falling back to public interface 2026-02-23T08:06:25.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:25.816 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:25.814+0000 7f9347966780 -1 osd.1 32 log_to_monitors true 2026-02-23T08:06:26.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:26.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:26.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:26.615 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:06:26.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:26.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:26.784 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 36 up_thru 36 down_at 33 last_clean_interval [30,32) [v2:127.0.0.1:6810/2770808948,v1:127.0.0.1:6811/2770808948] [v2:127.0.0.1:6812/2770808948,v1:127.0.0.1:6813/2770808948] exists,up b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:26.785 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:26.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:26.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:26.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:26.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:26.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:26.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:26.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:26.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:26.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:27.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:27.028 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:06:27.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:27.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:27.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:27.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215111 2026-02-23T08:06:27.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215111 2026-02-23T08:06:27.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215111' 2026-02-23T08:06:27.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:27.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:27.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822658 2026-02-23T08:06:27.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822658 2026-02-23T08:06:27.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215111 1-154618822658' 2026-02-23T08:06:27.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:27.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215111 2026-02-23T08:06:27.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:27.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:27.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215111 2026-02-23T08:06:27.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:27.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215111 2026-02-23T08:06:27.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215111' 2026-02-23T08:06:27.181 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215111 2026-02-23T08:06:27.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:27.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215111 -lt 103079215111 2026-02-23T08:06:27.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:27.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-154618822658 2026-02-23T08:06:27.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:27.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:27.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-154618822658 2026-02-23T08:06:27.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822658 2026-02-23T08:06:27.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 154618822658' 2026-02-23T08:06:27.348 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 154618822658 2026-02-23T08:06:27.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:27.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822658 2026-02-23T08:06:27.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:28.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:28.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:28.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 154618822658 2026-02-23T08:06:28.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:29.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:06:29.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:29.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822658 2026-02-23T08:06:29.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:29.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:29.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:30.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:06:30.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:30.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:30.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:30.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:30.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:30.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:30.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:06:30.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:06:30.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:06:30.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:30.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: get_pg rbd SOMETHING 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:06:30.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-23T08:06:30.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:06:30.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:297: corrupt_and_repair_one: local pg=1.3 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:298: corrupt_and_repair_one: repair 1.3 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.3 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.3 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:30.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:30.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:30.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.3 2026-02-23T08:06:30.906 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.3 on osd.1 to repair 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.3 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:30.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:30.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:31.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:31.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:32.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:32.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:32.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:32.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:32.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:32.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:32.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:32.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:32.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:33.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:33.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:33.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:33.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:33.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:33.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:33.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:33.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:34.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:34.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:34.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:34.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:34.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:34.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:34.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:34.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:35.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:35.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:35.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:35.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:35.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:35.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:35.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:35.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:35.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:36.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:36.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:36.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:36.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:36.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:36.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:36.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:36.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:16.271325+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:36.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:06:37.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:06:37.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:06:37.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:06:37.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:06:37.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:06:37.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:06:37.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:31.800973+0000 '>' 2026-02-23T08:06:16.271325+0000 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:302: corrupt_and_repair_one: objectstore_tool td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:06:38.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:06:38.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:06:38.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:06:38.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:06:38.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:06:38.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:06:38.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:06:38.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 SOMETHING list-attrs 2026-02-23T08:06:38.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:06:38.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:06:38.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:06:38.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:06:38.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:38.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 SOMETHING list-attrs 2026-02-23T08:06:38.255 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::deep_scrub_1.3:head#, (61) No data available 2026-02-23T08:06:38.256 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.3_head,#-3:c0000000:::scrub_1.3:head#, (61) No data available 2026-02-23T08:06:38.256 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:06:38.256 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:38.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:38.303 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:38.303 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:38.303 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:06:38.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:06:38.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:06:38.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:06:38.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:06:38.316 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:38.314+0000 7fe66c350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:38.317 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:38.315+0000 7fe66c350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:38.318 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:38.316+0000 7fe66c350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:38.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:38.539 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:38.537+0000 7fe66c350780 -1 Falling back to public interface 2026-02-23T08:06:38.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:38.878 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:38.877+0000 7fe66c350780 -1 osd.1 37 log_to_monitors true 2026-02-23T08:06:39.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:39.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:39.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:39.640 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:06:39.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:39.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 41 up_thru 41 down_at 38 last_clean_interval [36,37) [v2:127.0.0.1:6810/3440644090,v1:127.0.0.1:6811/3440644090] [v2:127.0.0.1:6812/3440644090,v1:127.0.0.1:6813/3440644090] exists,up b3d86a33-ac50-4f78-b9cc-622c083d2e2a 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:39.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:39.809 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:39.809 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:39.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:39.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:39.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:39.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:40.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:40.056 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:06:40.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:40.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:40.056 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:40.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215114 2026-02-23T08:06:40.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215114 2026-02-23T08:06:40.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215114' 2026-02-23T08:06:40.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:40.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:40.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659138 2026-02-23T08:06:40.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659138 2026-02-23T08:06:40.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215114 1-176093659138' 2026-02-23T08:06:40.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:40.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215114 2026-02-23T08:06:40.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:40.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:40.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215114 2026-02-23T08:06:40.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:40.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215114 2026-02-23T08:06:40.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215114' 2026-02-23T08:06:40.205 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215114 2026-02-23T08:06:40.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:40.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215113 -lt 103079215114 2026-02-23T08:06:40.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:41.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:41.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:41.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215115 -lt 103079215114 2026-02-23T08:06:41.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:41.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-176093659138 2026-02-23T08:06:41.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:41.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:41.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-176093659138 2026-02-23T08:06:41.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:41.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=176093659138 2026-02-23T08:06:41.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 176093659138' 2026-02-23T08:06:41.538 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 176093659138 2026-02-23T08:06:41.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:41.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 176093659138 -lt 176093659138 2026-02-23T08:06:41.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:41.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:41.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:41.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:41.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:06:42.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:06:42.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:06:42.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:42.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:06:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:06:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:06:42.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:303: corrupt_and_repair_one: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:06:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:304: corrupt_and_repair_one: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:06:42.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:06:42.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:06:42.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:06:42.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:06:42.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:06:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:06:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:06:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:06:42.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:06:42.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:06:42.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:06:42.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:06:42.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:06:42.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:06:42.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:06:42.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:06:42.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:06:42.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:06:42.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:06:42.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:06:42.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:06:42.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:06:42.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:06:42.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:06:42.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:06:42.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:06:42.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:06:42.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:06:42.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:06:42.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:06:42.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:06:42.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:06:42.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:06:42.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:06:42.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:06:42.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:06:42.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:06:42.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:06:42.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:06:42.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:06:42.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:06:42.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:06:42.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:06:42.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:06:42.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:06:42.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:06:42.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:06:42.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:06:42.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:06:42.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_scrub_erasure_appends td/osd-scrub-repair 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5912: TEST_corrupt_scrub_erasure_appends: corrupt_scrub_erasure td/osd-scrub-repair false 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3736: corrupt_scrub_erasure: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3737: corrupt_scrub_erasure: local allow_overwrites=false 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3738: corrupt_scrub_erasure: local poolname=ecpool 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3739: corrupt_scrub_erasure: local total_objs=7 2026-02-23T08:06:42.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3741: corrupt_scrub_erasure: run_mon td/osd-scrub-repair a 2026-02-23T08:06:42.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:06:42.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:06:42.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:06:42.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:06:42.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:42.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:06:42.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:06:42.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:06:42.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:06:42.473 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:06:42.473 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.473 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.473 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:06:42.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:06:42.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.533 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.534 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:06:42.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:06:42.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3742: corrupt_scrub_erasure: run_mgr td/osd-scrub-repair x 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:06:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:06:42.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:06:42.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:42.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:42.690 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:42.690 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.690 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:42.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:06:42.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:06:42.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: seq 0 2 2026-02-23T08:06:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-23T08:06:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 0 2026-02-23T08:06:42.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:06:42.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:42.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:06:42.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:06:42.713 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:06:42.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b' 2026-02-23T08:06:42.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:06:42.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCSCpxpLkLDKhAAfmDX1s553fEx0yUYFXxkgQ== 2026-02-23T08:06:42.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCSCpxpLkLDKhAAfmDX1s553fEx0yUYFXxkgQ=="}' 2026-02-23T08:06:42.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b -i td/osd-scrub-repair/0/new.json 2026-02-23T08:06:42.806 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:06:42.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:06:42.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCSCpxpLkLDKhAAfmDX1s553fEx0yUYFXxkgQ== --osd-uuid d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:06:42.830 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:42.828+0000 7f1c05dfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:42.831 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:42.830+0000 7f1c05dfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:42.831 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:42.830+0000 7f1c05dfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:42.832 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:42.831+0000 7f1c05dfd780 -1 bdev(0x5623dcc1b400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:06:42.832 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:42.831+0000 7f1c05dfd780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:06:43.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:06:43.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:06:43.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:06:43.278 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:06:43.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:06:43.372 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:06:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:06:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:43.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:06:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:06:43.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:06:43.384 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:43.383+0000 7f6042809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:43.385 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:43.385+0000 7f6042809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:43.386 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:43.385+0000 7f6042809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:43.465 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:06:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:43.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:06:43.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:43.605 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:43.604+0000 7f6042809780 -1 Falling back to public interface 2026-02-23T08:06:43.994 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:43.993+0000 7f6042809780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:06:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:44.556 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:06:44.648 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1772898292,v1:127.0.0.1:6801/1772898292] [v2:127.0.0.1:6802/1772898292,v1:127.0.0.1:6803/1772898292] exists,up d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 1 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:06:44.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:44.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:44.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:06:44.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ff5d3962-c546-4d67-bdb8-803c4a9e19e0' 2026-02-23T08:06:44.657 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:06:44.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:06:44.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCUCpxpZHFbJxAAmI0XVOy+BEy4z6dBdqYShQ== 2026-02-23T08:06:44.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCUCpxpZHFbJxAAmI0XVOy+BEy4z6dBdqYShQ=="}' 2026-02-23T08:06:44.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ff5d3962-c546-4d67-bdb8-803c4a9e19e0 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:06:44.748 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:44.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:06:44.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCUCpxpZHFbJxAAmI0XVOy+BEy4z6dBdqYShQ== --osd-uuid ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:06:44.772 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:44.770+0000 7f56b360e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:44.776 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:44.772+0000 7f56b360e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:44.776 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:44.772+0000 7f56b360e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:44.776 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:44.773+0000 7f56b360e780 -1 bdev(0x55bb6b67f400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:06:44.776 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:44.773+0000 7f56b360e780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:06:45.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:06:45.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:06:45.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:06:45.190 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:06:45.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:06:45.398 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:06:45.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:06:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:06:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:06:45.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:06:45.411 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:45.410+0000 7febd220d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:45.412 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:45.411+0000 7febd220d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:45.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:45.412+0000 7febd220d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:45.563 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:06:45.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:45.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:45.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:45.599+0000 7febd220d780 -1 Falling back to public interface 2026-02-23T08:06:45.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:45.953 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:45.952+0000 7febd220d780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:06:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:46.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:46.731 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:46.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:46.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:46.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:06:46.899 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1607168046,v1:127.0.0.1:6811/1607168046] [v2:127.0.0.1:6812/1607168046,v1:127.0.0.1:6813/1607168046] exists,up ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 2 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:06:46.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:06:46.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:06:46.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:06:46.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=031a4dda-da45-4efb-be36-2c64dd37a4ef 2026-02-23T08:06:46.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 031a4dda-da45-4efb-be36-2c64dd37a4ef' 2026-02-23T08:06:46.903 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 031a4dda-da45-4efb-be36-2c64dd37a4ef 2026-02-23T08:06:46.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:06:46.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCWCpxpk4FiNhAAcYWawWmVHLornFUM8ALOJA== 2026-02-23T08:06:46.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCWCpxpk4FiNhAAcYWawWmVHLornFUM8ALOJA=="}' 2026-02-23T08:06:46.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 031a4dda-da45-4efb-be36-2c64dd37a4ef -i td/osd-scrub-repair/2/new.json 2026-02-23T08:06:47.070 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:06:47.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:06:47.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCWCpxpk4FiNhAAcYWawWmVHLornFUM8ALOJA== --osd-uuid 031a4dda-da45-4efb-be36-2c64dd37a4ef 2026-02-23T08:06:47.095 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.094+0000 7f486de09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:47.096 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.095+0000 7f486de09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:47.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.096+0000 7f486de09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:47.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.097+0000 7f486de09780 -1 bdev(0x56011f6cf400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:06:47.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.097+0000 7f486de09780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:06:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:06:47.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:06:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:06:47.517 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:06:47.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:06:47.725 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:06:47.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:06:47.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:06:47.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:06:47.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:06:47.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:06:47.737 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.736+0000 7f4894e9b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:47.739 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.738+0000 7f4894e9b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:47.739 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.738+0000 7f4894e9b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:06:47.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:06:47.892 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:06:47.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:47.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:06:47.955 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:47.953+0000 7f4894e9b780 -1 Falling back to public interface 2026-02-23T08:06:48.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:06:48.322 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:06:48.320+0000 7f4894e9b780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:06:49.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:06:49.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:06:49.059 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:06:49.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:06:49.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:06:49.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:06:49.223 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/540100785,v1:127.0.0.1:6819/540100785] [v2:127.0.0.1:6820/540100785,v1:127.0.0.1:6821/540100785] exists,up 031a4dda-da45-4efb-be36-2c64dd37a4ef 2026-02-23T08:06:49.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:06:49.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:06:49.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:06:49.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3746: corrupt_scrub_erasure: create_rbd_pool 2026-02-23T08:06:49.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:06:49.378 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:06:49.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:06:49.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:06:49.597 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:06:49.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:06:50.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:06:50.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3747: corrupt_scrub_erasure: create_pool foo 1 2026-02-23T08:06:50.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-23T08:06:51.083 INFO:tasks.workunit.client.0.trial129.stderr:pool 'foo' created 2026-02-23T08:06:51.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:06:52.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3749: corrupt_scrub_erasure: create_ec_pool ecpool false k=2 m=1 stripe_unit=2K --force 2026-02-23T08:06:52.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:06:52.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:06:52.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T08:06:52.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:06:52.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 stripe_unit=2K --force 2026-02-23T08:06:52.307 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:06:52.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:06:52.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:06:52.614 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:06:52.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:06:53.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T08:06:53.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:06:53.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:53.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:53.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:53.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:53.630 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:53.630 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:53.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:53.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:53.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:53.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:53.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:53.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:53.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:53.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:53.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:53.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:53.877 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:06:53.877 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:06:53.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:53.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:53.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:53.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:06:53.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:06:53.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:06:53.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:53.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:54.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T08:06:54.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T08:06:54.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T08:06:54.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:54.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:06:54.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-23T08:06:54.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-23T08:06:54.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542147' 2026-02-23T08:06:54.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:54.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:06:54.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:54.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:54.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:06:54.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:54.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:06:54.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:06:54.101 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:06:54.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:54.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:06:54.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:55.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:55.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:55.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:06:55.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:55.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T08:06:55.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:55.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:55.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T08:06:55.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:55.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T08:06:55.435 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T08:06:55.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T08:06:55.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:55.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-23T08:06:55.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:55.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-23T08:06:55.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:55.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:06:55.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-23T08:06:55.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:55.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-23T08:06:55.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-23T08:06:55.601 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542147 2026-02-23T08:06:55.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:06:55.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-23T08:06:55.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:55.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:55.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:55.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:06:55.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:55.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:55.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:55.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:55.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:55.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:55.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:06:56.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:06:56.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:06:56.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:56.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3750: corrupt_scrub_erasure: wait_for_clean 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:06:56.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:06:56.335 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:06:56.335 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:06:56.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:06:56.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:06:56.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:06:56.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:06:56.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:06:56.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:06:56.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:06:56.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:06:56.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:06:56.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:06:56.579 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:06:56.579 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:06:56.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:06:56.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:56.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:06:56.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:06:56.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:06:56.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:06:56.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:56.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:06:56.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T08:06:56.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T08:06:56.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-23T08:06:56.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:06:56.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:06:56.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-23T08:06:56.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-23T08:06:56.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542149' 2026-02-23T08:06:56.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:56.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:06:56.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:56.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:06:56.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:06:56.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:56.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:06:56.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:06:56.803 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:06:56.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:06:56.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:06:56.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:56.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T08:06:56.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:56.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:06:56.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T08:06:56.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:56.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T08:06:56.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T08:06:56.971 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T08:06:56.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:57.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705668 2026-02-23T08:06:57.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:58.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:06:58.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:58.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705668 2026-02-23T08:06:58.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:06:59.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:06:59.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:06:59.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705668 2026-02-23T08:06:59.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:06:59.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-23T08:06:59.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:06:59.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:06:59.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-23T08:06:59.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:06:59.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-23T08:06:59.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-23T08:06:59.477 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542149 2026-02-23T08:06:59.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:06:59.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542149 2026-02-23T08:06:59.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:06:59.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:06:59.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:06:59.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:06:59.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:06:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:06:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:06:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:06:59.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:06:59.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:06:59.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:00.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:00.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:00.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:00.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:00.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:00.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:00.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:00.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: seq 1 7 2026-02-23T08:07:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ1 2026-02-23T08:07:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ1 2026-02-23T08:07:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:00.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ1 2026-02-23T08:07:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:00.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:00.428 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:00.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:00.633 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:00.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:00.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:00.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:00.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 1 % 2 2026-02-23T08:07:00.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:07:00.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:00.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3761: corrupt_scrub_erasure: local payload=UVWXYZZZ 2026-02-23T08:07:00.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3762: corrupt_scrub_erasure: echo UVWXYZZZ 2026-02-23T08:07:00.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3763: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:00.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:00.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:00.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:00.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:00.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:00.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:00.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:07:00.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:00.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:00.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:01.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:01.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:07:01.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:07:01.166 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:07:01.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:01.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:07:01.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:07:01.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:01.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:01.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:01.180 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:01.179+0000 7fcd26c7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:01.181 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:01.181+0000 7fcd26c7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:01.182 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:01.181+0000 7fcd26c7b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:01.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:01.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:01.403 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:01.402+0000 7fcd26c7b780 -1 Falling back to public interface 2026-02-23T08:07:01.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:01.770 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:01.769+0000 7fcd26c7b780 -1 osd.1 32 log_to_monitors true 2026-02-23T08:07:02.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:02.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:02.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:02.498 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:02.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:02.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:02.671 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 36 up_thru 36 down_at 33 last_clean_interval [9,32) [v2:127.0.0.1:6810/141421034,v1:127.0.0.1:6811/141421034] [v2:127.0.0.1:6812/141421034,v1:127.0.0.1:6813/141421034] exists,up ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:07:02.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:02.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:02.673 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:02.673 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:02.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:02.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:02.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:02.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:02.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:02.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:02.915 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:02.915 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:02.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:02.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:02.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:02.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:07:02.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:07:02.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:07:02.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:02.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:03.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822658 2026-02-23T08:07:03.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822658 2026-02-23T08:07:03.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-154618822658' 2026-02-23T08:07:03.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:03.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:03.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542151 2026-02-23T08:07:03.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542151 2026-02-23T08:07:03.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-154618822658 2-60129542151' 2026-02-23T08:07:03.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:03.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:07:03.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:03.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:03.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:07:03.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:03.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:07:03.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:07:03.138 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T08:07:03.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:07:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:04.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:04.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:04.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:07:04.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:05.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:07:05.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:05.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:07:05.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:05.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-154618822658 2026-02-23T08:07:05.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:05.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:05.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-154618822658 2026-02-23T08:07:05.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:05.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822658 2026-02-23T08:07:05.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 154618822658' 2026-02-23T08:07:05.648 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 154618822658 2026-02-23T08:07:05.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:05.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822658 -lt 154618822658 2026-02-23T08:07:05.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542151 2026-02-23T08:07:05.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:05.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:05.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542151 2026-02-23T08:07:05.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:05.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542151 2026-02-23T08:07:05.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542151' 2026-02-23T08:07:05.817 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542151 2026-02-23T08:07:05.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:05.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542152 -lt 60129542151 2026-02-23T08:07:05.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:05.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:05.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:06.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:06.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:06.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ2 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ2 2026-02-23T08:07:06.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:06.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:06.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ2 2026-02-23T08:07:06.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:06.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:06.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:06.762 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:06.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:06.964 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:06.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:06.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:06.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:06.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 2 % 2 2026-02-23T08:07:06.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-23T08:07:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3768: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=1 2026-02-23T08:07:06.999 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:07:06.999 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:07:06.999 INFO:tasks.workunit.client.0.trial129.stderr:2048 bytes (2.0 kB, 2.0 KiB) copied, 4.3441e-05 s, 47.1 MB/s 2026-02-23T08:07:06.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3769: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:07:07.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:07.001 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:07.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:07.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:07.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:07.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:07.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:07:07.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:07.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:07.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:07:07.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:07.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:07.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:07.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:07:07.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:07:07.483 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:07:07.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:07.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:07:07.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:07:07.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:07.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:07.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:07.493 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:07.491+0000 7f38afe7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:07.494 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:07.493+0000 7f38afe7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:07.495 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:07.494+0000 7f38afe7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:07.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:07.651 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:07.650+0000 7f38afe7e780 -1 Falling back to public interface 2026-02-23T08:07:07.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:07.920 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:07.919+0000 7f38afe7e780 -1 osd.0 39 log_to_monitors true 2026-02-23T08:07:08.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:08.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:08.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:08.813 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:08.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:08.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:08.980 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 43 up_thru 43 down_at 40 last_clean_interval [5,39) [v2:127.0.0.1:6800/694034971,v1:127.0.0.1:6801/694034971] [v2:127.0.0.1:6802/694034971,v1:127.0.0.1:6803/694034971] exists,up d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:07:08.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:08.981 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:08.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:08.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:08.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:09.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:09.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:09.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:09.225 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:09.226 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:09.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:09.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:09.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:09.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593730 2026-02-23T08:07:09.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593730 2026-02-23T08:07:09.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-184683593730' 2026-02-23T08:07:09.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:09.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:09.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822660 2026-02-23T08:07:09.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822660 2026-02-23T08:07:09.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-184683593730 1-154618822660' 2026-02-23T08:07:09.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:09.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:09.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T08:07:09.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T08:07:09.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-184683593730 1-154618822660 2-60129542153' 2026-02-23T08:07:09.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:09.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-184683593730 2026-02-23T08:07:09.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:09.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:09.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-184683593730 2026-02-23T08:07:09.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:09.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593730 2026-02-23T08:07:09.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 184683593730' 2026-02-23T08:07:09.455 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 184683593730 2026-02-23T08:07:09.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:09.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 184683593730 2026-02-23T08:07:09.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:10.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:10.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:10.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593730 -lt 184683593730 2026-02-23T08:07:10.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:10.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-154618822660 2026-02-23T08:07:10.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:10.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:10.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-154618822660 2026-02-23T08:07:10.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:10.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822660 2026-02-23T08:07:10.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 154618822660' 2026-02-23T08:07:10.796 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 154618822660 2026-02-23T08:07:10.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:10.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-23T08:07:10.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:10.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T08:07:10.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:10.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:10.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T08:07:10.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:10.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T08:07:10.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T08:07:10.965 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542153 2026-02-23T08:07:10.965 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:11.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542153 2026-02-23T08:07:11.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:11.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:11.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:11.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:11.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:11.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:11.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:11.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:11.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ3 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ3 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ3 2026-02-23T08:07:11.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:11.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:11.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:11.911 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:11.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:12.115 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:12.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:12.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 3 % 2 2026-02-23T08:07:12.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3774: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ3 remove 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ3 remove 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:12.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:12.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:12.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:12.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ3 remove 2026-02-23T08:07:12.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:12.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:12.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:07:12.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:12.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:12.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ3 remove 2026-02-23T08:07:12.568 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#3:b197b25d:::EOBJ3:head# 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:12.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:07:12.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:07:12.621 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:07:12.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:12.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:07:12.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:07:12.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:12.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:12.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:12.633 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:12.632+0000 7f8c90164780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:12.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:12.634+0000 7f8c90164780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:12.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:12.635+0000 7f8c90164780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:12.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:12.873 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:12.872+0000 7f8c90164780 -1 Falling back to public interface 2026-02-23T08:07:12.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:13.258 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:13.257+0000 7f8c90164780 -1 osd.1 47 log_to_monitors true 2026-02-23T08:07:13.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:13.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:13.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:13.952 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:13.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:13.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:14.118 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 51 up_thru 51 down_at 48 last_clean_interval [36,47) [v2:127.0.0.1:6810/2370553748,v1:127.0.0.1:6811/2370553748] [v2:127.0.0.1:6812/2370553748,v1:127.0.0.1:6813/2370553748] exists,up ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:07:14.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:14.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:14.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:14.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:14.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:14.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:14.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:14.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:14.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:14.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:14.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:14.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:14.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:14.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:14.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:14.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:14.365 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:14.365 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:14.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:14.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:14.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:14.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593732 2026-02-23T08:07:14.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593732 2026-02-23T08:07:14.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-184683593732' 2026-02-23T08:07:14.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:14.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:14.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332098 2026-02-23T08:07:14.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332098 2026-02-23T08:07:14.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-184683593732 1-219043332098' 2026-02-23T08:07:14.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:14.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:14.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-23T08:07:14.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-23T08:07:14.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-184683593732 1-219043332098 2-60129542156' 2026-02-23T08:07:14.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:14.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-184683593732 2026-02-23T08:07:14.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:14.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:14.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-184683593732 2026-02-23T08:07:14.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:14.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=184683593732 2026-02-23T08:07:14.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 184683593732' 2026-02-23T08:07:14.594 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 184683593732 2026-02-23T08:07:14.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:14.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593732 -lt 184683593732 2026-02-23T08:07:14.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:14.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-219043332098 2026-02-23T08:07:14.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:14.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:14.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-219043332098 2026-02-23T08:07:14.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:14.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332098 2026-02-23T08:07:14.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 219043332098' 2026-02-23T08:07:14.762 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 219043332098 2026-02-23T08:07:14.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:14.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332098 -lt 219043332098 2026-02-23T08:07:14.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:14.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-23T08:07:14.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:14.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:14.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-23T08:07:14.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:14.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-23T08:07:14.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-23T08:07:14.928 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542156 2026-02-23T08:07:14.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-23T08:07:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:15.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:15.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:15.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:15.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:15.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:15.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:15.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:15.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:15.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:15.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:15.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:15.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ4 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ4 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ4 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:15.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:15.881 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:15.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:16.085 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:16.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:16.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:16.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:16.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 4 % 2 2026-02-23T08:07:16.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-23T08:07:16.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:16.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3778: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key1-EOBJ4 val1-EOBJ4 2026-02-23T08:07:16.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3779: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key2-EOBJ4 val2-EOBJ4 2026-02-23T08:07:16.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3782: corrupt_scrub_erasure: echo -n bad-val 2026-02-23T08:07:16.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3783: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:16.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:16.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:16.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:16.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:16.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:16.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:07:16.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:16.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:16.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:07:16.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:16.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:16.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:16.454 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:07:16.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:07:16.456 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:07:16.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:16.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:07:16.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:07:16.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:16.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:16.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:16.465 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:16.464+0000 7f052cc0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:16.466 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:16.465+0000 7f052cc0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:16.467 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:16.466+0000 7f052cc0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:16.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:16.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:16.685 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:16.684+0000 7f052cc0f780 -1 Falling back to public interface 2026-02-23T08:07:16.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:16.987 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:16.986+0000 7f052cc0f780 -1 osd.0 54 log_to_monitors true 2026-02-23T08:07:17.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:17.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:17.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:17.789 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:17.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:17.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:17.954 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 58 up_thru 58 down_at 55 last_clean_interval [43,54) [v2:127.0.0.1:6800/2577240156,v1:127.0.0.1:6801/2577240156] [v2:127.0.0.1:6802/2577240156,v1:127.0.0.1:6803/2577240156] exists,up d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:17.955 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:17.956 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:17.956 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:17.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:17.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:17.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:18.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:18.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:18.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:18.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:18.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:18.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:18.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:18.206 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:18.206 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:18.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:18.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:18.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:18.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103170 2026-02-23T08:07:18.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103170 2026-02-23T08:07:18.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103170' 2026-02-23T08:07:18.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:18.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:18.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332100 2026-02-23T08:07:18.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332100 2026-02-23T08:07:18.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103170 1-219043332100' 2026-02-23T08:07:18.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:18.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:18.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-23T08:07:18.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-23T08:07:18.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103170 1-219043332100 2-60129542157' 2026-02-23T08:07:18.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:18.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103170 2026-02-23T08:07:18.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:18.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:18.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103170 2026-02-23T08:07:18.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:18.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103170 2026-02-23T08:07:18.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103170' 2026-02-23T08:07:18.432 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 249108103170 2026-02-23T08:07:18.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 184683593732 -lt 249108103170 2026-02-23T08:07:18.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:19.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:19.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:19.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103170 -lt 249108103170 2026-02-23T08:07:19.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:19.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-219043332100 2026-02-23T08:07:19.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:19.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:19.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-219043332100 2026-02-23T08:07:19.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:19.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332100 2026-02-23T08:07:19.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 219043332100' 2026-02-23T08:07:19.769 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 219043332100 2026-02-23T08:07:19.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:19.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332100 -lt 219043332100 2026-02-23T08:07:19.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:19.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-23T08:07:19.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:19.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:19.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-23T08:07:19.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:19.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-23T08:07:19.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-23T08:07:19.935 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542157 2026-02-23T08:07:19.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:20.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542157 -lt 60129542157 2026-02-23T08:07:20.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:20.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:20.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:20.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:20.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:20.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:20.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:20.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:20.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:20.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:20.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:20.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:20.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:20.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:20.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3784: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:20.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:20.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:20.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:20.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:20.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:07:20.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:21.146 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:07:21.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:07:21.148 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:07:21.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:21.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:07:21.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:07:21.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:21.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:21.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:21.160 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:21.159+0000 7fa99a375780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:21.161 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:21.160+0000 7fa99a375780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:21.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:21.161+0000 7fa99a375780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:21.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:07:21.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:21.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:07:21.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:21.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:21.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:21.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:21.318 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:21.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:21.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:07:21.353 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:21.351+0000 7fa99a375780 -1 Falling back to public interface 2026-02-23T08:07:21.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:21.672 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:21.671+0000 7fa99a375780 -1 osd.2 59 log_to_monitors true 2026-02-23T08:07:22.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:22.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:22.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:22.484 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:22.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:22.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 63 up_thru 63 down_at 60 last_clean_interval [14,59) [v2:127.0.0.1:6818/3867275929,v1:127.0.0.1:6819/3867275929] [v2:127.0.0.1:6820/3867275929,v1:127.0.0.1:6821/3867275929] exists,up 031a4dda-da45-4efb-be36-2c64dd37a4ef 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:22.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:22.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:22.651 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:22.651 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:22.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:22.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:22.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:22.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:22.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:22.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:22.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:22.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:22.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:22.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:22.896 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:22.896 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:22.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:22.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:22.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:22.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103172 2026-02-23T08:07:22.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103172 2026-02-23T08:07:22.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103172' 2026-02-23T08:07:22.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:22.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:23.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332101 2026-02-23T08:07:23.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332101 2026-02-23T08:07:23.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103172 1-219043332101' 2026-02-23T08:07:23.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:23.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:23.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=270582939650 2026-02-23T08:07:23.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 270582939650 2026-02-23T08:07:23.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103172 1-219043332101 2-270582939650' 2026-02-23T08:07:23.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:23.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103172 2026-02-23T08:07:23.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:23.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:23.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103172 2026-02-23T08:07:23.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:23.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103172 2026-02-23T08:07:23.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103172' 2026-02-23T08:07:23.120 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 249108103172 2026-02-23T08:07:23.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:23.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103171 -lt 249108103172 2026-02-23T08:07:23.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:24.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:24.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:24.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103171 -lt 249108103172 2026-02-23T08:07:24.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:25.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:07:25.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:25.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103172 -lt 249108103172 2026-02-23T08:07:25.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:25.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-219043332101 2026-02-23T08:07:25.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:25.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:25.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-219043332101 2026-02-23T08:07:25.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:25.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332101 2026-02-23T08:07:25.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 219043332101' 2026-02-23T08:07:25.642 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 219043332101 2026-02-23T08:07:25.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:25.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332102 -lt 219043332101 2026-02-23T08:07:25.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:25.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-270582939650 2026-02-23T08:07:25.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:25.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:25.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-270582939650 2026-02-23T08:07:25.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:25.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=270582939650 2026-02-23T08:07:25.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 270582939650' 2026-02-23T08:07:25.817 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 270582939650 2026-02-23T08:07:25.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:25.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 270582939650 -lt 270582939650 2026-02-23T08:07:25.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:25.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:25.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:26.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:26.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:26.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:26.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:26.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:26.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:26.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:26.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3785: corrupt_scrub_erasure: echo -n val3-EOBJ4 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3786: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:07:26.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:26.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:26.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:07:26.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:26.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:26.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:07:26.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:26.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:07:26.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:07:27.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:27.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:27.039 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:27.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:07:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:07:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:27.049 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:27.048+0000 7f68ffb4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:27.050 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:27.049+0000 7f68ffb4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:27.051 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:27.050+0000 7f68ffb4c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:27.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:27.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:07:27.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:27.250+0000 7f68ffb4c780 -1 Falling back to public interface 2026-02-23T08:07:27.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:27.572 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:27.571+0000 7f68ffb4c780 -1 osd.2 64 log_to_monitors true 2026-02-23T08:07:28.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:28.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:28.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:28.370 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:28.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:28.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 69 up_thru 69 down_at 66 last_clean_interval [63,64) [v2:127.0.0.1:6818/739626203,v1:127.0.0.1:6819/739626203] [v2:127.0.0.1:6820/739626203,v1:127.0.0.1:6821/739626203] exists,up 031a4dda-da45-4efb-be36-2c64dd37a4ef 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:28.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:28.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:28.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:28.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:28.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:28.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:28.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:28.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:28.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:28.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:28.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:28.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:28.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:28.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:28.784 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:28.784 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:28.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:28.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:28.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:28.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103174 2026-02-23T08:07:28.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103174 2026-02-23T08:07:28.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103174' 2026-02-23T08:07:28.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:28.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:28.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332104 2026-02-23T08:07:28.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332104 2026-02-23T08:07:28.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103174 1-219043332104' 2026-02-23T08:07:28.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:28.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:29.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743426 2026-02-23T08:07:29.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743426 2026-02-23T08:07:29.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103174 1-219043332104 2-296352743426' 2026-02-23T08:07:29.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:29.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103174 2026-02-23T08:07:29.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:29.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:29.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103174 2026-02-23T08:07:29.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:29.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103174 2026-02-23T08:07:29.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103174' 2026-02-23T08:07:29.009 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 249108103174 2026-02-23T08:07:29.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:29.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103173 -lt 249108103174 2026-02-23T08:07:29.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:30.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:30.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:30.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103173 -lt 249108103174 2026-02-23T08:07:30.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:31.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:07:31.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:31.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103174 -lt 249108103174 2026-02-23T08:07:31.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:31.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-219043332104 2026-02-23T08:07:31.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:31.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:31.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-219043332104 2026-02-23T08:07:31.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:31.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332104 2026-02-23T08:07:31.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 219043332104' 2026-02-23T08:07:31.510 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 219043332104 2026-02-23T08:07:31.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:31.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332104 -lt 219043332104 2026-02-23T08:07:31.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:31.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743426 2026-02-23T08:07:31.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:31.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:31.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743426 2026-02-23T08:07:31.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:31.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743426 2026-02-23T08:07:31.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743426' 2026-02-23T08:07:31.677 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743426 2026-02-23T08:07:31.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:31.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743426 -lt 296352743426 2026-02-23T08:07:31.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:31.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:31.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:32.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:32.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:32.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:32.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:32.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:32.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:32.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:32.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:32.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:32.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3787: corrupt_scrub_erasure: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-23T08:07:32.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:32.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ5 2026-02-23T08:07:32.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ5 2026-02-23T08:07:32.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:32.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:32.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ5 2026-02-23T08:07:32.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:32.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:32.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:32.620 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:32.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:32.826 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:32.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:32.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:32.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:32.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 5 % 2 2026-02-23T08:07:32.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:07:32.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:32.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3792: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=2 2026-02-23T08:07:32.860 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records in 2026-02-23T08:07:32.860 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records out 2026-02-23T08:07:32.860 INFO:tasks.workunit.client.0.trial129.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 4.3662e-05 s, 93.8 MB/s 2026-02-23T08:07:32.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3793: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:32.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:07:32.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:32.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:07:32.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:32.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:32.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:32.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:32.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:33.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:07:33.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:07:33.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:33.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:33.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:33.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:07:33.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:07:33.327 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:07:33.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:33.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:07:33.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:07:33.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:33.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:33.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:33.340 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:33.339+0000 7fefc70c1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:33.341 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:33.340+0000 7fefc70c1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:33.342 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:33.341+0000 7fefc70c1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:33.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:33.574 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:33.573+0000 7fefc70c1780 -1 Falling back to public interface 2026-02-23T08:07:33.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:33.897 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:33.896+0000 7fefc70c1780 -1 osd.1 72 log_to_monitors true 2026-02-23T08:07:34.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:34.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:34.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:34.657 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:34.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:34.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:34.824 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 76 up_thru 76 down_at 73 last_clean_interval [51,72) [v2:127.0.0.1:6810/1443088379,v1:127.0.0.1:6811/1443088379] [v2:127.0.0.1:6812/1443088379,v1:127.0.0.1:6813/1443088379] exists,up ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:07:34.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:34.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:34.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:34.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:34.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:34.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:35.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:35.071 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:35.071 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:35.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:35.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:35.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:35.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=249108103176 2026-02-23T08:07:35.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 249108103176 2026-02-23T08:07:35.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103176' 2026-02-23T08:07:35.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:35.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:35.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=326417514498 2026-02-23T08:07:35.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 326417514498 2026-02-23T08:07:35.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103176 1-326417514498' 2026-02-23T08:07:35.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:35.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:35.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743428 2026-02-23T08:07:35.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743428 2026-02-23T08:07:35.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-249108103176 1-326417514498 2-296352743428' 2026-02-23T08:07:35.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:35.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-249108103176 2026-02-23T08:07:35.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:35.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:35.292 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-249108103176 2026-02-23T08:07:35.292 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:35.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=249108103176 2026-02-23T08:07:35.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 249108103176' 2026-02-23T08:07:35.293 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 249108103176 2026-02-23T08:07:35.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:35.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103175 -lt 249108103176 2026-02-23T08:07:35.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:36.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:36.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:36.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103175 -lt 249108103176 2026-02-23T08:07:36.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:37.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:07:37.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:37.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 249108103176 -lt 249108103176 2026-02-23T08:07:37.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:37.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-326417514498 2026-02-23T08:07:37.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:37.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:37.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-326417514498 2026-02-23T08:07:37.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:37.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=326417514498 2026-02-23T08:07:37.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 326417514498' 2026-02-23T08:07:37.798 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 326417514498 2026-02-23T08:07:37.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:37.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 326417514498 -lt 326417514498 2026-02-23T08:07:37.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:37.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743428 2026-02-23T08:07:37.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:37.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:37.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743428 2026-02-23T08:07:37.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:37.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743428 2026-02-23T08:07:37.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743428' 2026-02-23T08:07:37.968 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743428 2026-02-23T08:07:37.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:38.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743428 -lt 296352743428 2026-02-23T08:07:38.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:38.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:38.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:38.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:38.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:38.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:38.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:38.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:38.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ6 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ6 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:38.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:38.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ6 2026-02-23T08:07:38.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:38.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:38.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:38.923 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:38.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:39.127 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:39.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:39.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:39.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:39.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 6 % 2 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3797: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:39.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:39.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:07:39.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:07:39.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:39.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:39.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:07:39.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:39.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:39.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:07:39.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:39.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:07:39.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:07:39.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:39.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:39.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:39.642 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:39.641+0000 7f7e1f950780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:39.644 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:39.643+0000 7f7e1f950780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:39.645 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:39.644+0000 7f7e1f950780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:39.797 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:39.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:39.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:39.868 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:39.867+0000 7f7e1f950780 -1 Falling back to public interface 2026-02-23T08:07:39.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:40.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:40.249+0000 7f7e1f950780 -1 osd.0 79 log_to_monitors true 2026-02-23T08:07:40.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:40.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:40.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:40.963 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:40.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:40.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 83 up_thru 83 down_at 80 last_clean_interval [58,79) [v2:127.0.0.1:6800/4175191634,v1:127.0.0.1:6801/4175191634] [v2:127.0.0.1:6802/4175191634,v1:127.0.0.1:6803/4175191634] exists,up d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:41.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:41.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:41.135 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:41.135 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:41.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:41.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:41.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:41.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:41.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:41.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:41.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:41.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:41.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:41.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:41.382 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:41.382 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:41.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:41.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:41.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285570 2026-02-23T08:07:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285570 2026-02-23T08:07:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-356482285570' 2026-02-23T08:07:41.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:41.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:41.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=326417514500 2026-02-23T08:07:41.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 326417514500 2026-02-23T08:07:41.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-356482285570 1-326417514500' 2026-02-23T08:07:41.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:41.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:41.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743430 2026-02-23T08:07:41.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743430 2026-02-23T08:07:41.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-356482285570 1-326417514500 2-296352743430' 2026-02-23T08:07:41.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:41.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-356482285570 2026-02-23T08:07:41.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:41.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:41.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-356482285570 2026-02-23T08:07:41.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:41.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=356482285570 2026-02-23T08:07:41.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 356482285570' 2026-02-23T08:07:41.607 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 356482285570 2026-02-23T08:07:41.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:41.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 356482285570 2026-02-23T08:07:41.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:42.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:42.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:42.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 356482285570 -lt 356482285570 2026-02-23T08:07:42.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:42.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-326417514500 2026-02-23T08:07:42.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:42.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:42.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-326417514500 2026-02-23T08:07:42.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:42.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=326417514500 2026-02-23T08:07:42.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 326417514500' 2026-02-23T08:07:42.955 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 326417514500 2026-02-23T08:07:42.955 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:43.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 326417514500 -lt 326417514500 2026-02-23T08:07:43.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:43.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743430 2026-02-23T08:07:43.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:43.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:43.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743430 2026-02-23T08:07:43.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:43.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743430 2026-02-23T08:07:43.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743430' 2026-02-23T08:07:43.121 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743430 2026-02-23T08:07:43.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:43.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743431 -lt 296352743430 2026-02-23T08:07:43.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:43.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:43.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:43.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:43.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:43.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:43.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:43.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:43.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:43.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:43.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:43.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:43.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3798: corrupt_scrub_erasure: echo -n bad-val 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3799: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:07:43.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:43.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:43.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:43.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:07:43.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:43.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:43.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:07:43.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:43.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:43.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:44.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:07:44.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:07:44.120 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:07:44.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:44.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:07:44.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:07:44.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:44.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:44.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:44.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:44.131+0000 7fb2d9e0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:44.134 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:44.133+0000 7fb2d9e0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:44.134 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:44.134+0000 7fb2d9e0b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:44.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:44.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:44.293 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:44.292+0000 7fb2d9e0b780 -1 Falling back to public interface 2026-02-23T08:07:44.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:44.639 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:44.638+0000 7fb2d9e0b780 -1 osd.1 84 log_to_monitors true 2026-02-23T08:07:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:45.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:45.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:45.455 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:45.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:45.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:07:45.620 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 88 up_thru 88 down_at 85 last_clean_interval [76,84) [v2:127.0.0.1:6810/2402267661,v1:127.0.0.1:6811/2402267661] [v2:127.0.0.1:6812/2402267661,v1:127.0.0.1:6813/2402267661] exists,up ff5d3962-c546-4d67-bdb8-803c4a9e19e0 2026-02-23T08:07:45.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:45.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:45.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:45.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:45.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:45.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:45.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:45.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:45.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:45.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:45.865 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:45.866 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:45.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:45.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:45.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:45.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=356482285572 2026-02-23T08:07:45.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 356482285572 2026-02-23T08:07:45.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-356482285572' 2026-02-23T08:07:45.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:45.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:46.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122050 2026-02-23T08:07:46.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122050 2026-02-23T08:07:46.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-356482285572 1-377957122050' 2026-02-23T08:07:46.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:46.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:46.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743432 2026-02-23T08:07:46.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743432 2026-02-23T08:07:46.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-356482285572 1-377957122050 2-296352743432' 2026-02-23T08:07:46.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:46.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-356482285572 2026-02-23T08:07:46.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:46.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:46.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-356482285572 2026-02-23T08:07:46.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:46.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=356482285572 2026-02-23T08:07:46.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 356482285572' 2026-02-23T08:07:46.094 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 356482285572 2026-02-23T08:07:46.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:46.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 356482285570 -lt 356482285572 2026-02-23T08:07:46.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:47.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:47.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:47.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 356482285572 -lt 356482285572 2026-02-23T08:07:47.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:47.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122050 2026-02-23T08:07:47.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:47.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:47.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122050 2026-02-23T08:07:47.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122050 2026-02-23T08:07:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122050' 2026-02-23T08:07:47.429 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 377957122050 2026-02-23T08:07:47.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:47.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122050 -lt 377957122050 2026-02-23T08:07:47.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:47.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743432 2026-02-23T08:07:47.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:47.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:47.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743432 2026-02-23T08:07:47.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:47.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743432 2026-02-23T08:07:47.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743432' 2026-02-23T08:07:47.597 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743432 2026-02-23T08:07:47.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:47.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743432 -lt 296352743432 2026-02-23T08:07:47.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:47.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:47.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:47.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:47.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:48.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:48.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:48.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:48.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ7 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ7 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ7 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:07:48.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:07:48.562 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:07:48.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:07:48.767 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:07:48.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:07:48.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:07:48.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:07:48.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 7 % 2 2026-02-23T08:07:48.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:07:48.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:07:48.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3803: corrupt_scrub_erasure: local payload=MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-23T08:07:48.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3804: corrupt_scrub_erasure: echo MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-23T08:07:48.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3805: corrupt_scrub_erasure: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/DIFFERENT 2026-02-23T08:07:48.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3808: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-23T08:07:48.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:48.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:48.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:07:48.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:48.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:48.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:48.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ1 get-attr hinfo_key 2026-02-23T08:07:49.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:07:49.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:49.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:49.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:07:49.029 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:07:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:49.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:07:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:07:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:49.035 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:49.034+0000 7fd53ee0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:49.036 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:49.035+0000 7fd53ee0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:49.037 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:49.036+0000 7fd53ee0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:49.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:07:49.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:49.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:07:49.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:49.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:49.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:49.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:49.189 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:49.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:49.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:49.249 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:49.247+0000 7fd53ee0c780 -1 Falling back to public interface 2026-02-23T08:07:49.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:49.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:49.634+0000 7fd53ee0c780 -1 osd.0 91 log_to_monitors true 2026-02-23T08:07:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:50.360 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:50.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:50.536 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 95 up_thru 95 down_at 92 last_clean_interval [83,91) [v2:127.0.0.1:6800/1438454791,v1:127.0.0.1:6801/1438454791] [v2:127.0.0.1:6802/1438454791,v1:127.0.0.1:6803/1438454791] exists,up d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:07:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:50.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:50.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:50.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:50.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:50.782 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:50.782 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:50.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:50.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:50.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:50.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893122 2026-02-23T08:07:50.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893122 2026-02-23T08:07:50.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893122' 2026-02-23T08:07:50.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:50.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:50.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122052 2026-02-23T08:07:50.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122052 2026-02-23T08:07:50.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893122 1-377957122052' 2026-02-23T08:07:50.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:50.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:51.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743434 2026-02-23T08:07:51.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743434 2026-02-23T08:07:51.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893122 1-377957122052 2-296352743434' 2026-02-23T08:07:51.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:51.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893122 2026-02-23T08:07:51.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:51.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:51.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893122 2026-02-23T08:07:51.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893122 2026-02-23T08:07:51.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893122' 2026-02-23T08:07:51.006 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 408021893122 2026-02-23T08:07:51.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:51.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 408021893122 2026-02-23T08:07:51.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:52.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:52.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:52.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 408021893122 2026-02-23T08:07:52.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:53.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:07:53.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893122 -lt 408021893122 2026-02-23T08:07:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:53.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122052 2026-02-23T08:07:53.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:53.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:53.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122052 2026-02-23T08:07:53.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:53.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122052 2026-02-23T08:07:53.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122052' 2026-02-23T08:07:53.510 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 377957122052 2026-02-23T08:07:53.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:53.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122052 -lt 377957122052 2026-02-23T08:07:53.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:53.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743434 2026-02-23T08:07:53.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:53.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:53.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743434 2026-02-23T08:07:53.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:53.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743434 2026-02-23T08:07:53.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743434' 2026-02-23T08:07:53.679 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743434 2026-02-23T08:07:53.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:53.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743435 -lt 296352743434 2026-02-23T08:07:53.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:53.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:53.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:54.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:54.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:54.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:54.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:54.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:54.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:54.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:54.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:07:54.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:07:54.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:07:54.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:54.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3809: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:07:54.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:07:54.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:07:54.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:07:54.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:07:54.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:07:54.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:07:54.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:07:54.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:07:54.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:07:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:07:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:07:54.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:07:54.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:07:54.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:07:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:07:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:07:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:07:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:07:54.894 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:54.893+0000 7f4a8b211780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:54.896 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:54.895+0000 7f4a8b211780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:54.897 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:54.896+0000 7f4a8b211780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:07:55.050 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:07:55.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:55.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:55.063 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:55.063+0000 7f4a8b211780 -1 Falling back to public interface 2026-02-23T08:07:55.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:07:55.380 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:07:55.378+0000 7f4a8b211780 -1 osd.0 96 log_to_monitors true 2026-02-23T08:07:56.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:07:56.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:07:56.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:07:56.216 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:56.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:07:56.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:07:56.381 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 100 up_thru 100 down_at 97 last_clean_interval [95,96) [v2:127.0.0.1:6800/1110179921,v1:127.0.0.1:6801/1110179921] [v2:127.0.0.1:6802/1110179921,v1:127.0.0.1:6803/1110179921] exists,up d3b63c4f-35ae-476c-8c58-3f1dba1fbb4b 2026-02-23T08:07:56.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:07:56.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:07:56.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:07:56.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:07:56.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:07:56.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:07:56.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:07:56.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:07:56.383 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:07:56.383 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:07:56.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:07:56.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:07:56.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:07:56.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:07:56.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:07:56.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:07:56.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:07:56.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:07:56.463 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:07:56.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:07:56.628 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:07:56.628 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:07:56.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:07:56.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:56.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:07:56.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=429496729602 2026-02-23T08:07:56.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 429496729602 2026-02-23T08:07:56.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729602' 2026-02-23T08:07:56.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:56.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:07:56.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122054 2026-02-23T08:07:56.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122054 2026-02-23T08:07:56.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729602 1-377957122054' 2026-02-23T08:07:56.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:07:56.777 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:07:56.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743436 2026-02-23T08:07:56.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743436 2026-02-23T08:07:56.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729602 1-377957122054 2-296352743436' 2026-02-23T08:07:56.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:56.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-429496729602 2026-02-23T08:07:56.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:56.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:07:56.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-429496729602 2026-02-23T08:07:56.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:56.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=429496729602 2026-02-23T08:07:56.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 429496729602' 2026-02-23T08:07:56.856 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 429496729602 2026-02-23T08:07:56.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:07:57.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729602 -lt 429496729602 2026-02-23T08:07:57.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:57.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122054 2026-02-23T08:07:57.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:57.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:07:57.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122054 2026-02-23T08:07:57.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:57.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122054 2026-02-23T08:07:57.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122054' 2026-02-23T08:07:57.028 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 377957122054 2026-02-23T08:07:57.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:57.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122053 -lt 377957122054 2026-02-23T08:07:57.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:58.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:07:58.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:58.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122053 -lt 377957122054 2026-02-23T08:07:58.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:07:59.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:07:59.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:07:59.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122054 -lt 377957122054 2026-02-23T08:07:59.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:07:59.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743436 2026-02-23T08:07:59.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:07:59.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:07:59.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743436 2026-02-23T08:07:59.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:07:59.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743436 2026-02-23T08:07:59.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743436' 2026-02-23T08:07:59.530 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743436 2026-02-23T08:07:59.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:07:59.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743437 -lt 296352743436 2026-02-23T08:07:59.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:07:59.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:07:59.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:07:59.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:07:59.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:07:59.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:07:59.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:07:59.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:07:59.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:07:59.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:07:59.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:00.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:00.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:00.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:00.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:00.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:00.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:00.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:00.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3810: corrupt_scrub_erasure: rm -f td/osd-scrub-repair/hinfo 2026-02-23T08:08:00.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: get_pg ecpool EOBJ0 2026-02-23T08:08:00.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:08:00.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=EOBJ0 2026-02-23T08:08:00.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool EOBJ0 2026-02-23T08:08:00.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:08:00.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: local pg=3.0 2026-02-23T08:08:00.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3818: corrupt_scrub_erasure: pg_scrub 3.0 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:00.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:00.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:08:00.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:08:00.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:08:00.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:08:00.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:00.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:00.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:00.796 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:00.797 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:00.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:00.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:00.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:00.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=429496729604 2026-02-23T08:08:00.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 429496729604 2026-02-23T08:08:00.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729604' 2026-02-23T08:08:00.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:00.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122056 2026-02-23T08:08:00.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122056 2026-02-23T08:08:00.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729604 1-377957122056' 2026-02-23T08:08:00.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:00.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:01.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743438 2026-02-23T08:08:01.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743438 2026-02-23T08:08:01.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729604 1-377957122056 2-296352743438' 2026-02-23T08:08:01.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:01.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-429496729604 2026-02-23T08:08:01.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:01.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:01.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-429496729604 2026-02-23T08:08:01.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:01.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=429496729604 2026-02-23T08:08:01.023 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 429496729604 2026-02-23T08:08:01.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 429496729604' 2026-02-23T08:08:01.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:01.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729603 -lt 429496729604 2026-02-23T08:08:01.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:02.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:02.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:02.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729603 -lt 429496729604 2026-02-23T08:08:02.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:03.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:08:03.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:03.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729604 -lt 429496729604 2026-02-23T08:08:03.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:03.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122056 2026-02-23T08:08:03.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:03.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:03.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122056 2026-02-23T08:08:03.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:03.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122056 2026-02-23T08:08:03.531 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 377957122056 2026-02-23T08:08:03.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122056' 2026-02-23T08:08:03.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:03.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122056 -lt 377957122056 2026-02-23T08:08:03.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:03.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743438 2026-02-23T08:08:03.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:03.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:03.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743438 2026-02-23T08:08:03.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:03.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743438 2026-02-23T08:08:03.702 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 296352743438 2026-02-23T08:08:03.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743438' 2026-02-23T08:08:03.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:03.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743439 -lt 296352743438 2026-02-23T08:08:03.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:08:03.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:08:03.869 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:08:03.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:08:03.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:08:03.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:08:03.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:08:03.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:08:03.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:08:03.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:08:03.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:08:03.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:08:03.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:08:03.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:03.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:08:03.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:03.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:08:04.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:04.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:08:04.258 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0s0 on osd.1 to scrub 2026-02-23T08:08:04.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:04.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:08:04.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:52.611465+0000 '>' 2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:04.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:08:05.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:08:05.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:08:05.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:08:05.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:05.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:08:05.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:05.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:08:05.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:08:04.645376+0000 '>' 2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:05.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:08:05.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3820: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-23T08:08:05.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:08:05.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: test 1 = 1 2026-02-23T08:08:05.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:08:05.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-23T08:08:05.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3826: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-23T08:08:05.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-23T08:08:05.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: epoch=100 2026-02-23T08:08:05.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:08:05.633 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:08:05.633 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:08:05.634 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:08:05.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:08:05.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:08:05.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:08:05.646 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:08:05.646 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:08:05.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:08:05.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4459: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:08:05.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4460: corrupt_scrub_erasure: test no = yes 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4465: corrupt_scrub_erasure: test '' = yes 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4470: corrupt_scrub_erasure: pg_deep_scrub 3.0 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:08:05.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:08:05.663 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:05.663 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:05.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:05.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:05.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:05.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:08:05.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:08:05.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:08:05.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:08:05.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:05.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:06.022 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:06.022 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:06.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:06.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=429496729606 2026-02-23T08:08:06.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 429496729606 2026-02-23T08:08:06.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729606' 2026-02-23T08:08:06.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:06.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122058 2026-02-23T08:08:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122058 2026-02-23T08:08:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729606 1-377957122058' 2026-02-23T08:08:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:06.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:06.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743440 2026-02-23T08:08:06.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743440 2026-02-23T08:08:06.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-429496729606 1-377957122058 2-296352743440' 2026-02-23T08:08:06.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:06.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-429496729606 2026-02-23T08:08:06.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:06.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:06.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-429496729606 2026-02-23T08:08:06.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:06.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=429496729606 2026-02-23T08:08:06.248 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 429496729606 2026-02-23T08:08:06.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 429496729606' 2026-02-23T08:08:06.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:06.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729604 -lt 429496729606 2026-02-23T08:08:06.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:07.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:07.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:07.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729606 -lt 429496729606 2026-02-23T08:08:07.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:07.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122058 2026-02-23T08:08:07.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:07.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:07.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122058 2026-02-23T08:08:07.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:07.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122058 2026-02-23T08:08:07.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122058' 2026-02-23T08:08:07.585 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 377957122058 2026-02-23T08:08:07.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:07.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122058 -lt 377957122058 2026-02-23T08:08:07.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:07.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743440 2026-02-23T08:08:07.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:07.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:07.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743440 2026-02-23T08:08:07.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:07.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743440 2026-02-23T08:08:07.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743440' 2026-02-23T08:08:07.752 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 296352743440 2026-02-23T08:08:07.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:07.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743440 -lt 296352743440 2026-02-23T08:08:07.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:08:07.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:08:07.918 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:08:07.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:08:07.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:08:07.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:08:07.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:08:07.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:08:07.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:08:07.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:08:07.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:08:07.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:08:07.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:08:07.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:07.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:08:07.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:07.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:08:08.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:08.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:08:08.317 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0s0 on osd.1 to deep-scrub 2026-02-23T08:08:08.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:06:52.611465+0000 last_deep_scrub_stamp 2026-02-23T08:08:08.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:08:08.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:08.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:08:08.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:08:08.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:08:08.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:08:08.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:08.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:08:08.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:08.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:08:08.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:52.611465+0000 '>' 2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:08.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:08:09.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:08:09.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:08:09.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:08:09.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:09.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:08:09.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:09.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:08:09.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:06:52.611465+0000 '>' 2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:09.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:08:10.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:08:10.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:08:10.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:08:10.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:08:10.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:08:10.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:08:10.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:08:10.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:08:08.749154+0000 '>' 2026-02-23T08:06:52.611465+0000 2026-02-23T08:08:10.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:08:10.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4472: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-23T08:08:10.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:08:10.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: test 1 = 1 2026-02-23T08:08:10.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:08:10.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-23T08:08:10.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4478: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-23T08:08:10.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4479: corrupt_scrub_erasure: cp td/osd-scrub-repair/json /tmp/rrr6.json 2026-02-23T08:08:10.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-23T08:08:10.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: epoch=100 2026-02-23T08:08:10.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4483: corrupt_scrub_erasure: '[' false = true ']' 2026-02-23T08:08:10.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5148: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:08:10.884 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:08:10.884 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:08:10.884 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5148: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:08:10.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5148: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:08:10.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:08:10.897 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:08:10.897 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:08:10.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:08:10.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5891: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:08:10.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:08:10.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5892: corrupt_scrub_erasure: test no = yes 2026-02-23T08:08:10.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5903: corrupt_scrub_erasure: test '' = yes 2026-02-23T08:08:10.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5908: corrupt_scrub_erasure: ceph osd pool rm ecpool ecpool --yes-i-really-really-mean-it 2026-02-23T08:08:11.118 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' removed 2026-02-23T08:08:11.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:08:11.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:08:11.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:08:11.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:11.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:11.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:11.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:11.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:11.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:11.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:08:11.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:08:11.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:08:11.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:08:11.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:08:11.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:08:11.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:08:11.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:08:11.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:08:11.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:08:11.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:08:11.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:08:11.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:08:11.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:08:11.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:08:11.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:11.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:11.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:08:11.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:08:11.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:08:11.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:08:11.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:08:11.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:08:11.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:08:11.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:08:11.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:08:11.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:08:11.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:08:11.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:08:11.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:08:11.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:08:11.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:08:11.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:08:11.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:08:11.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:08:11.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:08:11.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:08:11.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:08:11.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:08:11.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_scrub_erasure_overwrites td/osd-scrub-repair 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5916: TEST_corrupt_scrub_erasure_overwrites: '[' true = true ']' 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5917: TEST_corrupt_scrub_erasure_overwrites: corrupt_scrub_erasure td/osd-scrub-repair true 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3736: corrupt_scrub_erasure: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3737: corrupt_scrub_erasure: local allow_overwrites=true 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3738: corrupt_scrub_erasure: local poolname=ecpool 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3739: corrupt_scrub_erasure: local total_objs=7 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3741: corrupt_scrub_erasure: run_mon td/osd-scrub-repair a 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:08:11.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:08:11.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:08:11.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:08:11.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:11.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:08:11.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:08:11.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:08:11.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:08:11.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:08:11.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:08:11.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:08:11.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:08:11.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:08:11.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:08:11.325 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:08:11.325 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.325 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.325 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:08:11.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:08:11.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:08:11.386 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:08:11.387 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:08:11.387 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.387 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.387 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:08:11.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:08:11.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3742: corrupt_scrub_erasure: run_mgr td/osd-scrub-repair x 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:08:11.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:08:11.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:08:11.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:11.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:11.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:11.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:11.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:08:11.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:08:11.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: seq 0 2 2026-02-23T08:08:11.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 0 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:11.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:11.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:11.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:11.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:08:11.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:08:11.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:11.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:08:11.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:11.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:08:11.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:11.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:11.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:11.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:11.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:11.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:11.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:11.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:11.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:08:11.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:08:11.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:08:11.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:08:11.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:08:11.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:08:11.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b24055af-268c-4bce-8cd3-525a3ca7b8c5' 2026-02-23T08:08:11.564 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:08:11.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:08:11.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrCpxpwoayIRAARpbm5sDP9dTHLTJmuAgOAQ== 2026-02-23T08:08:11.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrCpxpwoayIRAARpbm5sDP9dTHLTJmuAgOAQ=="}' 2026-02-23T08:08:11.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b24055af-268c-4bce-8cd3-525a3ca7b8c5 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:08:11.654 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:08:11.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:08:11.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrCpxpwoayIRAARpbm5sDP9dTHLTJmuAgOAQ== --osd-uuid b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:08:11.678 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:11.677+0000 7f00f6810780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:11.679 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:11.678+0000 7f00f6810780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:11.680 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:11.679+0000 7f00f6810780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:11.680 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:11.679+0000 7f00f6810780 -1 bdev(0x559dca265400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:08:11.680 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:11.679+0000 7f00f6810780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:08:12.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:08:12.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:08:12.141 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:08:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:08:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:08:12.236 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:08:12.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:08:12.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:12.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:08:12.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:08:12.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:08:12.249 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:12.248+0000 7f0e090a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:12.251 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:12.249+0000 7f0e090a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:12.252 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:12.250+0000 7f0e090a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:12.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:12.331 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:08:12.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:12.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:08:12.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:12.480 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:12.478+0000 7f0e090a0780 -1 Falling back to public interface 2026-02-23T08:08:12.814 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:12.811+0000 7f0e090a0780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:08:13.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:13.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:13.424 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:08:13.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:13.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:13.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:08:13.516 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3571679930,v1:127.0.0.1:6801/3571679930] [v2:127.0.0.1:6802/3571679930,v1:127.0.0.1:6803/3571679930] exists,up b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:08:13.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 1 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:08:13.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:13.522 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:13.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:08:13.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:08:13.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:08:13.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:08:13.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:08:13.524 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:08:13.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 52ba07d9-a3ba-4817-8de4-eb1ce1797f60' 2026-02-23T08:08:13.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:08:13.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDtCpxppeR4HxAA2hIb9SQHltini8LCwUe4oQ== 2026-02-23T08:08:13.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDtCpxppeR4HxAA2hIb9SQHltini8LCwUe4oQ=="}' 2026-02-23T08:08:13.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:08:13.617 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:08:13.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:08:13.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDtCpxppeR4HxAA2hIb9SQHltini8LCwUe4oQ== --osd-uuid 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:08:13.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:13.638+0000 7f7226f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:13.641 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:13.639+0000 7f7226f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:13.642 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:13.640+0000 7f7226f4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:13.643 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:13.640+0000 7f7226f4f780 -1 bdev(0x5559ca795400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:08:13.643 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:13.640+0000 7f7226f4f780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:08:14.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:08:14.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:08:14.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:08:14.091 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:08:14.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:08:14.297 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:08:14.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:08:14.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:14.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:08:14.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:08:14.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:08:14.310 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:14.307+0000 7f41fca11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:14.311 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:14.309+0000 7f41fca11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:14.312 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:14.310+0000 7f41fca11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:14.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:08:14.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:14.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:08:14.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:14.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:14.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:14.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:14.465 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:08:14.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:14.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:08:14.509 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:14.507+0000 7f41fca11780 -1 Falling back to public interface 2026-02-23T08:08:14.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:14.883 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:14.881+0000 7f41fca11780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:08:15.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:15.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:15.630 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:08:15.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:15.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:15.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:08:15.794 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3370943871,v1:127.0.0.1:6811/3370943871] [v2:127.0.0.1:6812/3370943871,v1:127.0.0.1:6813/3370943871] exists,up 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:08:15.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:15.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3743: corrupt_scrub_erasure: for id in $(seq 0 2) 2026-02-23T08:08:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3744: corrupt_scrub_erasure: run_osd td/osd-scrub-repair 2 2026-02-23T08:08:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:08:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:08:15.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:08:15.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:08:15.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:15.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:15.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:15.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:08:15.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:15.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:15.806 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:15.806 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:15.806 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:15.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:15.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:15.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:15.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:15.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:15.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:08:15.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:08:15.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:08:15.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:08:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c2c78efd-31fa-4fd3-978e-f4151ce53195 2026-02-23T08:08:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c2c78efd-31fa-4fd3-978e-f4151ce53195' 2026-02-23T08:08:15.810 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 c2c78efd-31fa-4fd3-978e-f4151ce53195 2026-02-23T08:08:15.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:08:15.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDvCpxpOoL+LxAAfa9OK1hNCCqL7/7YlmEG8A== 2026-02-23T08:08:15.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDvCpxpOoL+LxAAfa9OK1hNCCqL7/7YlmEG8A=="}' 2026-02-23T08:08:15.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c2c78efd-31fa-4fd3-978e-f4151ce53195 -i td/osd-scrub-repair/2/new.json 2026-02-23T08:08:15.965 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:08:15.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:08:15.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDvCpxpOoL+LxAAfa9OK1hNCCqL7/7YlmEG8A== --osd-uuid c2c78efd-31fa-4fd3-978e-f4151ce53195 2026-02-23T08:08:15.990 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:15.988+0000 7f3028ea6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:15.992 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:15.990+0000 7f3028ea6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:15.992 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:15.990+0000 7f3028ea6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:15.993 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:15.991+0000 7f3028ea6780 -1 bdev(0x55fb02b27400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:08:15.993 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:15.991+0000 7f3028ea6780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:08:16.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:08:16.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:08:16.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:08:16.416 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:08:16.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:08:16.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:08:16.621 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:08:16.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:16.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:08:16.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:08:16.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:08:16.633 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:16.630+0000 7f41f954f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:16.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:16.632+0000 7f41f954f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:16.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:16.632+0000 7f41f954f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:16.785 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:08:16.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:16.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:16.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:08:16.854 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:16.852+0000 7f41f954f780 -1 Falling back to public interface 2026-02-23T08:08:16.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:17.176 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:17.174+0000 7f41f954f780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:08:17.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:17.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:17.951 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:08:17.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:17.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:17.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:08:18.119 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/810130963,v1:127.0.0.1:6819/810130963] [v2:127.0.0.1:6820/810130963,v1:127.0.0.1:6821/810130963] exists,up c2c78efd-31fa-4fd3-978e-f4151ce53195 2026-02-23T08:08:18.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:18.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:18.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:18.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3746: corrupt_scrub_erasure: create_rbd_pool 2026-02-23T08:08:18.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:08:18.273 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:08:18.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:08:18.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:08:18.462 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:08:18.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:08:19.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:08:19.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3747: corrupt_scrub_erasure: create_pool foo 1 2026-02-23T08:08:19.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-23T08:08:19.951 INFO:tasks.workunit.client.0.trial129.stderr:pool 'foo' created 2026-02-23T08:08:19.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:08:20.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3749: corrupt_scrub_erasure: create_ec_pool ecpool true k=2 m=1 stripe_unit=2K --force 2026-02-23T08:08:20.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:08:20.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:08:20.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-23T08:08:20.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:08:20.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 stripe_unit=2K --force 2026-02-23T08:08:21.177 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:08:21.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:08:21.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:08:21.483 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:08:21.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:08:22.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-23T08:08:22.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-23T08:08:22.706 INFO:tasks.workunit.client.0.trial129.stderr:set pool 3 allow_ec_overwrites to true 2026-02-23T08:08:22.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:08:22.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:22.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:22.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:22.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:22.718 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:22.718 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:22.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:22.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:22.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:22.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:22.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:22.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:22.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:22.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:22.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:22.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:22.963 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:22.963 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:22.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:22.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:22.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:23.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:08:23.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:08:23.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:08:23.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:23.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:23.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T08:08:23.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T08:08:23.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T08:08:23.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:23.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:23.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T08:08:23.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T08:08:23.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-23T08:08:23.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:23.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:08:23.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:23.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:23.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:08:23.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:23.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:08:23.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:08:23.185 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:08:23.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:23.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:08:23.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:24.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:24.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:24.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:08:24.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:24.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T08:08:24.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:24.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:24.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T08:08:24.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:24.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T08:08:24.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T08:08:24.520 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T08:08:24.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:24.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-23T08:08:24.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:24.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T08:08:24.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:24.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:24.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T08:08:24.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:24.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T08:08:24.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T08:08:24.688 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T08:08:24.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:24.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-23T08:08:24.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:24.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:24.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:25.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:25.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:25.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:25.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:25.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:25.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:25.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:25.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:25.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:25.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:25.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:25.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3750: corrupt_scrub_erasure: wait_for_clean 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:25.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:25.435 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:25.435 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:25.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:25.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:25.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:25.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:25.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:25.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:25.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:25.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:25.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:25.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:25.679 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:25.679 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:25.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:25.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:25.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:25.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:08:25.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:08:25.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:08:25.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:25.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:25.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T08:08:25.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T08:08:25.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-23T08:08:25.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:25.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:25.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T08:08:25.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T08:08:25.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-60129542148' 2026-02-23T08:08:25.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:25.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:08:25.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:25.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:08:25.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:08:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:08:25.934 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:08:25.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:26.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:08:26.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:27.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:27.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:27.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:08:27.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:28.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:08:28.236 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:28.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:08:28.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:28.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T08:08:28.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:28.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T08:08:28.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:28.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T08:08:28.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T08:08:28.404 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T08:08:28.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:28.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705668 2026-02-23T08:08:28.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:28.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T08:08:28.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:28.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T08:08:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:28.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T08:08:28.575 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542148 2026-02-23T08:08:28.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T08:08:28.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:28.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T08:08:28.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:28.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:28.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:28.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:28.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:29.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:29.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:29.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:29.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:29.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:29.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:29.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:29.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: seq 1 7 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ1 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ1 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ1 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:08:29.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:08:29.517 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:08:29.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:08:29.722 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:08:29.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:08:29.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:08:29.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:08:29.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 1 % 2 2026-02-23T08:08:29.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:08:29.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:08:29.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3761: corrupt_scrub_erasure: local payload=UVWXYZZZ 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3762: corrupt_scrub_erasure: echo UVWXYZZZ 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3763: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:08:29.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:08:29.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:29.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:29.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:29.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:29.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:30.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:08:30.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:30.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:08:30.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:30.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:30.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:30.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:08:30.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:08:30.245 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:30.243+0000 7f79f6808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:30.247 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:30.245+0000 7f79f6808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:30.247 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:30.246+0000 7f79f6808780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:30.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:08:30.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:08:30.475 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:30.472+0000 7f79f6808780 -1 Falling back to public interface 2026-02-23T08:08:30.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:30.796 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:30.794+0000 7f79f6808780 -1 osd.1 33 log_to_monitors true 2026-02-23T08:08:31.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:31.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:31.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:31.567 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:31.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:31.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:08:31.732 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 37 up_thru 37 down_at 34 last_clean_interval [9,33) [v2:127.0.0.1:6810/2522641968,v1:127.0.0.1:6811/2522641968] [v2:127.0.0.1:6812/2522641968,v1:127.0.0.1:6813/2522641968] exists,up 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:08:31.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:31.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:31.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:31.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:31.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:31.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:31.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:31.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:31.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:31.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:31.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:31.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:31.981 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:31.981 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:31.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:31.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:31.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:32.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:08:32.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:08:32.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:08:32.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:32.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789954 2026-02-23T08:08:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789954 2026-02-23T08:08:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-158913789954' 2026-02-23T08:08:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:32.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:32.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-23T08:08:32.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-23T08:08:32.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-158913789954 2-60129542150' 2026-02-23T08:08:32.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:32.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:08:32.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:32.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:32.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:08:32.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:32.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:08:32.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:08:32.204 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T08:08:32.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:08:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:33.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:33.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:33.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:08:33.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:34.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:08:34.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:34.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:08:34.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:34.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-158913789954 2026-02-23T08:08:34.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:34.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:34.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-158913789954 2026-02-23T08:08:34.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:34.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789954 2026-02-23T08:08:34.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 158913789954' 2026-02-23T08:08:34.710 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 158913789954 2026-02-23T08:08:34.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:34.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789954 -lt 158913789954 2026-02-23T08:08:34.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:34.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-23T08:08:34.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:34.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:34.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-23T08:08:34.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:34.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-23T08:08:34.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-23T08:08:34.882 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542150 2026-02-23T08:08:34.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:35.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542151 -lt 60129542150 2026-02-23T08:08:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:35.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:35.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:35.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:35.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:35.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:35.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:35.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:35.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:35.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:35.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:35.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:35.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:35.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ2 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ2 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ2 2026-02-23T08:08:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:08:35.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:08:35.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:08:35.808 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:08:35.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:08:36.010 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:08:36.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:08:36.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:08:36.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:08:36.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 2 % 2 2026-02-23T08:08:36.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-23T08:08:36.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:08:36.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3768: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=1 2026-02-23T08:08:36.041 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:08:36.041 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:08:36.041 INFO:tasks.workunit.client.0.trial129.stderr:2048 bytes (2.0 kB, 2.0 KiB) copied, 3.7671e-05 s, 54.4 MB/s 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3769: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:36.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:36.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:36.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:36.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:08:36.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:08:36.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:08:36.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:08:36.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:08:36.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:36.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:36.527 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:36.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:08:36.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:08:36.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:08:36.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:08:36.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:08:36.541 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:36.539+0000 7f2bfb879780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:36.543 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:36.541+0000 7f2bfb879780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:36.544 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:36.542+0000 7f2bfb879780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:36.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:36.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:08:36.755 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:36.753+0000 7f2bfb879780 -1 Falling back to public interface 2026-02-23T08:08:36.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:37.099 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:37.097+0000 7f2bfb879780 -1 osd.0 40 log_to_monitors true 2026-02-23T08:08:37.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:37.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:37.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:37.861 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:37.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:37.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 44 up_thru 44 down_at 41 last_clean_interval [5,40) [v2:127.0.0.1:6800/1602834299,v1:127.0.0.1:6801/1602834299] [v2:127.0.0.1:6802/1602834299,v1:127.0.0.1:6803/1602834299] exists,up b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:38.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:38.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:38.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:38.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:38.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:38.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:38.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:38.275 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:38.275 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:38.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:38.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561026 2026-02-23T08:08:38.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561026 2026-02-23T08:08:38.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561026' 2026-02-23T08:08:38.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:38.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:38.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789956 2026-02-23T08:08:38.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789956 2026-02-23T08:08:38.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561026 1-158913789956' 2026-02-23T08:08:38.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:38.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:38.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T08:08:38.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T08:08:38.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561026 1-158913789956 2-60129542153' 2026-02-23T08:08:38.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:38.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-188978561026 2026-02-23T08:08:38.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:38.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:38.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-188978561026 2026-02-23T08:08:38.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:38.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561026 2026-02-23T08:08:38.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 188978561026' 2026-02-23T08:08:38.499 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 188978561026 2026-02-23T08:08:38.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:38.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 188978561026 2026-02-23T08:08:38.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:39.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:39.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:39.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561026 -lt 188978561026 2026-02-23T08:08:39.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:39.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-158913789956 2026-02-23T08:08:39.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:39.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:39.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-158913789956 2026-02-23T08:08:39.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:39.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789956 2026-02-23T08:08:39.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 158913789956' 2026-02-23T08:08:39.837 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 158913789956 2026-02-23T08:08:39.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:40.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789956 2026-02-23T08:08:40.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:40.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T08:08:40.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:40.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:40.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T08:08:40.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:40.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T08:08:40.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T08:08:40.007 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542153 2026-02-23T08:08:40.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:40.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-23T08:08:40.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:40.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:40.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:40.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:40.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:40.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:40.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:40.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:40.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:40.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:40.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:40.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:40.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:40.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:40.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:40.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:40.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:40.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ3 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ3 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ3 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:08:40.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:08:40.949 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:08:40.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:08:41.153 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:08:41.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:08:41.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:08:41.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:08:41.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 3 % 2 2026-02-23T08:08:41.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:08:41.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:08:41.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3774: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ3 remove 2026-02-23T08:08:41.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ3 remove 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:08:41.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:41.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:41.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:41.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:41.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ3 remove 2026-02-23T08:08:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:08:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:08:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:08:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:08:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:08:41.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ3 remove 2026-02-23T08:08:41.593 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#3:b197b25d:::EOBJ3:head# 2026-02-23T08:08:41.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:41.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:41.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:08:41.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:08:41.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:08:41.671 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:08:41.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:41.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:08:41.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:08:41.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:08:41.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:08:41.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:08:41.681 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:41.679+0000 7fa90860d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:41.682 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:41.680+0000 7fa90860d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:41.683 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:41.681+0000 7fa90860d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:41.829 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:41.827+0000 7fa90860d780 -1 Falling back to public interface 2026-02-23T08:08:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:08:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:41.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:08:41.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:42.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:42.162+0000 7fa90860d780 -1 osd.1 48 log_to_monitors true 2026-02-23T08:08:42.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:42.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:42.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:42.999 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:42.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:42.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:08:43.169 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 49 last_clean_interval [37,48) [v2:127.0.0.1:6810/687261876,v1:127.0.0.1:6811/687261876] [v2:127.0.0.1:6812/687261876,v1:127.0.0.1:6813/687261876] exists,up 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:08:43.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:43.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:43.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:43.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:43.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:43.415 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:43.416 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:43.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:43.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:43.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:43.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561028 2026-02-23T08:08:43.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561028 2026-02-23T08:08:43.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561028' 2026-02-23T08:08:43.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:43.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:43.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299394 2026-02-23T08:08:43.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299394 2026-02-23T08:08:43.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561028 1-223338299394' 2026-02-23T08:08:43.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:43.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:43.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542155 2026-02-23T08:08:43.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542155 2026-02-23T08:08:43.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-188978561028 1-223338299394 2-60129542155' 2026-02-23T08:08:43.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:43.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-188978561028 2026-02-23T08:08:43.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:43.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:43.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-188978561028 2026-02-23T08:08:43.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:43.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561028 2026-02-23T08:08:43.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 188978561028' 2026-02-23T08:08:43.640 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 188978561028 2026-02-23T08:08:43.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:43.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561028 -lt 188978561028 2026-02-23T08:08:43.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:43.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299394 2026-02-23T08:08:43.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:43.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:43.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299394 2026-02-23T08:08:43.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:43.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299394 2026-02-23T08:08:43.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299394' 2026-02-23T08:08:43.813 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 223338299394 2026-02-23T08:08:43.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:43.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 223338299394 2026-02-23T08:08:43.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:44.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:44.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 223338299394 2026-02-23T08:08:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:46.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:08:46.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:46.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299394 -lt 223338299394 2026-02-23T08:08:46.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:46.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542155 2026-02-23T08:08:46.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:46.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:46.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542155 2026-02-23T08:08:46.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:46.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542155 2026-02-23T08:08:46.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542155' 2026-02-23T08:08:46.325 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542155 2026-02-23T08:08:46.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542155 2026-02-23T08:08:46.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:46.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:46.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:46.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:46.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:46.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:46.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:46.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:46.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:46.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:46.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:46.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:46.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:46.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:47.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:47.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:47.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:47.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ4 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ4 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ4 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:08:47.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:08:47.272 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:08:47.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:08:47.476 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:08:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:08:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:08:47.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:08:47.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 4 % 2 2026-02-23T08:08:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-23T08:08:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:08:47.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3778: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key1-EOBJ4 val1-EOBJ4 2026-02-23T08:08:47.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3779: corrupt_scrub_erasure: rados --pool ecpool setxattr EOBJ4 key2-EOBJ4 val2-EOBJ4 2026-02-23T08:08:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3782: corrupt_scrub_erasure: echo -n bad-val 2026-02-23T08:08:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3783: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:08:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:08:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:08:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:08:47.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:47.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:08:47.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ4 set-attr _key1-EOBJ4 td/osd-scrub-repair/bad-val 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:47.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:47.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:47.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:08:47.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:08:47.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:08:47.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:08:47.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:08:47.818 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:47.816+0000 7fe2a7e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:47.819 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:47.817+0000 7fe2a7e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:47.820 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:47.818+0000 7fe2a7e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:47.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:08:47.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:47.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:08:48.017 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:48.015+0000 7fe2a7e0c780 -1 Falling back to public interface 2026-02-23T08:08:48.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:48.414 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:48.412+0000 7fe2a7e0c780 -1 osd.0 55 log_to_monitors true 2026-02-23T08:08:49.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:49.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:49.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:49.138 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:49.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:49.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 59 up_thru 59 down_at 56 last_clean_interval [44,55) [v2:127.0.0.1:6800/103400152,v1:127.0.0.1:6801/103400152] [v2:127.0.0.1:6802/103400152,v1:127.0.0.1:6803/103400152] exists,up b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:49.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:49.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:49.305 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:49.305 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:49.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:49.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:49.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:49.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:49.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:49.555 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:49.555 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:49.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:49.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:49.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:49.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070466 2026-02-23T08:08:49.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070466 2026-02-23T08:08:49.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070466' 2026-02-23T08:08:49.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:49.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299396 2026-02-23T08:08:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299396 2026-02-23T08:08:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070466 1-223338299396' 2026-02-23T08:08:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:49.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:49.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542157 2026-02-23T08:08:49.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542157 2026-02-23T08:08:49.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070466 1-223338299396 2-60129542157' 2026-02-23T08:08:49.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:49.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070466 2026-02-23T08:08:49.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:49.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:49.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070466 2026-02-23T08:08:49.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:49.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070466 2026-02-23T08:08:49.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070466' 2026-02-23T08:08:49.786 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 253403070466 2026-02-23T08:08:49.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:49.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 253403070466 2026-02-23T08:08:49.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:50.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:50.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:51.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 253403070466 2026-02-23T08:08:51.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:52.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:08:52.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070466 -lt 253403070466 2026-02-23T08:08:52.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:52.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299396 2026-02-23T08:08:52.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:52.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:52.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299396 2026-02-23T08:08:52.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:52.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299396 2026-02-23T08:08:52.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299396' 2026-02-23T08:08:52.289 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 223338299396 2026-02-23T08:08:52.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:52.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299396 -lt 223338299396 2026-02-23T08:08:52.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:52.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542157 2026-02-23T08:08:52.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:52.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:52.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542157 2026-02-23T08:08:52.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:52.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542157 2026-02-23T08:08:52.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542157' 2026-02-23T08:08:52.459 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 60129542157 2026-02-23T08:08:52.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:52.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542157 -lt 60129542157 2026-02-23T08:08:52.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:52.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:52.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:52.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:52.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:52.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:52.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:52.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:52.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:53.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3784: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:08:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:53.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:08:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:08:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:08:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:08:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:08:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:08:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 rm-attr _key2-EOBJ4 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:08:53.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:53.694 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:53.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:08:53.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:08:53.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:08:53.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:08:53.696 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:08:53.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:53.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:08:53.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:08:53.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:08:53.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:08:53.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:08:53.705 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:53.703+0000 7f2b32e8d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:53.706 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:53.704+0000 7f2b32e8d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:53.707 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:53.705+0000 7f2b32e8d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:53.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:53.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:08:53.896 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:53.894+0000 7f2b32e8d780 -1 Falling back to public interface 2026-02-23T08:08:54.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:08:54.264 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:54.262+0000 7f2b32e8d780 -1 osd.2 61 log_to_monitors true 2026-02-23T08:08:55.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:08:55.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:55.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:08:55.027 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:55.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:55.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:08:55.192 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 64 up_thru 64 down_at 61 last_clean_interval [14,61) [v2:127.0.0.1:6818/3070910689,v1:127.0.0.1:6819/3070910689] [v2:127.0.0.1:6820/3070910689,v1:127.0.0.1:6821/3070910689] exists,up c2c78efd-31fa-4fd3-978e-f4151ce53195 2026-02-23T08:08:55.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:08:55.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:08:55.194 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:08:55.194 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:08:55.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:08:55.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:08:55.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:08:55.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:08:55.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:08:55.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:08:55.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:08:55.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:08:55.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:08:55.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:08:55.437 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:08:55.438 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:08:55.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:08:55.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:55.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:08:55.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070468 2026-02-23T08:08:55.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070468 2026-02-23T08:08:55.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070468' 2026-02-23T08:08:55.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:55.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:08:55.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299398 2026-02-23T08:08:55.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299398 2026-02-23T08:08:55.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070468 1-223338299398' 2026-02-23T08:08:55.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:08:55.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:08:55.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=274877906946 2026-02-23T08:08:55.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 274877906946 2026-02-23T08:08:55.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070468 1-223338299398 2-274877906946' 2026-02-23T08:08:55.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:55.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070468 2026-02-23T08:08:55.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:55.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:08:55.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070468 2026-02-23T08:08:55.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:55.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070468 2026-02-23T08:08:55.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070468' 2026-02-23T08:08:55.663 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 253403070468 2026-02-23T08:08:55.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:08:55.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070468 -lt 253403070468 2026-02-23T08:08:55.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:55.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299398 2026-02-23T08:08:55.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:55.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:08:55.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299398 2026-02-23T08:08:55.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:55.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299398 2026-02-23T08:08:55.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299398' 2026-02-23T08:08:55.828 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 223338299398 2026-02-23T08:08:55.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:55.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299397 -lt 223338299398 2026-02-23T08:08:55.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:56.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:08:56.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:57.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299397 -lt 223338299398 2026-02-23T08:08:57.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:08:58.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:08:58.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:08:58.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299399 -lt 223338299398 2026-02-23T08:08:58.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:08:58.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-274877906946 2026-02-23T08:08:58.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:08:58.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:08:58.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-274877906946 2026-02-23T08:08:58.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:08:58.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=274877906946 2026-02-23T08:08:58.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 274877906946' 2026-02-23T08:08:58.334 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 274877906946 2026-02-23T08:08:58.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:08:58.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 274877906946 -lt 274877906946 2026-02-23T08:08:58.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:08:58.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:58.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:58.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:08:58.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:08:58.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:08:58.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:08:58.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:08:58.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:08:59.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:08:59.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:08:59.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3785: corrupt_scrub_erasure: echo -n val3-EOBJ4 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3786: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:08:59.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:08:59.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:08:59.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:08:59.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:08:59.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:08:59.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:08:59.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:08:59.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:08:59.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 EOBJ4 set-attr _key3-EOBJ4 td/osd-scrub-repair/newval 2026-02-23T08:08:59.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:08:59.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:08:59.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:08:59.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:08:59.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:08:59.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:08:59.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:08:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:08:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:08:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:08:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:08:59.546 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:59.544+0000 7faa3e354780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:59.547 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:59.545+0000 7faa3e354780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:59.548 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:59.546+0000 7faa3e354780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:08:59.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:08:59.702 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:08:59.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:08:59.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:08:59.757 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:08:59.755+0000 7faa3e354780 -1 Falling back to public interface 2026-02-23T08:08:59.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:00.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:00.095+0000 7faa3e354780 -1 osd.2 65 log_to_monitors true 2026-02-23T08:09:00.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:00.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:00.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:00.869 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:00.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:00.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:09:01.037 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 69 up_thru 69 down_at 66 last_clean_interval [64,65) [v2:127.0.0.1:6818/890778067,v1:127.0.0.1:6819/890778067] [v2:127.0.0.1:6820/890778067,v1:127.0.0.1:6821/890778067] exists,up c2c78efd-31fa-4fd3-978e-f4151ce53195 2026-02-23T08:09:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:09:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:01.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:01.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:01.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:01.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:01.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:01.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:01.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:01.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:01.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:01.280 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:01.280 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:01.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:01.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:01.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:01.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070470 2026-02-23T08:09:01.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070470 2026-02-23T08:09:01.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070470' 2026-02-23T08:09:01.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:01.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:01.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=223338299400 2026-02-23T08:09:01.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 223338299400 2026-02-23T08:09:01.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070470 1-223338299400' 2026-02-23T08:09:01.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:01.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:01.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743426 2026-02-23T08:09:01.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743426 2026-02-23T08:09:01.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070470 1-223338299400 2-296352743426' 2026-02-23T08:09:01.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:01.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070470 2026-02-23T08:09:01.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:01.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:01.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070470 2026-02-23T08:09:01.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:01.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070470 2026-02-23T08:09:01.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070470' 2026-02-23T08:09:01.505 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 253403070470 2026-02-23T08:09:01.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:01.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070470 -lt 253403070470 2026-02-23T08:09:01.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:01.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-223338299400 2026-02-23T08:09:01.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:01.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:01.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-223338299400 2026-02-23T08:09:01.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:01.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=223338299400 2026-02-23T08:09:01.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 223338299400' 2026-02-23T08:09:01.673 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 223338299400 2026-02-23T08:09:01.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:01.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 223338299400 -lt 223338299400 2026-02-23T08:09:01.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:01.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743426 2026-02-23T08:09:01.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:01.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:01.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743426 2026-02-23T08:09:01.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:01.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743426 2026-02-23T08:09:01.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743426' 2026-02-23T08:09:01.845 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743426 2026-02-23T08:09:01.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:02.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743426 -lt 296352743426 2026-02-23T08:09:02.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:02.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:02.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:02.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:02.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:02.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:02.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:02.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:02.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:02.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:02.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:02.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:02.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:02.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:02.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:02.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:02.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:02.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:02.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3787: corrupt_scrub_erasure: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ5 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ5 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ5 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:02.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:02.797 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:02.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:03.002 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:03.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:03.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:03.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:03.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 5 % 2 2026-02-23T08:09:03.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:09:03.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:09:03.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3792: corrupt_scrub_erasure: dd if=/dev/urandom of=td/osd-scrub-repair/CORRUPT bs=2048 count=2 2026-02-23T08:09:03.033 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records in 2026-02-23T08:09:03.033 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records out 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:4096 bytes (4.1 kB, 4.0 KiB) copied, 3.745e-05 s, 109 MB/s 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3793: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:09:03.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:09:03.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:03.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:03.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:03.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:03.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:03.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:03.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:09:03.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:09:03.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:09:03.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:09:03.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:09:03.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:09:03.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ5 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:09:03.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:03.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:03.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:09:03.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:03.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:09:03.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:09:03.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:09:03.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:09:03.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:09:03.530 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:03.528+0000 7fa40dd4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:03.531 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:03.529+0000 7fa40dd4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:03.532 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:03.530+0000 7fa40dd4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:03.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:09:03.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:03.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:09:03.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:03.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:03.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:03.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:03.687 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:09:03.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:03.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:09:03.695 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:03.693+0000 7fa40dd4f780 -1 Falling back to public interface 2026-02-23T08:09:03.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:04.046 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:04.044+0000 7fa40dd4f780 -1 osd.1 73 log_to_monitors true 2026-02-23T08:09:04.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:04.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:04.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:04.852 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:04.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:04.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [52,73) [v2:127.0.0.1:6810/2814096864,v1:127.0.0.1:6811/2814096864] [v2:127.0.0.1:6812/2814096864,v1:127.0.0.1:6813/2814096864] exists,up 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:05.016 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:05.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:05.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:05.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:05.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:05.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:05.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:05.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:05.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:05.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:05.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:05.260 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:05.260 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:05.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:05.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:05.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:05.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=253403070472 2026-02-23T08:09:05.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 253403070472 2026-02-23T08:09:05.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070472' 2026-02-23T08:09:05.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:05.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-23T08:09:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-23T08:09:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070472 1-330712481794' 2026-02-23T08:09:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:05.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:05.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743428 2026-02-23T08:09:05.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743428 2026-02-23T08:09:05.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-253403070472 1-330712481794 2-296352743428' 2026-02-23T08:09:05.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:05.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-253403070472 2026-02-23T08:09:05.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:05.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-253403070472 2026-02-23T08:09:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:05.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=253403070472 2026-02-23T08:09:05.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 253403070472' 2026-02-23T08:09:05.483 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 253403070472 2026-02-23T08:09:05.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:05.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 253403070472 -lt 253403070472 2026-02-23T08:09:05.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:05.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481794 2026-02-23T08:09:05.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:05.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:05.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481794 2026-02-23T08:09:05.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:05.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-23T08:09:05.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481794' 2026-02-23T08:09:05.651 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 330712481794 2026-02-23T08:09:05.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:05.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481794 -lt 330712481794 2026-02-23T08:09:05.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:05.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743428 2026-02-23T08:09:05.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:05.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:05.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743428 2026-02-23T08:09:05.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:05.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743428 2026-02-23T08:09:05.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743428' 2026-02-23T08:09:05.820 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743428 2026-02-23T08:09:05.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:05.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743428 -lt 296352743428 2026-02-23T08:09:05.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:05.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:05.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:06.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:06.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:06.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:06.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:06.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:06.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:06.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ6 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ6 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ6 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:06.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:06.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:06.763 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:06.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:06.967 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:06.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:06.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:06.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:06.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 6 % 2 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=0 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3797: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:09:06.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:06.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:07.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:07.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:09:07.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:09:07.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:09:07.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:09:07.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:09:07.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:07.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ6 rm-attr hinfo_key 2026-02-23T08:09:07.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:09:07.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:09:07.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:07.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:07.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:09:07.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:09:07.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:09:07.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:09:07.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:09:07.482 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:07.480+0000 7f5685e14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:07.483 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:07.481+0000 7f5685e14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:07.484 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:07.482+0000 7f5685e14780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:09:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:09:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:07.638 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:09:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:07.680 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:07.678+0000 7f5685e14780 -1 Falling back to public interface 2026-02-23T08:09:07.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:08.010 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:08.008+0000 7f5685e14780 -1 osd.0 80 log_to_monitors true 2026-02-23T08:09:08.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:08.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:08.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:08.800 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:08.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:08.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:08.968 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [59,80) [v2:127.0.0.1:6800/3570811716,v1:127.0.0.1:6801/3570811716] [v2:127.0.0.1:6802/3570811716,v1:127.0.0.1:6803/3570811716] exists,up b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:09:08.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:08.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:08.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:08.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:09:08.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:08.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:08.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:08.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:08.970 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:08.970 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:08.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:08.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:08.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:09.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:09.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:09.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:09.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:09.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:09.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:09.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:09.218 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:09.218 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:09.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:09.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:09.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:09.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252866 2026-02-23T08:09:09.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252866 2026-02-23T08:09:09.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866' 2026-02-23T08:09:09.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:09.296 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:09.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481796 2026-02-23T08:09:09.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481796 2026-02-23T08:09:09.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-330712481796' 2026-02-23T08:09:09.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:09.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:09.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743429 2026-02-23T08:09:09.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743429 2026-02-23T08:09:09.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252866 1-330712481796 2-296352743429' 2026-02-23T08:09:09.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:09.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252866 2026-02-23T08:09:09.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:09.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:09.445 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252866 2026-02-23T08:09:09.445 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252866 2026-02-23T08:09:09.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252866' 2026-02-23T08:09:09.447 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 360777252866 2026-02-23T08:09:09.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:09.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252866 2026-02-23T08:09:09.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:09.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481796 2026-02-23T08:09:09.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:09.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:09.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481796 2026-02-23T08:09:09.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:09.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481796 2026-02-23T08:09:09.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481796' 2026-02-23T08:09:09.615 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 330712481796 2026-02-23T08:09:09.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:09.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481796 -lt 330712481796 2026-02-23T08:09:09.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:09.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743429 2026-02-23T08:09:09.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:09.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743429 2026-02-23T08:09:09.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:09.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743429 2026-02-23T08:09:09.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743429' 2026-02-23T08:09:09.785 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743429 2026-02-23T08:09:09.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:09.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743429 -lt 296352743429 2026-02-23T08:09:09.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:09.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:09.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:10.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:10.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:10.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:10.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:10.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:10.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3798: corrupt_scrub_erasure: echo -n bad-val 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3799: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:09:10.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:10.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:10.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:10.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:10.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:09:10.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:09:10.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:09:10.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:09:10.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:09:10.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:09:10.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 EOBJ6 set-attr hinfo_key td/osd-scrub-repair/bad-val 2026-02-23T08:09:10.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:09:10.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:10.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:10.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:10.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:10.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:10.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:09:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:09:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:09:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:09:10.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:09:10.812 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:10.811+0000 7f779a67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:10.814 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:10.812+0000 7f779a67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:10.815 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:10.813+0000 7f779a67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:10.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:10.967 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:09:10.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:10.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:09:11.024 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:11.022+0000 7f779a67e780 -1 Falling back to public interface 2026-02-23T08:09:11.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:11.299 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:11.297+0000 7f779a67e780 -1 osd.1 85 log_to_monitors true 2026-02-23T08:09:12.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:12.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:12.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:12.135 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:12.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:12.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:09:12.300 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 89 up_thru 89 down_at 86 last_clean_interval [77,85) [v2:127.0.0.1:6810/2308785239,v1:127.0.0.1:6811/2308785239] [v2:127.0.0.1:6812/2308785239,v1:127.0.0.1:6813/2308785239] exists,up 52ba07d9-a3ba-4817-8de4-eb1ce1797f60 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:12.301 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:12.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:12.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:12.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:12.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:12.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:12.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:12.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:12.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:12.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:12.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:12.543 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:12.544 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:12.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:12.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:12.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-23T08:09:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-23T08:09:12.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867' 2026-02-23T08:09:12.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:12.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:12.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089346 2026-02-23T08:09:12.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089346 2026-02-23T08:09:12.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-382252089346' 2026-02-23T08:09:12.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:12.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:12.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743431 2026-02-23T08:09:12.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743431 2026-02-23T08:09:12.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-382252089346 2-296352743431' 2026-02-23T08:09:12.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:12.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252867 2026-02-23T08:09:12.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:12.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:12.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252867 2026-02-23T08:09:12.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:12.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-23T08:09:12.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252867' 2026-02-23T08:09:12.767 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 360777252867 2026-02-23T08:09:12.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:12.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252866 -lt 360777252867 2026-02-23T08:09:12.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:13.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:13.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:14.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252868 -lt 360777252867 2026-02-23T08:09:14.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:14.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089346 2026-02-23T08:09:14.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:14.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:14.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089346 2026-02-23T08:09:14.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:14.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089346 2026-02-23T08:09:14.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089346' 2026-02-23T08:09:14.101 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 382252089346 2026-02-23T08:09:14.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:14.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089346 -lt 382252089346 2026-02-23T08:09:14.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:14.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743431 2026-02-23T08:09:14.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:14.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:14.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743431 2026-02-23T08:09:14.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:14.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743431 2026-02-23T08:09:14.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743431' 2026-02-23T08:09:14.270 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743431 2026-02-23T08:09:14.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:14.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743431 -lt 296352743431 2026-02-23T08:09:14.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:14.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:14.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:14.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:14.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:14.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:14.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:14.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:14.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3752: corrupt_scrub_erasure: for i in $(seq 1 $total_objs) 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3753: corrupt_scrub_erasure: objname=EOBJ7 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3754: corrupt_scrub_erasure: add_something td/osd-scrub-repair ecpool EOBJ7 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=EOBJ7 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:15.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:15.214 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:15.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:15.418 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:15.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:15.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:15.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:15.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: expr 7 % 2 2026-02-23T08:09:15.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3756: corrupt_scrub_erasure: local osd=1 2026-02-23T08:09:15.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3758: corrupt_scrub_erasure: case $i in 2026-02-23T08:09:15.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3803: corrupt_scrub_erasure: local payload=MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-23T08:09:15.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3804: corrupt_scrub_erasure: echo MAKETHISDIFFERENTFROMOTHEROBJECTS 2026-02-23T08:09:15.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3805: corrupt_scrub_erasure: rados --pool ecpool put EOBJ7 td/osd-scrub-repair/DIFFERENT 2026-02-23T08:09:15.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3808: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-23T08:09:15.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:09:15.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:15.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:15.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ1 get-attr hinfo_key 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:15.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ1 get-attr hinfo_key 2026-02-23T08:09:15.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:09:15.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:15.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:09:15.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:09:15.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:09:15.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:09:15.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:15.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:09:15.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:09:15.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:09:15.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:09:15.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:09:15.882 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:15.880+0000 7faa1e4a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:15.883 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:15.882+0000 7faa1e4a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:15.884 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:15.882+0000 7faa1e4a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:09:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:09:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:16.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:16.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:16.036 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:09:16.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:16.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:16.104 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:16.102+0000 7faa1e4a6780 -1 Falling back to public interface 2026-02-23T08:09:16.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:16.456 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:16.454+0000 7faa1e4a6780 -1 osd.0 92 log_to_monitors true 2026-02-23T08:09:17.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:17.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:17.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:17.203 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:17.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:17.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:17.369 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 96 up_thru 96 down_at 93 last_clean_interval [84,92) [v2:127.0.0.1:6800/1268088184,v1:127.0.0.1:6801/1268088184] [v2:127.0.0.1:6802/1268088184,v1:127.0.0.1:6803/1268088184] exists,up b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:17.370 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:17.371 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:17.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:17.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:17.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:17.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:17.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:17.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:17.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:17.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:17.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:17.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:17.618 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:17.619 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:17.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:17.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:17.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:17.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=412316860418 2026-02-23T08:09:17.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 412316860418 2026-02-23T08:09:17.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418' 2026-02-23T08:09:17.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:17.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:17.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089348 2026-02-23T08:09:17.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089348 2026-02-23T08:09:17.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418 1-382252089348' 2026-02-23T08:09:17.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:17.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:17.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743433 2026-02-23T08:09:17.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743433 2026-02-23T08:09:17.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-412316860418 1-382252089348 2-296352743433' 2026-02-23T08:09:17.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:17.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-412316860418 2026-02-23T08:09:17.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:17.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:17.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-412316860418 2026-02-23T08:09:17.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:17.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=412316860418 2026-02-23T08:09:17.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 412316860418' 2026-02-23T08:09:17.845 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 412316860418 2026-02-23T08:09:17.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:18.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 412316860418 2026-02-23T08:09:18.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:19.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:19.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:19.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 412316860418 2026-02-23T08:09:19.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:20.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:09:20.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:20.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 412316860418 -lt 412316860418 2026-02-23T08:09:20.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:20.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089348 2026-02-23T08:09:20.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:20.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:20.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089348 2026-02-23T08:09:20.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:20.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089348 2026-02-23T08:09:20.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089348' 2026-02-23T08:09:20.353 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 382252089348 2026-02-23T08:09:20.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:20.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089348 -lt 382252089348 2026-02-23T08:09:20.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:20.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743433 2026-02-23T08:09:20.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:20.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:20.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743433 2026-02-23T08:09:20.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:20.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743433 2026-02-23T08:09:20.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743433' 2026-02-23T08:09:20.525 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743433 2026-02-23T08:09:20.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:20.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743433 -lt 296352743433 2026-02-23T08:09:20.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:20.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:20.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:20.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:20.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:20.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:20.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:20.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:20.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:20.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:20.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:21.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:21.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:21.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:21.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:21.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3809: corrupt_scrub_erasure: objectstore_tool td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:09:21.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:21.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:21.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:21.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:09:21.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:09:21.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:09:21.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:09:21.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:09:21.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:21.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 EOBJ7 set-attr hinfo_key td/osd-scrub-repair/hinfo 2026-02-23T08:09:21.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:09:21.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:21.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:09:21.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:09:21.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:21.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:21.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:09:21.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:09:21.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:09:21.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:09:21.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:09:21.735 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:21.733+0000 7f608e56a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:21.737 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:21.735+0000 7f608e56a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:21.737 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:21.735+0000 7f608e56a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:21.915 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:21.913+0000 7f608e56a780 -1 Falling back to public interface 2026-02-23T08:09:22.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:22.276 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:22.274+0000 7f608e56a780 -1 osd.0 97 log_to_monitors true 2026-02-23T08:09:23.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:23.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:23.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:23.057 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:23.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:23.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:23.222 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 101 up_thru 101 down_at 98 last_clean_interval [96,97) [v2:127.0.0.1:6800/3763150405,v1:127.0.0.1:6801/3763150405] [v2:127.0.0.1:6802/3763150405,v1:127.0.0.1:6803/3763150405] exists,up b24055af-268c-4bce-8cd3-525a3ca7b8c5 2026-02-23T08:09:23.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:23.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:23.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:09:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:23.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:23.224 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:23.224 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:23.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:23.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:23.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:23.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:23.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:23.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:23.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:23.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:23.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:23.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:23.469 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:23.469 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:23.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:23.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:23.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:23.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696898 2026-02-23T08:09:23.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696898 2026-02-23T08:09:23.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696898' 2026-02-23T08:09:23.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:23.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:23.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089350 2026-02-23T08:09:23.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089350 2026-02-23T08:09:23.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696898 1-382252089350' 2026-02-23T08:09:23.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:23.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:23.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743435 2026-02-23T08:09:23.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743435 2026-02-23T08:09:23.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696898 1-382252089350 2-296352743435' 2026-02-23T08:09:23.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:23.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-433791696898 2026-02-23T08:09:23.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:23.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:23.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-433791696898 2026-02-23T08:09:23.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:23.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696898 2026-02-23T08:09:23.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 433791696898' 2026-02-23T08:09:23.696 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 433791696898 2026-02-23T08:09:23.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:23.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696898 -lt 433791696898 2026-02-23T08:09:23.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:23.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089350 2026-02-23T08:09:23.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:23.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:23.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089350 2026-02-23T08:09:23.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:23.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089350 2026-02-23T08:09:23.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089350' 2026-02-23T08:09:23.863 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 382252089350 2026-02-23T08:09:23.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:24.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089349 -lt 382252089350 2026-02-23T08:09:24.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:25.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:25.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:25.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089349 -lt 382252089350 2026-02-23T08:09:25.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:26.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:09:26.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:26.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089350 -lt 382252089350 2026-02-23T08:09:26.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:26.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743435 2026-02-23T08:09:26.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:26.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:26.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743435 2026-02-23T08:09:26.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:26.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743435 2026-02-23T08:09:26.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743435' 2026-02-23T08:09:26.374 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 296352743435 2026-02-23T08:09:26.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:26.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743436 -lt 296352743435 2026-02-23T08:09:26.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:26.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:26.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:26.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:26.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:26.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:26.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:26.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:26.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:26.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:26.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:26.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:26.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:26.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:26.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:27.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:27.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:27.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:27.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3810: corrupt_scrub_erasure: rm -f td/osd-scrub-repair/hinfo 2026-02-23T08:09:27.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: get_pg ecpool EOBJ0 2026-02-23T08:09:27.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:09:27.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=EOBJ0 2026-02-23T08:09:27.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool EOBJ0 2026-02-23T08:09:27.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:09:27.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3816: corrupt_scrub_erasure: local pg=3.0 2026-02-23T08:09:27.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3818: corrupt_scrub_erasure: pg_scrub 3.0 2026-02-23T08:09:27.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:27.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:27.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:09:27.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:09:27.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:09:27.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:09:27.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:27.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:27.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:27.643 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:27.644 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:27.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:27.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:27.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:27.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696900 2026-02-23T08:09:27.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696900 2026-02-23T08:09:27.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696900' 2026-02-23T08:09:27.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:27.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:27.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089352 2026-02-23T08:09:27.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089352 2026-02-23T08:09:27.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696900 1-382252089352' 2026-02-23T08:09:27.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:27.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:27.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743437 2026-02-23T08:09:27.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743437 2026-02-23T08:09:27.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696900 1-382252089352 2-296352743437' 2026-02-23T08:09:27.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:27.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-433791696900 2026-02-23T08:09:27.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:27.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:27.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-433791696900 2026-02-23T08:09:27.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:27.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696900 2026-02-23T08:09:27.871 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 433791696900 2026-02-23T08:09:27.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 433791696900' 2026-02-23T08:09:27.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:28.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696899 -lt 433791696900 2026-02-23T08:09:28.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:29.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:29.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:29.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696899 -lt 433791696900 2026-02-23T08:09:29.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:30.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:09:30.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:30.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696900 -lt 433791696900 2026-02-23T08:09:30.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:30.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089352 2026-02-23T08:09:30.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:30.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:30.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089352 2026-02-23T08:09:30.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:30.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089352 2026-02-23T08:09:30.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089352' 2026-02-23T08:09:30.376 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 382252089352 2026-02-23T08:09:30.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:30.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089352 -lt 382252089352 2026-02-23T08:09:30.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:30.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743437 2026-02-23T08:09:30.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:30.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:30.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743437 2026-02-23T08:09:30.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:30.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743437 2026-02-23T08:09:30.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743437' 2026-02-23T08:09:30.543 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 296352743437 2026-02-23T08:09:30.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:30.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743437 -lt 296352743437 2026-02-23T08:09:30.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:09:30.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:09:30.710 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:09:30.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:09:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:09:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:09:30.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:09:30.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:30.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:09:30.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:30.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:09:30.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:30.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:09:31.101 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0s0 on osd.1 to scrub 2026-02-23T08:09:31.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:31.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:09:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:08:21.481561+0000 '>' 2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:31.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:09:32.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:09:32.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:09:32.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:09:32.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:32.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:09:32.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:32.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:09:32.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:09:31.173997+0000 '>' 2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:32.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:09:32.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3820: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-23T08:09:32.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:09:32.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3822: corrupt_scrub_erasure: test 1 = 1 2026-02-23T08:09:32.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:09:32.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3824: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-23T08:09:32.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3826: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-23T08:09:32.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-23T08:09:32.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3828: corrupt_scrub_erasure: epoch=101 2026-02-23T08:09:32.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:09:32.479 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:09:32.479 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:09:32.479 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:09:32.479 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:09:32.479 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:09:32.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3830: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:09:32.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:09:32.492 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:09:32.492 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:09:32.492 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:09:32.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4458: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:09:32.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4459: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:09:32.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:09:32.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4460: corrupt_scrub_erasure: test no = yes 2026-02-23T08:09:32.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4465: corrupt_scrub_erasure: test '' = yes 2026-02-23T08:09:32.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4470: corrupt_scrub_erasure: pg_deep_scrub 3.0 2026-02-23T08:09:32.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:09:32.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:09:32.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:09:32.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:09:32.507 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:32.507 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:32.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:32.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:32.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:32.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:09:32.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:09:32.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:09:32.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:09:32.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:32.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:32.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:32.868 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:09:32.868 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:09:32.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:32.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:32.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:32.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=433791696902 2026-02-23T08:09:32.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 433791696902 2026-02-23T08:09:32.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696902' 2026-02-23T08:09:32.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:33.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=382252089354 2026-02-23T08:09:33.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 382252089354 2026-02-23T08:09:33.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696902 1-382252089354' 2026-02-23T08:09:33.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:33.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:09:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=296352743439 2026-02-23T08:09:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 296352743439 2026-02-23T08:09:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-433791696902 1-382252089354 2-296352743439' 2026-02-23T08:09:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:33.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-433791696902 2026-02-23T08:09:33.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:33.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:33.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-433791696902 2026-02-23T08:09:33.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:33.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=433791696902 2026-02-23T08:09:33.091 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 433791696902 2026-02-23T08:09:33.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 433791696902' 2026-02-23T08:09:33.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:33.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696900 -lt 433791696902 2026-02-23T08:09:33.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:34.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:34.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:34.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 433791696902 -lt 433791696902 2026-02-23T08:09:34.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:34.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-382252089354 2026-02-23T08:09:34.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:34.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:34.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-382252089354 2026-02-23T08:09:34.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:34.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=382252089354 2026-02-23T08:09:34.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 382252089354' 2026-02-23T08:09:34.428 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 382252089354 2026-02-23T08:09:34.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:34.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 382252089354 -lt 382252089354 2026-02-23T08:09:34.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:34.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-296352743439 2026-02-23T08:09:34.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:34.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:09:34.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-296352743439 2026-02-23T08:09:34.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:34.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=296352743439 2026-02-23T08:09:34.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 296352743439' 2026-02-23T08:09:34.599 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 296352743439 2026-02-23T08:09:34.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:09:34.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 296352743439 -lt 296352743439 2026-02-23T08:09:34.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:09:34.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:09:34.769 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:09:34.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:09:34.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:09:34.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:09:34.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:09:34.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:09:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:09:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:09:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:09:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:09:34.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:09:34.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:34.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:09:34.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:34.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:09:35.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:35.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:09:35.157 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0s0 on osd.1 to deep-scrub 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:08:21.481561+0000 last_deep_scrub_stamp 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:09:35.168 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:09:35.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:35.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:09:35.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:35.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:09:35.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:08:21.481561+0000 '>' 2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:35.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:09:36.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:09:36.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:09:36.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:09:36.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:36.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:09:36.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:36.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:09:36.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:08:21.481561+0000 '>' 2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:36.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:09:37.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:09:37.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:09:37.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:09:37.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:09:37.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:09:37.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:09:37.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:09:37.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:09:36.090622+0000 '>' 2026-02-23T08:08:21.481561+0000 2026-02-23T08:09:37.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:09:37.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4472: corrupt_scrub_erasure: rados list-inconsistent-pg ecpool 2026-02-23T08:09:37.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:09:37.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4474: corrupt_scrub_erasure: test 1 = 1 2026-02-23T08:09:37.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:09:37.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4476: corrupt_scrub_erasure: test 3.0 = 3.0 2026-02-23T08:09:37.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4478: corrupt_scrub_erasure: rados list-inconsistent-obj 3.0 2026-02-23T08:09:37.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4479: corrupt_scrub_erasure: cp td/osd-scrub-repair/json /tmp/rrr6.json 2026-02-23T08:09:37.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: jq .epoch td/osd-scrub-repair/json 2026-02-23T08:09:37.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4481: corrupt_scrub_erasure: epoch=101 2026-02-23T08:09:37.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4483: corrupt_scrub_erasure: '[' true = true ']' 2026-02-23T08:09:37.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4485: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:09:37.710 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:09:37.711 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:09:37.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4485: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:09:37.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:4485: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:09:37.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq 'def walk(f): 2026-02-23T08:09:37.722 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:09:37.723 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:09:37.724 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:09:37.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: jq .inconsistents 2026-02-23T08:09:37.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5890: corrupt_scrub_erasure: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:09:37.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5891: corrupt_scrub_erasure: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:09:37.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:09:37.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5892: corrupt_scrub_erasure: test no = yes 2026-02-23T08:09:37.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5903: corrupt_scrub_erasure: test '' = yes 2026-02-23T08:09:37.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5908: corrupt_scrub_erasure: ceph osd pool rm ecpool ecpool --yes-i-really-really-mean-it 2026-02-23T08:09:37.944 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' removed 2026-02-23T08:09:37.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:09:37.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:09:37.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:09:37.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:09:37.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:37.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:37.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:37.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:37.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:38.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:38.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:09:38.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:09:38.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:09:38.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:09:38.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:09:38.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:09:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:09:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:09:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:09:38.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:09:38.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:09:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:09:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:09:38.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:09:38.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:09:38.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:09:38.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:09:38.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:09:38.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:09:38.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:09:38.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:09:38.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:09:38.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:09:38.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:09:38.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:09:38.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:09:38.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:09:38.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:09:38.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:09:38.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:09:38.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:09:38.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:09:38.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:09:38.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:09:38.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:09:38.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:09:38.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:09:38.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:09:38.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:09:38.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:09:38.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:09:38.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:09:38.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:09:38.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:09:38.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:09:38.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:09:38.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:09:38.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_scrub_replicated td/osd-scrub-repair 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1050: TEST_corrupt_scrub_replicated: local dir=td/osd-scrub-repair 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1051: TEST_corrupt_scrub_replicated: local poolname=csr_pool 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1052: TEST_corrupt_scrub_replicated: local total_objs=19 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1054: TEST_corrupt_scrub_replicated: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:09:38.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:38.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:09:38.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:09:38.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:09:38.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:09:38.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:09:38.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:09:38.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:09:38.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:09:38.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:09:38.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:09:38.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:09:38.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:09:38.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.213 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:09:38.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:09:38.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:09:38.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1055: TEST_corrupt_scrub_replicated: run_mgr td/osd-scrub-repair x 2026-02-23T08:09:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:09:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:09:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:09:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:09:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:09:38.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:38.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:09:38.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:09:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1056: TEST_corrupt_scrub_replicated: run_osd td/osd-scrub-repair 0 2026-02-23T08:09:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:09:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:09:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:09:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:38.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:09:38.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:09:38.389 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:09:38.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe' 2026-02-23T08:09:38.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:09:38.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBCC5xpKdBxFxAARxINXGW1EZRRmS7RcH+ckQ== 2026-02-23T08:09:38.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBCC5xpKdBxFxAARxINXGW1EZRRmS7RcH+ckQ=="}' 2026-02-23T08:09:38.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe -i td/osd-scrub-repair/0/new.json 2026-02-23T08:09:38.483 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:09:38.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:09:38.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBCC5xpKdBxFxAARxINXGW1EZRRmS7RcH+ckQ== --osd-uuid 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:09:38.508 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:38.506+0000 7f5a6cf6d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:38.510 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:38.508+0000 7f5a6cf6d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:38.510 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:38.509+0000 7f5a6cf6d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:38.511 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:38.509+0000 7f5a6cf6d780 -1 bdev(0x55da75d05400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:09:38.511 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:38.509+0000 7f5a6cf6d780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:09:38.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:09:38.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:09:38.935 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:09:38.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:09:38.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:09:39.033 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:09:39.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:09:39.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:39.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:09:39.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:09:39.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:09:39.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:39.044+0000 7f591d750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:39.047 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:39.045+0000 7f591d750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:39.048 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:39.046+0000 7f591d750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:39.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:39.130 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:09:39.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:39.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:39.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:39.242 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:39.240+0000 7f591d750780 -1 Falling back to public interface 2026-02-23T08:09:39.525 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:39.523+0000 7f591d750780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:09:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:40.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:40.221 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:09:40.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:40.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:40.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:09:40.314 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2898320868,v1:127.0.0.1:6801/2898320868] [v2:127.0.0.1:6802/2898320868,v1:127.0.0.1:6803/2898320868] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:09:40.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:40.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:40.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:40.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1057: TEST_corrupt_scrub_replicated: run_osd td/osd-scrub-repair 1 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:09:40.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:09:40.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:09:40.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:09:40.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0b156bf7-3918-47a2-afb7-92e9980bcd6f' 2026-02-23T08:09:40.322 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:09:40.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:09:40.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBEC5xp50dnExAAVklYEpb6si++4/sC8ddoIw== 2026-02-23T08:09:40.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBEC5xp50dnExAAVklYEpb6si++4/sC8ddoIw=="}' 2026-02-23T08:09:40.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0b156bf7-3918-47a2-afb7-92e9980bcd6f -i td/osd-scrub-repair/1/new.json 2026-02-23T08:09:40.418 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:09:40.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:09:40.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBEC5xp50dnExAAVklYEpb6si++4/sC8ddoIw== --osd-uuid 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:09:40.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:40.440+0000 7f9f2d2ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:40.443 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:40.441+0000 7f9f2d2ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:40.444 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:40.442+0000 7f9f2d2ba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:40.444 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:40.442+0000 7f9f2d2ba780 -1 bdev(0x5582c63b5400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:09:40.444 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:40.442+0000 7f9f2d2ba780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:09:40.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:09:40.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:09:40.878 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:09:40.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:09:40.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:09:41.087 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:09:41.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:09:41.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:09:41.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:09:41.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:09:41.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:09:41.099 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:41.098+0000 7f99b4950780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:41.101 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:41.099+0000 7f99b4950780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:41.102 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:41.100+0000 7f99b4950780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:09:41.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:09:41.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:09:41.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:09:41.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:09:41.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:09:41.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:41.260 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:09:41.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:09:41.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:41.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:09:41.304 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:41.303+0000 7f99b4950780 -1 Falling back to public interface 2026-02-23T08:09:41.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:09:41.606 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:09:41.604+0000 7f99b4950780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:09:42.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:09:42.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:09:42.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:09:42.430 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:09:42.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:09:42.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:09:42.593 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3480522004,v1:127.0.0.1:6811/3480522004] [v2:127.0.0.1:6812/3480522004,v1:127.0.0.1:6813/3480522004] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:09:42.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:09:42.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:09:42.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:09:42.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1058: TEST_corrupt_scrub_replicated: create_rbd_pool 2026-02-23T08:09:42.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:09:42.749 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:09:42.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:09:42.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:09:42.940 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:09:42.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:09:43.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:09:44.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1059: TEST_corrupt_scrub_replicated: wait_for_clean 2026-02-23T08:09:44.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:44.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:44.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:44.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:44.232 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:44.233 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:44.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:44.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:44.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:44.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:44.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:44.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:44.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:44.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:44.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:44.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:44.482 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:09:44.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:44.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:44.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:09:44.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:09:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:09:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:44.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-23T08:09:44.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-23T08:09:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-23T08:09:44.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:44.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:09:44.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:44.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:44.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:09:44.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:44.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:09:44.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:09:44.634 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:09:44.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:44.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:09:44.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:45.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:45.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:45.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:09:45.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:46.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:09:46.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:47.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-23T08:09:47.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:47.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-23T08:09:47.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:47.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:47.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-23T08:09:47.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:47.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-23T08:09:47.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-23T08:09:47.144 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672962 2026-02-23T08:09:47.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:47.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-23T08:09:47.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:47.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:47.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:47.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:09:47.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:47.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:47.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:47.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:47.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:47.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:47.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:47.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:09:47.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:47.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:47.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:09:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1061: TEST_corrupt_scrub_replicated: create_pool foo 1 2026-02-23T08:09:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-23T08:09:48.088 INFO:tasks.workunit.client.0.trial129.stderr:pool 'foo' created 2026-02-23T08:09:48.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:09:49.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1062: TEST_corrupt_scrub_replicated: create_pool csr_pool 1 1 2026-02-23T08:09:49.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create csr_pool 1 1 2026-02-23T08:09:49.313 INFO:tasks.workunit.client.0.trial129.stderr:pool 'csr_pool' created 2026-02-23T08:09:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:09:50.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1063: TEST_corrupt_scrub_replicated: wait_for_clean 2026-02-23T08:09:50.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:09:50.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:09:50.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:09:50.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:09:50.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:09:50.332 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:09:50.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:09:50.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:09:50.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:09:50.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:09:50.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:09:50.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:09:50.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:09:50.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:09:50.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:09:50.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:09:50.579 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:09:50.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:09:50.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:50.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:09:50.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:09:50.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:09:50.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:09:50.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:09:50.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:09:50.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T08:09:50.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T08:09:50.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-23T08:09:50.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:50.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:09:50.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:50.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:09:50.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:09:50.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:50.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:09:50.727 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:09:50.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:09:50.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:50.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-23T08:09:50.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:51.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:09:51.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:52.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-23T08:09:52.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:09:53.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:09:53.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:09:53.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:09:53.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:09:53.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T08:09:53.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:09:53.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:09:53.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T08:09:53.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:09:53.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T08:09:53.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T08:09:53.232 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T08:09:53.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:09:53.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-23T08:09:53.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:09:53.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:53.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:53.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:09:53.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:09:53.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:09:53.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:09:53.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:09:53.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:09:53.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:09:53.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:09:53.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:09:53.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:09:53.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:09:53.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:09:53.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:09:53.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:09:53.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:09:53.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: seq 1 19 2026-02-23T08:09:53.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:53.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ1 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ1 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ1 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:53.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:54.181 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:54.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:54.384 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:54.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:54.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:54.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:54.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ1 hdr-ROBJ1 2026-02-23T08:09:54.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ1 key-ROBJ1 val-ROBJ1 2026-02-23T08:09:54.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:54.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ2 2026-02-23T08:09:54.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ2 2026-02-23T08:09:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ2 2026-02-23T08:09:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:54.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:54.647 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:54.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:54.852 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:54.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:54.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:54.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ2 hdr-ROBJ2 2026-02-23T08:09:54.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ2 key-ROBJ2 val-ROBJ2 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ3 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ3 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ3 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:54.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:55.118 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:55.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:55.322 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:55.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:55.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:55.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:55.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ3 hdr-ROBJ3 2026-02-23T08:09:55.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ3 key-ROBJ3 val-ROBJ3 2026-02-23T08:09:55.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:55.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ4 2026-02-23T08:09:55.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ4 2026-02-23T08:09:55.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:55.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:55.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ4 2026-02-23T08:09:55.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:55.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:55.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:55.590 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:55.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:55.794 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:55.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:55.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:55.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:55.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ4 hdr-ROBJ4 2026-02-23T08:09:55.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ4 key-ROBJ4 val-ROBJ4 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ5 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ5 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ5 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:55.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:56.065 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:56.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:56.270 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:56.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:56.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:56.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:56.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ5 hdr-ROBJ5 2026-02-23T08:09:56.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ5 key-ROBJ5 val-ROBJ5 2026-02-23T08:09:56.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:56.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ6 2026-02-23T08:09:56.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ6 2026-02-23T08:09:56.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:56.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:56.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ6 2026-02-23T08:09:56.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:56.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:56.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:56.573 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:56.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:56.775 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:56.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:56.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:56.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:56.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ6 hdr-ROBJ6 2026-02-23T08:09:56.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ6 key-ROBJ6 val-ROBJ6 2026-02-23T08:09:56.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:56.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ7 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ7 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ7 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:57.044 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:57.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:57.247 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:57.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:57.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:57.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:57.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ7 hdr-ROBJ7 2026-02-23T08:09:57.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ7 key-ROBJ7 val-ROBJ7 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ8 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ8 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ8 2026-02-23T08:09:57.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:57.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:57.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:57.517 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:57.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:57.720 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:57.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:57.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:57.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ8 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:57.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ8 hdr-ROBJ8 2026-02-23T08:09:57.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ8 key-ROBJ8 val-ROBJ8 2026-02-23T08:09:57.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ9 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ9 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ9 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:57.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:57.988 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:58.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:58.194 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:58.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:58.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:58.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:58.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ9 hdr-ROBJ9 2026-02-23T08:09:58.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ9 key-ROBJ9 val-ROBJ9 2026-02-23T08:09:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ10 2026-02-23T08:09:58.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ10 2026-02-23T08:09:58.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:58.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:58.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ10 2026-02-23T08:09:58.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:58.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:58.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:58.497 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:58.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:58.699 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:58.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:58.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:58.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ10 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:58.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ10 hdr-ROBJ10 2026-02-23T08:09:58.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ10 key-ROBJ10 val-ROBJ10 2026-02-23T08:09:58.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:58.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ11 2026-02-23T08:09:58.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ11 2026-02-23T08:09:58.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:58.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:58.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ11 2026-02-23T08:09:58.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:58.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:58.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:58.965 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:58.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:59.168 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:59.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:59.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:59.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ11 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:59.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ11 hdr-ROBJ11 2026-02-23T08:09:59.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ11 key-ROBJ11 val-ROBJ11 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ12 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ12 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ12 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:59.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:59.443 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:59.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:09:59.647 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:09:59.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:09:59.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:09:59.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ12 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:09:59.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ12 hdr-ROBJ12 2026-02-23T08:09:59.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ12 key-ROBJ12 val-ROBJ12 2026-02-23T08:09:59.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:09:59.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ13 2026-02-23T08:09:59.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ13 2026-02-23T08:09:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:09:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:09:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ13 2026-02-23T08:09:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:09:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:09:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:09:59.916 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:09:59.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:00.119 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:00.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:00.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:00.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ13 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:00.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ13 hdr-ROBJ13 2026-02-23T08:10:00.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ13 key-ROBJ13 val-ROBJ13 2026-02-23T08:10:00.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:00.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ14 2026-02-23T08:10:00.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ14 2026-02-23T08:10:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:10:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:10:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ14 2026-02-23T08:10:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:10:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:10:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:10:00.389 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:10:00.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:00.593 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:00.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:00.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:00.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ14 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:00.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ14 hdr-ROBJ14 2026-02-23T08:10:00.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ14 key-ROBJ14 val-ROBJ14 2026-02-23T08:10:00.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ15 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ15 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ15 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:10:00.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:10:00.861 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:10:00.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:01.065 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:01.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:01.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:01.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ15 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:01.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ15 hdr-ROBJ15 2026-02-23T08:10:01.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ15 key-ROBJ15 val-ROBJ15 2026-02-23T08:10:01.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ16 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ16 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ16 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:10:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:10:01.331 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:10:01.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:01.536 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:01.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ16 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:01.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ16 hdr-ROBJ16 2026-02-23T08:10:01.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ16 key-ROBJ16 val-ROBJ16 2026-02-23T08:10:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:01.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ17 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ17 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ17 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:10:01.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:10:01.804 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:10:01.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:02.008 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:02.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:02.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:02.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ17 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:02.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ17 hdr-ROBJ17 2026-02-23T08:10:02.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ17 key-ROBJ17 val-ROBJ17 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ18 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ18 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ18 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:10:02.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:10:02.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:10:02.276 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:10:02.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:02.481 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:02.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:02.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:02.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ18 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:02.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ18 hdr-ROBJ18 2026-02-23T08:10:02.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ18 key-ROBJ18 val-ROBJ18 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1065: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1066: TEST_corrupt_scrub_replicated: objname=ROBJ19 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1067: TEST_corrupt_scrub_replicated: add_something td/osd-scrub-repair csr_pool ROBJ19 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ19 2026-02-23T08:10:02.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:10:02.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:10:02.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:10:02.750 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:10:02.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:10:02.954 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:10:02.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:10:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:10:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:10:02.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1069: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapheader ROBJ19 hdr-ROBJ19 2026-02-23T08:10:02.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1070: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ19 key-ROBJ19 val-ROBJ19 2026-02-23T08:10:03.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1074: TEST_corrupt_scrub_replicated: dd if=/dev/zero of=td/osd-scrub-repair/new.ROBJ19 bs=1024 count=1025 2026-02-23T08:10:03.015 INFO:tasks.workunit.client.0.trial129.stderr:1025+0 records in 2026-02-23T08:10:03.015 INFO:tasks.workunit.client.0.trial129.stderr:1025+0 records out 2026-02-23T08:10:03.015 INFO:tasks.workunit.client.0.trial129.stderr:1049600 bytes (1.0 MB, 1.0 MiB) copied, 0.00161504 s, 650 MB/s 2026-02-23T08:10:03.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1075: TEST_corrupt_scrub_replicated: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/new.ROBJ19 2026-02-23T08:10:03.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1076: TEST_corrupt_scrub_replicated: rm -f td/osd-scrub-repair/new.ROBJ19 2026-02-23T08:10:03.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1078: TEST_corrupt_scrub_replicated: get_pg csr_pool ROBJ0 2026-02-23T08:10:03.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-23T08:10:03.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-23T08:10:03.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:10:03.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:10:03.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1078: TEST_corrupt_scrub_replicated: local pg=3.0 2026-02-23T08:10:03.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1079: TEST_corrupt_scrub_replicated: get_primary csr_pool ROBJ0 2026-02-23T08:10:03.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=csr_pool 2026-02-23T08:10:03.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=ROBJ0 2026-02-23T08:10:03.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:10:03.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:10:03.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1079: TEST_corrupt_scrub_replicated: local primary=1 2026-02-23T08:10:03.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1082: TEST_corrupt_scrub_replicated: get_asok_path osd.0 2026-02-23T08:10:03.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:10:03.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:10:03.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:10:03.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:03.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:03.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:10:03.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1082: TEST_corrupt_scrub_replicated: CEPH_ARGS= 2026-02-23T08:10:03.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1082: TEST_corrupt_scrub_replicated: ceph daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-23T08:10:03.420 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:10:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-23T08:10:03.421 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:10:03.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1084: TEST_corrupt_scrub_replicated: get_asok_path osd.1 2026-02-23T08:10:03.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:10:03.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:10:03.429 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:10:03.429 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:03.430 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:03.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:10:03.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1084: TEST_corrupt_scrub_replicated: CEPH_ARGS= 2026-02-23T08:10:03.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1084: TEST_corrupt_scrub_replicated: ceph daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-23T08:10:03.484 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:10:03.485 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T08:10:03.485 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:10:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1086: TEST_corrupt_scrub_replicated: pg_deep_scrub 3.0 2026-02-23T08:10:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:10:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:10:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:10:03.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:10:03.493 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:03.493 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:03.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:03.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:03.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:03.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:10:03.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:10:03.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:10:03.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:10:03.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:03.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:03.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:03.855 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:03.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:03.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:03.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-23T08:10:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-23T08:10:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-23T08:10:03.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:03.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:04.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672968 2026-02-23T08:10:04.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672968 2026-02-23T08:10:04.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672968' 2026-02-23T08:10:04.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:04.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-23T08:10:04.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:04.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:04.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-23T08:10:04.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:04.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-23T08:10:04.007 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836488 2026-02-23T08:10:04.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-23T08:10:04.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:04.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836488 2026-02-23T08:10:04.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:05.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:05.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:05.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-23T08:10:05.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:05.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672968 2026-02-23T08:10:05.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:05.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:05.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672968 2026-02-23T08:10:05.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672968 2026-02-23T08:10:05.345 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672968 2026-02-23T08:10:05.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2026-02-23T08:10:05.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:05.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672968 -lt 42949672968 2026-02-23T08:10:05.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:10:05.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:10:05.511 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:10:05.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:10:05.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:10:05.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:10:05.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:10:05.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:10:05.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:10:05.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:10:05.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:10:05.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:09:49.311330+0000 2026-02-23T08:10:05.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:10:05.904 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:09:49.311330+0000 last_deep_scrub_stamp 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:09:49.311330+0000 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:10:05.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:10:05.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:10:05.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:10:06.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:09:49.311330+0000 '>' 2026-02-23T08:09:49.311330+0000 2026-02-23T08:10:06.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:10:07.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:10:07.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:10:07.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:10:07.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:10:07.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:10:07.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:10:07.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:10:07.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:09:49.311330+0000 '>' 2026-02-23T08:09:49.311330+0000 2026-02-23T08:10:07.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:10:08.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:10:08.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:10:08.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:10:08.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:10:08.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:10:08.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:10:08.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:10:08.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:09:49.311330+0000 2026-02-23T08:10:08.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:10:08.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: seq 1 19 2026-02-23T08:10:08.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:08.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ1 2026-02-23T08:10:08.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 1 % 2 2026-02-23T08:10:08.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:10:08.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:08.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1097: TEST_corrupt_scrub_replicated: local payload=UVWXYZZZ 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1098: TEST_corrupt_scrub_replicated: echo UVWXYZZZ 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1099: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:08.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:08.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:08.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:08.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:08.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:08.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:08.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:08.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:08.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:08.854 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#-5:00000000:::deep_scrub_3.0:head#, (61) No data available 2026-02-23T08:10:08.855 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#-5:00000000:::scrub_3.0:head#, (61) No data available 2026-02-23T08:10:08.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:08.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:08.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:08.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:08.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:08.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:08.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:08.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:08.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:08.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:08.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:08.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:08.928 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:08.926+0000 7f5786d4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:08.930 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:08.928+0000 7f5786d4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:08.930 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:08.928+0000 7f5786d4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:09.086 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:09.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:09.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:09.115 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:09.113+0000 7f5786d4a780 -1 Falling back to public interface 2026-02-23T08:10:09.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:09.475 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:09.473+0000 7f5786d4a780 -1 osd.1 63 log_to_monitors true 2026-02-23T08:10:10.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:10.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:10.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:10.252 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:10.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:10.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:10.422 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 67 up_thru 67 down_at 64 last_clean_interval [10,63) [v2:127.0.0.1:6810/758064637,v1:127.0.0.1:6811/758064637] [v2:127.0.0.1:6812/758064637,v1:127.0.0.1:6813/758064637] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:10.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:10.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:10.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:10.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:10.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:10.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:10.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:10.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:10.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:10.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:10.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:10.670 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:10.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:10.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:10.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:10.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-23T08:10:10.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-23T08:10:10.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-23T08:10:10.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:10.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:10.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808834 2026-02-23T08:10:10.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808834 2026-02-23T08:10:10.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-287762808834' 2026-02-23T08:10:10.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:10.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-23T08:10:10.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:10.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:10.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-23T08:10:10.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:10.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-23T08:10:10.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-23T08:10:10.822 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836491 2026-02-23T08:10:10.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:10.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-23T08:10:10.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:11.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:11.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:12.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-23T08:10:12.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:13.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:10:13.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-23T08:10:13.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:13.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-287762808834 2026-02-23T08:10:13.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:13.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:13.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-287762808834 2026-02-23T08:10:13.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:13.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808834 2026-02-23T08:10:13.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 287762808834' 2026-02-23T08:10:13.328 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 287762808834 2026-02-23T08:10:13.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:13.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808834 -lt 287762808834 2026-02-23T08:10:13.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:13.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:13.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:13.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:13.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:13.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:13.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:13.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:13.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:14.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:14.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:14.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:14.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:14.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ2 2026-02-23T08:10:14.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 2 % 2 2026-02-23T08:10:14.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1104: TEST_corrupt_scrub_replicated: local payload=UVWXYZ 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1105: TEST_corrupt_scrub_replicated: echo UVWXYZ 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1106: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:14.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:14.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:14.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:14.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:14.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:14.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:10:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:14.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:10:14.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:10:14.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:14.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:14.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:14.365 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:14.363+0000 7f4b05951780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:14.367 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:14.365+0000 7f4b05951780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:14.367 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:14.365+0000 7f4b05951780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:14.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:10:14.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:14.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:14.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:14.539 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:14.537+0000 7f4b05951780 -1 Falling back to public interface 2026-02-23T08:10:14.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:14.937 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:14.934+0000 7f4b05951780 -1 osd.0 68 log_to_monitors true 2026-02-23T08:10:15.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:15.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:15.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:15.686 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:15.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:15.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:15.854 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 72 up_thru 72 down_at 69 last_clean_interval [5,68) [v2:127.0.0.1:6800/2451360474,v1:127.0.0.1:6801/2451360474] [v2:127.0.0.1:6802/2451360474,v1:127.0.0.1:6803/2451360474] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:10:15.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:15.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:15.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:15.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:15.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:15.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:15.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:15.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:15.855 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:15.855 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:15.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:15.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:15.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:15.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:15.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:15.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:15.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:15.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:15.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:16.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:16.102 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:16.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:16.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:16.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:16.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645314 2026-02-23T08:10:16.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645314 2026-02-23T08:10:16.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-309237645314' 2026-02-23T08:10:16.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:16.175 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:16.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=287762808836 2026-02-23T08:10:16.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 287762808836 2026-02-23T08:10:16.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-309237645314 1-287762808836' 2026-02-23T08:10:16.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:16.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-309237645314 2026-02-23T08:10:16.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:16.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:16.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-309237645314 2026-02-23T08:10:16.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:16.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=309237645314 2026-02-23T08:10:16.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 309237645314' 2026-02-23T08:10:16.252 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 309237645314 2026-02-23T08:10:16.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:16.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 309237645314 2026-02-23T08:10:16.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:17.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:17.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:17.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645314 -lt 309237645314 2026-02-23T08:10:17.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:17.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-287762808836 2026-02-23T08:10:17.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:17.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:17.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-287762808836 2026-02-23T08:10:17.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:17.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=287762808836 2026-02-23T08:10:17.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 287762808836' 2026-02-23T08:10:17.589 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 287762808836 2026-02-23T08:10:17.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:17.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 287762808836 -lt 287762808836 2026-02-23T08:10:17.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:17.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:17.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:17.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:17.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:18.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:18.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:18.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:18.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:18.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:18.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:18.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:18.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:18.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ3 2026-02-23T08:10:18.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 3 % 2 2026-02-23T08:10:18.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:10:18.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:18.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1111: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ3 remove 2026-02-23T08:10:18.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:18.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:18.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ3 remove 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:18.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ3 remove 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:18.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:18.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ3 remove 2026-02-23T08:10:18.730 INFO:tasks.workunit.client.0.trial129.stdout:remove #3:f2a5b2a4:::ROBJ3:head# 2026-02-23T08:10:18.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:18.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:18.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:18.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:18.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:18.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:18.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:18.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:18.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:18.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:18.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:18.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:18.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:18.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:18.794 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:18.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:18.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:18.801 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:18.799+0000 7f6fe65ff780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:18.803 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:18.801+0000 7f6fe65ff780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:18.804 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:18.802+0000 7f6fe65ff780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:18.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:19.049 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:19.047+0000 7f6fe65ff780 -1 Falling back to public interface 2026-02-23T08:10:19.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:19.351 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:19.350+0000 7f6fe65ff780 -1 osd.1 73 log_to_monitors true 2026-02-23T08:10:20.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:20.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:20.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:20.128 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:20.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:20.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:20.293 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 77 up_thru 77 down_at 74 last_clean_interval [67,73) [v2:127.0.0.1:6810/1180261624,v1:127.0.0.1:6811/1180261624] [v2:127.0.0.1:6812/1180261624,v1:127.0.0.1:6813/1180261624] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:20.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:20.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:20.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:20.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:20.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:20.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:20.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:20.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:20.295 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:20.295 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:20.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:20.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:20.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:20.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:20.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:20.539 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:20.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:20.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:20.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:20.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=309237645316 2026-02-23T08:10:20.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 309237645316 2026-02-23T08:10:20.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-309237645316' 2026-02-23T08:10:20.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:20.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:20.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481794 2026-02-23T08:10:20.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481794 2026-02-23T08:10:20.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-309237645316 1-330712481794' 2026-02-23T08:10:20.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:20.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-309237645316 2026-02-23T08:10:20.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:20.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:20.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-309237645316 2026-02-23T08:10:20.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:20.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=309237645316 2026-02-23T08:10:20.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 309237645316' 2026-02-23T08:10:20.691 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 309237645316 2026-02-23T08:10:20.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:20.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645315 -lt 309237645316 2026-02-23T08:10:20.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:21.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:21.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:22.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645315 -lt 309237645316 2026-02-23T08:10:22.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:23.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:10:23.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:23.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 309237645316 -lt 309237645316 2026-02-23T08:10:23.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:23.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481794 2026-02-23T08:10:23.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:23.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:23.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481794 2026-02-23T08:10:23.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:23.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481794 2026-02-23T08:10:23.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481794' 2026-02-23T08:10:23.199 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 330712481794 2026-02-23T08:10:23.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481794 -lt 330712481794 2026-02-23T08:10:23.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:23.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:23.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:23.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:23.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:23.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:23.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:23.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:23.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:23.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:23.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:23.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:23.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:23.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ4 2026-02-23T08:10:23.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 4 % 2 2026-02-23T08:10:23.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1116: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:23.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:23.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:24.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:24.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:24.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:24.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:24.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:10:24.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:24.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:24.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:10:24.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:24.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:10:24.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:24.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:10:24.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:10:24.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:24.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:24.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:24.441 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:24.440+0000 7f922a74b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:24.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:24.441+0000 7f922a74b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:24.443 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:24.442+0000 7f922a74b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:24.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:10:24.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:24.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:10:24.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:24.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:24.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:24.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:24.600 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:24.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:24.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:24.649 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:24.648+0000 7f922a74b780 -1 Falling back to public interface 2026-02-23T08:10:24.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:25.003 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:25.002+0000 7f922a74b780 -1 osd.0 78 log_to_monitors true 2026-02-23T08:10:25.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:25.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:25.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:25.765 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:25.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:25.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:25.932 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 82 up_thru 82 down_at 79 last_clean_interval [72,78) [v2:127.0.0.1:6800/1455848036,v1:127.0.0.1:6801/1455848036] [v2:127.0.0.1:6802/1455848036,v1:127.0.0.1:6803/1455848036] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:10:25.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:25.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:25.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:25.933 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:25.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:25.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:25.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:26.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:26.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:26.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:26.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:26.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:26.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:26.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:26.180 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:26.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:26.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:26.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:26.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=352187318274 2026-02-23T08:10:26.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 352187318274 2026-02-23T08:10:26.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-352187318274' 2026-02-23T08:10:26.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:26.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:26.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=330712481796 2026-02-23T08:10:26.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 330712481796 2026-02-23T08:10:26.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-352187318274 1-330712481796' 2026-02-23T08:10:26.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:26.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-352187318274 2026-02-23T08:10:26.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:26.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:26.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-352187318274 2026-02-23T08:10:26.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:26.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=352187318274 2026-02-23T08:10:26.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 352187318274' 2026-02-23T08:10:26.329 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 352187318274 2026-02-23T08:10:26.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 352187318274 -lt 352187318274 2026-02-23T08:10:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:26.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-330712481796 2026-02-23T08:10:26.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:26.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-330712481796 2026-02-23T08:10:26.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=330712481796 2026-02-23T08:10:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 330712481796' 2026-02-23T08:10:26.503 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 330712481796 2026-02-23T08:10:26.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:26.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 330712481796 -lt 330712481796 2026-02-23T08:10:26.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:26.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:26.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:26.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:27.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:27.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:27.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:27.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:27.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:27.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:27.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:27.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:27.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ5 2026-02-23T08:10:27.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 5 % 2 2026-02-23T08:10:27.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:10:27.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:27.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1121: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:10:27.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:27.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:27.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:27.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:27.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:10:27.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:27.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:27.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:27.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:27.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:27.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:27.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:27.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:27.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:27.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:10:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:27.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:27.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:27.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:27.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:27.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:27.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:27.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:27.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:27.732 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:27.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:27.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:27.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:27.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:27.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:27.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:27.742 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:27.741+0000 7fd45900a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:27.743 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:27.742+0000 7fd45900a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:27.744 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:27.743+0000 7fd45900a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:27.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:27.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:27.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:27.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:27.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:27.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:27.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:27.898 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:27.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:27.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:27.913 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:27.912+0000 7fd45900a780 -1 Falling back to public interface 2026-02-23T08:10:28.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:28.196 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:28.194+0000 7fd45900a780 -1 osd.1 84 log_to_monitors true 2026-02-23T08:10:29.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:29.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:29.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:29.064 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:29.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:29.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:29.231 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 88 up_thru 88 down_at 85 last_clean_interval [77,84) [v2:127.0.0.1:6810/2074854975,v1:127.0.0.1:6811/2074854975] [v2:127.0.0.1:6812/2074854975,v1:127.0.0.1:6813/2074854975] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:29.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:29.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:29.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:29.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:29.233 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:29.233 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:29.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:29.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:29.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:29.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:29.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:29.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:29.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:29.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:29.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:29.476 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:29.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:29.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:29.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=352187318275 2026-02-23T08:10:29.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 352187318275 2026-02-23T08:10:29.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-352187318275' 2026-02-23T08:10:29.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:29.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:29.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122050 2026-02-23T08:10:29.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122050 2026-02-23T08:10:29.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-352187318275 1-377957122050' 2026-02-23T08:10:29.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:29.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-352187318275 2026-02-23T08:10:29.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:29.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:29.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-352187318275 2026-02-23T08:10:29.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:29.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=352187318275 2026-02-23T08:10:29.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 352187318275' 2026-02-23T08:10:29.626 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 352187318275 2026-02-23T08:10:29.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:29.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 352187318274 -lt 352187318275 2026-02-23T08:10:29.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:30.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:30.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:30.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 352187318276 -lt 352187318275 2026-02-23T08:10:30.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:30.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122050 2026-02-23T08:10:30.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:30.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:30.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122050 2026-02-23T08:10:30.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:30.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122050 2026-02-23T08:10:30.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122050' 2026-02-23T08:10:30.963 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 377957122050 2026-02-23T08:10:30.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:31.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122050 -lt 377957122050 2026-02-23T08:10:31.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:31.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:31.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:31.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:31.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:31.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:31.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:31.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:31.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:31.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:31.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:31.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:31.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:31.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:31.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:31.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:31.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:31.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:31.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ6 2026-02-23T08:10:31.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 6 % 2 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1126: TEST_corrupt_scrub_replicated: echo extra 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1127: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:31.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:31.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:32.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:32.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:32.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:32.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:32.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:32.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:10:32.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:10:32.173 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:10:32.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:32.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:10:32.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:10:32.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:32.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:32.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:32.182 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:32.181+0000 7fcb74f49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:32.183 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:32.182+0000 7fcb74f49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:32.184 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:32.183+0000 7fcb74f49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:32.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:32.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:32.350 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:32.350+0000 7fcb74f49780 -1 Falling back to public interface 2026-02-23T08:10:32.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:32.720 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:32.719+0000 7fcb74f49780 -1 osd.0 89 log_to_monitors true 2026-02-23T08:10:33.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:33.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:33.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:33.502 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:33.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:33.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:33.668 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 93 up_thru 93 down_at 90 last_clean_interval [82,89) [v2:127.0.0.1:6800/503991352,v1:127.0.0.1:6801/503991352] [v2:127.0.0.1:6802/503991352,v1:127.0.0.1:6803/503991352] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:10:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:33.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:33.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:33.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:33.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:33.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:33.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:33.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:33.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:33.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:33.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:33.917 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:33.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:33.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:33.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958530 2026-02-23T08:10:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958530 2026-02-23T08:10:33.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-399431958530' 2026-02-23T08:10:33.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:33.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:34.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=377957122052 2026-02-23T08:10:34.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 377957122052 2026-02-23T08:10:34.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-399431958530 1-377957122052' 2026-02-23T08:10:34.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:34.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-399431958530 2026-02-23T08:10:34.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:34.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:34.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-399431958530 2026-02-23T08:10:34.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:34.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958530 2026-02-23T08:10:34.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 399431958530' 2026-02-23T08:10:34.071 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 399431958530 2026-02-23T08:10:34.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:34.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 352187318276 -lt 399431958530 2026-02-23T08:10:34.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:35.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:35.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:35.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958530 -lt 399431958530 2026-02-23T08:10:35.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:35.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-377957122052 2026-02-23T08:10:35.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:35.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:35.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-377957122052 2026-02-23T08:10:35.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:35.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=377957122052 2026-02-23T08:10:35.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 377957122052' 2026-02-23T08:10:35.409 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 377957122052 2026-02-23T08:10:35.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:35.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 377957122052 -lt 377957122052 2026-02-23T08:10:35.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:35.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:35.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:35.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:35.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:35.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:35.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:35.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:36.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:36.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:36.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:36.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1128: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/extra-val 2026-02-23T08:10:36.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:36.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ7 2026-02-23T08:10:36.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 7 % 2 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1133: TEST_corrupt_scrub_replicated: echo -n newheader 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1134: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:36.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:10:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:36.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:36.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:10:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:36.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:36.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:36.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:36.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:36.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:36.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:36.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:36.644 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:36.643+0000 7fcccef4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:36.646 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:36.645+0000 7fcccef4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:36.647 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:36.646+0000 7fcccef4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:36.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:36.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:36.847 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:36.845+0000 7fcccef4f780 -1 Falling back to public interface 2026-02-23T08:10:36.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:37.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:37.200+0000 7fcccef4f780 -1 osd.1 95 log_to_monitors true 2026-02-23T08:10:37.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:37.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:37.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:37.970 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:37.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:37.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:38.137 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 99 up_thru 99 down_at 96 last_clean_interval [88,95) [v2:127.0.0.1:6810/1282989934,v1:127.0.0.1:6811/1282989934] [v2:127.0.0.1:6812/1282989934,v1:127.0.0.1:6813/1282989934] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:38.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:38.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:38.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:38.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:38.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:38.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:38.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:38.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:38.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:38.385 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:38.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:38.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:38.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:38.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=399431958532 2026-02-23T08:10:38.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 399431958532 2026-02-23T08:10:38.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-399431958532' 2026-02-23T08:10:38.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:38.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:38.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=425201762306 2026-02-23T08:10:38.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 425201762306 2026-02-23T08:10:38.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-399431958532 1-425201762306' 2026-02-23T08:10:38.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:38.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-399431958532 2026-02-23T08:10:38.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:38.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:38.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-399431958532 2026-02-23T08:10:38.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:38.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=399431958532 2026-02-23T08:10:38.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 399431958532' 2026-02-23T08:10:38.535 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 399431958532 2026-02-23T08:10:38.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:38.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958532 2026-02-23T08:10:38.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:39.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:39.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:39.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958531 -lt 399431958532 2026-02-23T08:10:39.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:40.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:10:40.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:41.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958532 -lt 399431958532 2026-02-23T08:10:41.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:41.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-425201762306 2026-02-23T08:10:41.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:41.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:41.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-425201762306 2026-02-23T08:10:41.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:41.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=425201762306 2026-02-23T08:10:41.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 425201762306' 2026-02-23T08:10:41.041 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 425201762306 2026-02-23T08:10:41.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:41.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 425201762306 -lt 425201762306 2026-02-23T08:10:41.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:41.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:41.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:41.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:41.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:41.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:41.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:41.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:41.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:41.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:41.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:41.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:41.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:41.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:41.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:41.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:41.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:41.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:41.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1135: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/hdr 2026-02-23T08:10:41.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:41.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ8 2026-02-23T08:10:41.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 8 % 2 2026-02-23T08:10:41.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:10:41.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:41.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1139: TEST_corrupt_scrub_replicated: rados --pool csr_pool setxattr ROBJ8 key1-ROBJ8 val1-ROBJ8 2026-02-23T08:10:41.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1140: TEST_corrupt_scrub_replicated: rados --pool csr_pool setxattr ROBJ8 key2-ROBJ8 val2-ROBJ8 2026-02-23T08:10:41.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1143: TEST_corrupt_scrub_replicated: echo -n bad-val 2026-02-23T08:10:41.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1144: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:10:41.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:41.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:41.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:41.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:42.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:42.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:10:42.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:42.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:42.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:10:42.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:42.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:42.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:10:42.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:10:42.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:42.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:42.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:10:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:10:42.296 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:10:42.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:42.296 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:10:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:10:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:42.304 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:42.303+0000 7f5347586780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:42.305 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:42.305+0000 7f5347586780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:42.306 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:42.305+0000 7f5347586780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:42.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:10:42.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:42.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:42.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:42.529 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:42.528+0000 7f5347586780 -1 Falling back to public interface 2026-02-23T08:10:42.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:42.924 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:42.923+0000 7f5347586780 -1 osd.0 100 log_to_monitors true 2026-02-23T08:10:43.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:43.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:43.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:43.625 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:43.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:43.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:10:43.793 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 104 up_thru 104 down_at 101 last_clean_interval [93,100) [v2:127.0.0.1:6800/2848991445,v1:127.0.0.1:6801/2848991445] [v2:127.0.0.1:6802/2848991445,v1:127.0.0.1:6803/2848991445] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:10:43.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:43.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:43.795 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:43.795 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:43.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:43.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:43.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:43.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:43.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:43.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:43.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:43.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:43.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:44.040 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:44.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:44.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:44.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598786 2026-02-23T08:10:44.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598786 2026-02-23T08:10:44.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598786' 2026-02-23T08:10:44.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:44.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=425201762308 2026-02-23T08:10:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 425201762308 2026-02-23T08:10:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598786 1-425201762308' 2026-02-23T08:10:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:44.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-446676598786 2026-02-23T08:10:44.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-446676598786 2026-02-23T08:10:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598786 2026-02-23T08:10:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 446676598786' 2026-02-23T08:10:44.193 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 446676598786 2026-02-23T08:10:44.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 399431958532 -lt 446676598786 2026-02-23T08:10:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:45.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:45.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598786 -lt 446676598786 2026-02-23T08:10:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:45.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-425201762308 2026-02-23T08:10:45.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:45.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:45.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-425201762308 2026-02-23T08:10:45.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:45.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=425201762308 2026-02-23T08:10:45.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 425201762308' 2026-02-23T08:10:45.535 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 425201762308 2026-02-23T08:10:45.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:45.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 425201762308 -lt 425201762308 2026-02-23T08:10:45.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:45.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:45.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:45.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:46.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:46.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:46.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:46.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:46.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:46.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1145: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:46.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:46.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:46.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:46.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:46.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:46.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:46.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:10:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:10:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:46.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:46.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:46.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:46.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:46.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:46.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:46.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:46.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:46.778 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:46.777+0000 7fd2eb754780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:46.779 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:46.779+0000 7fd2eb754780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:46.780 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:46.779+0000 7fd2eb754780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:46.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:46.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:46.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:46.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:46.983 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:46.982+0000 7fd2eb754780 -1 Falling back to public interface 2026-02-23T08:10:47.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:47.330 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:47.329+0000 7fd2eb754780 -1 osd.1 105 log_to_monitors true 2026-02-23T08:10:48.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:48.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:48.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:48.101 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:48.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:48.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:48.267 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 109 up_thru 109 down_at 106 last_clean_interval [99,105) [v2:127.0.0.1:6810/2126370808,v1:127.0.0.1:6811/2126370808] [v2:127.0.0.1:6812/2126370808,v1:127.0.0.1:6813/2126370808] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:48.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:48.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:48.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:48.268 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:48.268 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:48.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:48.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:48.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:48.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:48.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:48.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:48.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:48.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:48.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:48.519 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:48.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:48.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598788 2026-02-23T08:10:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598788 2026-02-23T08:10:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598788' 2026-02-23T08:10:48.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:48.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=468151435266 2026-02-23T08:10:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 468151435266 2026-02-23T08:10:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598788 1-468151435266' 2026-02-23T08:10:48.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:48.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-446676598788 2026-02-23T08:10:48.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:48.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:48.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-446676598788 2026-02-23T08:10:48.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:48.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598788 2026-02-23T08:10:48.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 446676598788' 2026-02-23T08:10:48.672 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 446676598788 2026-02-23T08:10:48.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:48.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598788 2026-02-23T08:10:48.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:49.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:49.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598787 -lt 446676598788 2026-02-23T08:10:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:51.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:10:51.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:51.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598788 -lt 446676598788 2026-02-23T08:10:51.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:51.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-468151435266 2026-02-23T08:10:51.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:51.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:51.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-468151435266 2026-02-23T08:10:51.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:51.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=468151435266 2026-02-23T08:10:51.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 468151435266' 2026-02-23T08:10:51.180 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 468151435266 2026-02-23T08:10:51.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:51.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 468151435266 -lt 468151435266 2026-02-23T08:10:51.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:51.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:51.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:51.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:51.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:51.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:51.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:51.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:51.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:51.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:51.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:51.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:51.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:51.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:51.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:51.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:51.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:51.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:51.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1146: TEST_corrupt_scrub_replicated: echo -n val3-ROBJ8 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1147: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:51.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:51.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:51.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:10:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:52.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:52.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:52.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:52.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:10:52.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:52.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:52.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:52.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:52.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:52.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:52.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:52.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:52.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:52.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:52.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:52.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:52.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:52.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:52.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:52.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:52.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:52.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:52.204 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:52.204 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:52.204 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:52.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:52.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:52.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:52.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:52.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:52.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:52.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:52.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:52.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:52.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:52.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:52.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:52.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:52.207 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:52.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:52.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:52.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:52.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:52.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:52.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:52.210 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:52.206+0000 7fb1b5b6b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:52.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:52.208+0000 7fb1b5b6b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:52.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:52.208+0000 7fb1b5b6b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:52.370 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:52.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:52.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:52.430 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:52.429+0000 7fb1b5b6b780 -1 Falling back to public interface 2026-02-23T08:10:52.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:52.752 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:52.750+0000 7fb1b5b6b780 -1 osd.1 111 log_to_monitors true 2026-02-23T08:10:53.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:53.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:53.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:53.536 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:53.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:53.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:53.706 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 115 up_thru 115 down_at 112 last_clean_interval [109,111) [v2:127.0.0.1:6810/2906470104,v1:127.0.0.1:6811/2906470104] [v2:127.0.0.1:6812/2906470104,v1:127.0.0.1:6813/2906470104] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:53.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:53.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:53.708 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:53.708 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:53.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:53.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:53.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:53.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:53.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:53.952 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:53.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:53.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:53.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:54.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598790 2026-02-23T08:10:54.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598790 2026-02-23T08:10:54.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598790' 2026-02-23T08:10:54.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:54.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:54.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=493921239042 2026-02-23T08:10:54.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 493921239042 2026-02-23T08:10:54.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598790 1-493921239042' 2026-02-23T08:10:54.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:54.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-446676598790 2026-02-23T08:10:54.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:54.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:54.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-446676598790 2026-02-23T08:10:54.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:54.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598790 2026-02-23T08:10:54.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 446676598790' 2026-02-23T08:10:54.107 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 446676598790 2026-02-23T08:10:54.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:54.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598788 -lt 446676598790 2026-02-23T08:10:54.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:55.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:55.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:55.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598790 -lt 446676598790 2026-02-23T08:10:55.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:55.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-493921239042 2026-02-23T08:10:55.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:55.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:10:55.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-493921239042 2026-02-23T08:10:55.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:55.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=493921239042 2026-02-23T08:10:55.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 493921239042' 2026-02-23T08:10:55.443 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 493921239042 2026-02-23T08:10:55.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:10:55.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 493921239042 -lt 493921239042 2026-02-23T08:10:55.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:10:55.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:55.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:55.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:10:55.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:10:55.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:10:55.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:10:55.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:10:55.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:10:55.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:10:55.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:10:55.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:10:55.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:10:55.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:10:55.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:10:56.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:10:56.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:10:56.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:10:56.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1148: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-23T08:10:56.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:10:56.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ9 2026-02-23T08:10:56.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 9 % 2 2026-02-23T08:10:56.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:10:56.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:10:56.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1152: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-23T08:10:56.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:10:56.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:10:56.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:10:56.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:10:56.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:10:56.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-23T08:10:56.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:10:56.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:10:56.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:10:56.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:10:56.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:56.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 get-attr _ 2026-02-23T08:10:56.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:10:56.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:10:56.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:10:56.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:10:56.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:10:56.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:10:56.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:10:56.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:10:56.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:10:56.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:10:56.624 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:10:56.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:10:56.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:10:56.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:10:56.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:10:56.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:10:56.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:10:56.633 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:56.632+0000 7f87de74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:56.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:56.633+0000 7f87de74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:56.635 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:56.634+0000 7f87de74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:10:56.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:56.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:56.844 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:56.842+0000 7f87de74f780 -1 Falling back to public interface 2026-02-23T08:10:56.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:10:57.122 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:10:57.121+0000 7f87de74f780 -1 osd.1 116 log_to_monitors true 2026-02-23T08:10:57.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:10:57.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:10:57.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:10:57.954 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:10:57.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:10:57.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:10:58.120 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 120 up_thru 120 down_at 117 last_clean_interval [115,116) [v2:127.0.0.1:6810/2017728621,v1:127.0.0.1:6811/2017728621] [v2:127.0.0.1:6812/2017728621,v1:127.0.0.1:6813/2017728621] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:10:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:10:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:10:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:10:58.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:10:58.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:10:58.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:10:58.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:10:58.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:10:58.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:10:58.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:10:58.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:10:58.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:10:58.366 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:10:58.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:10:58.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:58.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:10:58.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598792 2026-02-23T08:10:58.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598792 2026-02-23T08:10:58.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598792' 2026-02-23T08:10:58.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:10:58.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:10:58.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=515396075522 2026-02-23T08:10:58.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 515396075522 2026-02-23T08:10:58.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598792 1-515396075522' 2026-02-23T08:10:58.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:10:58.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-446676598792 2026-02-23T08:10:58.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:10:58.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:10:58.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-446676598792 2026-02-23T08:10:58.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:10:58.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598792 2026-02-23T08:10:58.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 446676598792' 2026-02-23T08:10:58.514 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 446676598792 2026-02-23T08:10:58.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:58.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598791 -lt 446676598792 2026-02-23T08:10:58.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:10:59.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:10:59.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:10:59.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598791 -lt 446676598792 2026-02-23T08:10:59.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:00.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:11:00.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:01.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598792 -lt 446676598792 2026-02-23T08:11:01.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:01.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-515396075522 2026-02-23T08:11:01.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:01.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:01.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-515396075522 2026-02-23T08:11:01.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:01.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=515396075522 2026-02-23T08:11:01.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 515396075522' 2026-02-23T08:11:01.025 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 515396075522 2026-02-23T08:11:01.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:01.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 515396075522 -lt 515396075522 2026-02-23T08:11:01.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:01.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:01.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:01.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:01.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:01.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:01.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:01.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:01.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:01.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:01.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:01.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:01.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:01.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:01.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:01.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1153: TEST_corrupt_scrub_replicated: echo -n D 2026-02-23T08:11:01.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1154: TEST_corrupt_scrub_replicated: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/change 2026-02-23T08:11:01.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1155: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:01.778 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:01.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:01.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:01.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:01.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:02.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:02.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:11:02.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:02.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:11:02.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:02.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:02.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:02.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:02.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:02.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:02.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:02.286 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:02.285+0000 7f9a7a681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:02.287 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:02.286+0000 7f9a7a681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:02.288 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:02.287+0000 7f9a7a681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:02.444 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:02.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:02.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:02.447 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:02.446+0000 7f9a7a681780 -1 Falling back to public interface 2026-02-23T08:11:02.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:02.839 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:02.838+0000 7f9a7a681780 -1 osd.1 122 log_to_monitors true 2026-02-23T08:11:03.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:03.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:03.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:03.609 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:03.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:03.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:03.773 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 126 up_thru 126 down_at 123 last_clean_interval [120,122) [v2:127.0.0.1:6810/1470480768,v1:127.0.0.1:6811/1470480768] [v2:127.0.0.1:6812/1470480768,v1:127.0.0.1:6813/1470480768] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:03.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:03.775 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:03.775 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:03.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:03.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:03.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:03.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:03.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:03.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:03.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:03.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:03.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:04.020 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:04.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:04.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=446676598794 2026-02-23T08:11:04.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 446676598794 2026-02-23T08:11:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598794' 2026-02-23T08:11:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:04.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:04.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=541165879298 2026-02-23T08:11:04.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 541165879298 2026-02-23T08:11:04.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-446676598794 1-541165879298' 2026-02-23T08:11:04.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:04.168 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-446676598794 2026-02-23T08:11:04.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:04.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:04.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-446676598794 2026-02-23T08:11:04.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:04.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=446676598794 2026-02-23T08:11:04.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 446676598794' 2026-02-23T08:11:04.171 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 446676598794 2026-02-23T08:11:04.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:04.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598792 -lt 446676598794 2026-02-23T08:11:04.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:05.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:05.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:05.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 446676598794 -lt 446676598794 2026-02-23T08:11:05.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:05.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-541165879298 2026-02-23T08:11:05.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:05.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:05.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-541165879298 2026-02-23T08:11:05.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:05.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=541165879298 2026-02-23T08:11:05.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 541165879298' 2026-02-23T08:11:05.513 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 541165879298 2026-02-23T08:11:05.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:05.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 541165879298 -lt 541165879298 2026-02-23T08:11:05.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:05.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:05.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:05.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:05.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:05.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:05.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:05.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:05.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:05.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:05.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:06.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:06.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:06.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:06.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:06.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:06.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:06.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:06.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1156: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/oi td/osd-scrub-repair/change 2026-02-23T08:11:06.251 INFO:tasks.workunit.client.0.trial129.stderr:rm: cannot remove 'td/osd-scrub-repair/oi': No such file or directory 2026-02-23T08:11:06.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:06.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ10 2026-02-23T08:11:06.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 10 % 2 2026-02-23T08:11:06.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:11:06.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:06.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:06.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ11 2026-02-23T08:11:06.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 11 % 2 2026-02-23T08:11:06.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:11:06.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:06.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:06.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ12 2026-02-23T08:11:06.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 12 % 2 2026-02-23T08:11:06.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:11:06.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:06.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:06.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ13 2026-02-23T08:11:06.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 13 % 2 2026-02-23T08:11:06.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:11:06.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:06.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:06.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ14 2026-02-23T08:11:06.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 14 % 2 2026-02-23T08:11:06.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:11:06.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:06.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1165: TEST_corrupt_scrub_replicated: echo -n bad-val 2026-02-23T08:11:06.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1166: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:11:06.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:06.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:06.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:06.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:06.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:06.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:11:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:11:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:06.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:11:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:11:06.539 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:11:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:06.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:11:06.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:11:06.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:06.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:06.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:06.551 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:06.550+0000 7f0e49f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:06.552 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:06.551+0000 7f0e49f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:06.553 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:06.552+0000 7f0e49f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:06.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:11:06.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:06.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:11:06.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:06.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:06.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:06.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:06.709 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:06.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:06.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:06.748 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:06.747+0000 7f0e49f4b780 -1 Falling back to public interface 2026-02-23T08:11:06.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:07.006 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:07.005+0000 7f0e49f4b780 -1 osd.0 128 log_to_monitors true 2026-02-23T08:11:07.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:07.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:07.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:07.873 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:07.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:07.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 132 up_thru 132 down_at 129 last_clean_interval [104,128) [v2:127.0.0.1:6800/376767619,v1:127.0.0.1:6801/376767619] [v2:127.0.0.1:6802/376767619,v1:127.0.0.1:6803/376767619] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:08.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:08.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:08.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:08.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:08.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:08.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:08.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:08.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:08.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:08.286 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:08.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:08.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:08.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:08.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=566935683074 2026-02-23T08:11:08.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 566935683074 2026-02-23T08:11:08.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-566935683074' 2026-02-23T08:11:08.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:08.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:08.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=541165879300 2026-02-23T08:11:08.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 541165879300 2026-02-23T08:11:08.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-566935683074 1-541165879300' 2026-02-23T08:11:08.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:08.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-566935683074 2026-02-23T08:11:08.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:08.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:08.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-566935683074 2026-02-23T08:11:08.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:08.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=566935683074 2026-02-23T08:11:08.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 566935683074' 2026-02-23T08:11:08.437 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 566935683074 2026-02-23T08:11:08.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:08.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683074 -lt 566935683074 2026-02-23T08:11:08.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:08.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-541165879300 2026-02-23T08:11:08.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:08.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:08.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-541165879300 2026-02-23T08:11:08.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:08.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=541165879300 2026-02-23T08:11:08.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 541165879300' 2026-02-23T08:11:08.607 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 541165879300 2026-02-23T08:11:08.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:08.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 541165879299 -lt 541165879300 2026-02-23T08:11:08.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:09.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:09.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:09.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 541165879299 -lt 541165879300 2026-02-23T08:11:09.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:10.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:11:10.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:11.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 541165879300 -lt 541165879300 2026-02-23T08:11:11.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:11.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:11.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:11.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:11.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:11.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:11.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:11.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:11.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:11.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1167: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:11.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:11.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ14 rm-attr _ 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:12.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:12.159 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:12.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:12.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:12.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:12.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:12.161 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:12.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:12.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:12.170 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:12.169+0000 7fee9f099780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:12.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:12.171+0000 7fee9f099780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:12.172 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:12.171+0000 7fee9f099780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:12.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:12.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:12.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:12.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:12.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:12.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:12.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:12.324 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:12.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:12.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:12.400 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:12.399+0000 7fee9f099780 -1 Falling back to public interface 2026-02-23T08:11:12.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:12.788 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:12.787+0000 7fee9f099780 -1 osd.1 133 log_to_monitors true 2026-02-23T08:11:13.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:13.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:13.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:13.491 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:13.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:13.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:13.659 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 137 up_thru 137 down_at 134 last_clean_interval [126,133) [v2:127.0.0.1:6810/3371553410,v1:127.0.0.1:6811/3371553410] [v2:127.0.0.1:6812/3371553410,v1:127.0.0.1:6813/3371553410] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:13.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:13.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:13.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:13.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:13.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:13.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:13.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:13.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:13.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:13.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:13.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:13.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:13.906 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:13.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:13.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:13.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:13.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=566935683076 2026-02-23T08:11:13.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 566935683076 2026-02-23T08:11:13.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-566935683076' 2026-02-23T08:11:13.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:13.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:14.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=588410519554 2026-02-23T08:11:14.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 588410519554 2026-02-23T08:11:14.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-566935683076 1-588410519554' 2026-02-23T08:11:14.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:14.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-566935683076 2026-02-23T08:11:14.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:14.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:14.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-566935683076 2026-02-23T08:11:14.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:14.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=566935683076 2026-02-23T08:11:14.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 566935683076' 2026-02-23T08:11:14.061 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 566935683076 2026-02-23T08:11:14.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:14.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683075 -lt 566935683076 2026-02-23T08:11:14.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:15.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:15.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:15.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683076 -lt 566935683076 2026-02-23T08:11:15.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:15.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-588410519554 2026-02-23T08:11:15.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:15.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:15.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-588410519554 2026-02-23T08:11:15.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:15.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=588410519554 2026-02-23T08:11:15.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 588410519554' 2026-02-23T08:11:15.399 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 588410519554 2026-02-23T08:11:15.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:15.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 588410519554 -lt 588410519554 2026-02-23T08:11:15.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:15.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:15.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:15.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:15.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:15.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:15.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:15.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:16.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:16.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:16.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:16.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1168: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/bad-val 2026-02-23T08:11:16.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:16.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ15 2026-02-23T08:11:16.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 15 % 2 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1172: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:16.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:16.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:16.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:16.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:16.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:16.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:16.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:16.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ15 rm-attr _ 2026-02-23T08:11:16.569 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:11:16.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:16.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:16.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:16.627 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:16.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:16.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:16.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:16.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:16.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:16.633+0000 7f63a700e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:16.636 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:16.635+0000 7f63a700e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:16.637 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:16.636+0000 7f63a700e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:16.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:16.791 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:16.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:16.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:16.826 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:16.825+0000 7f63a700e780 -1 Falling back to public interface 2026-02-23T08:11:16.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:17.201 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:17.200+0000 7f63a700e780 -1 osd.1 139 log_to_monitors true 2026-02-23T08:11:17.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:17.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:17.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:17.953 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:17.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:17.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 143 up_thru 143 down_at 140 last_clean_interval [137,139) [v2:127.0.0.1:6810/785356580,v1:127.0.0.1:6811/785356580] [v2:127.0.0.1:6812/785356580,v1:127.0.0.1:6813/785356580] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:18.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:18.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:18.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:18.119 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:18.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:18.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:18.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:18.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:18.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:18.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:18.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:18.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:18.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:18.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:18.366 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:18.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:18.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:18.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:18.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=566935683078 2026-02-23T08:11:18.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 566935683078 2026-02-23T08:11:18.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-566935683078' 2026-02-23T08:11:18.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:18.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:18.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=614180323330 2026-02-23T08:11:18.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 614180323330 2026-02-23T08:11:18.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-566935683078 1-614180323330' 2026-02-23T08:11:18.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:18.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-566935683078 2026-02-23T08:11:18.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:18.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:18.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-566935683078 2026-02-23T08:11:18.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:18.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=566935683078 2026-02-23T08:11:18.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 566935683078' 2026-02-23T08:11:18.518 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 566935683078 2026-02-23T08:11:18.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:18.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683077 -lt 566935683078 2026-02-23T08:11:18.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:19.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:19.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:19.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683077 -lt 566935683078 2026-02-23T08:11:19.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:20.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:11:20.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:21.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683078 -lt 566935683078 2026-02-23T08:11:21.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:21.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-614180323330 2026-02-23T08:11:21.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:21.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:21.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-614180323330 2026-02-23T08:11:21.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:21.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=614180323330 2026-02-23T08:11:21.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 614180323330' 2026-02-23T08:11:21.018 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 614180323330 2026-02-23T08:11:21.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:21.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 614180323330 -lt 614180323330 2026-02-23T08:11:21.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:21.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:21.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:21.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:21.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:21.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:21.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:21.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:21.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:21.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:21.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:21.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:21.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:21.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:21.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:21.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:21.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:21.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:21.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:21.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ16 2026-02-23T08:11:21.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 16 % 2 2026-02-23T08:11:21.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:11:21.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1176: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:21.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:22.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:22.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-23T08:11:22.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:22.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:22.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:11:22.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:22.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:22.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ16 rm-attr snapset 2026-02-23T08:11:22.189 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:11:22.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:11:22.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:22.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:22.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:11:22.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:11:22.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:22.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:22.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:22.255 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:22.254+0000 7f0bbcea2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:22.257 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:22.256+0000 7f0bbcea2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:22.257 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:22.257+0000 7f0bbcea2780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:22.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:11:22.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:22.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:11:22.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:22.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:22.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:22.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:22.411 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:22.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:22.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:22.468 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:22.467+0000 7f0bbcea2780 -1 Falling back to public interface 2026-02-23T08:11:22.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:22.810 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:22.808+0000 7f0bbcea2780 -1 osd.0 145 log_to_monitors true 2026-02-23T08:11:23.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:23.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:23.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:23.574 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:23.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:23.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:23.740 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 149 up_thru 149 down_at 146 last_clean_interval [132,145) [v2:127.0.0.1:6800/4136873029,v1:127.0.0.1:6801/4136873029] [v2:127.0.0.1:6802/4136873029,v1:127.0.0.1:6803/4136873029] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:11:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:23.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:23.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:23.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:23.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:23.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:23.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:23.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:23.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:23.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:23.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:23.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:23.982 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:23.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:23.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:23.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:24.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127106 2026-02-23T08:11:24.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127106 2026-02-23T08:11:24.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127106' 2026-02-23T08:11:24.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:24.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=614180323332 2026-02-23T08:11:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 614180323332 2026-02-23T08:11:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127106 1-614180323332' 2026-02-23T08:11:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127106 2026-02-23T08:11:24.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:24.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:24.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127106 2026-02-23T08:11:24.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:24.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127106 2026-02-23T08:11:24.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127106' 2026-02-23T08:11:24.138 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 639950127106 2026-02-23T08:11:24.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:24.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 566935683078 -lt 639950127106 2026-02-23T08:11:24.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:25.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:25.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:25.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127106 -lt 639950127106 2026-02-23T08:11:25.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:25.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-614180323332 2026-02-23T08:11:25.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:25.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:25.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-614180323332 2026-02-23T08:11:25.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:25.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=614180323332 2026-02-23T08:11:25.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 614180323332' 2026-02-23T08:11:25.473 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 614180323332 2026-02-23T08:11:25.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:25.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 614180323332 -lt 614180323332 2026-02-23T08:11:25.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:25.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:25.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:25.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:25.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:25.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:25.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:25.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:25.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:25.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:25.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:26.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:26.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:26.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:26.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:26.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:26.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:26.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:26.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1177: TEST_corrupt_scrub_replicated: echo -n bad-val 2026-02-23T08:11:26.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1178: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:11:26.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:26.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:26.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:26.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:26.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:11:26.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:26.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:26.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:26.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:26.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:26.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:11:26.442 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:11:26.442 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:11:26.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:26.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:26.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:26.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:26.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:26.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:26.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:26.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:26.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:26.511 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:26.510+0000 7f7836817780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:26.512 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:26.511+0000 7f7836817780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:26.513 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:26.512+0000 7f7836817780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:26.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:26.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:26.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:26.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:26.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:26.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:26.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:26.666 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:26.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:26.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:26.750 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:26.749+0000 7f7836817780 -1 Falling back to public interface 2026-02-23T08:11:26.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:27.141 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:27.140+0000 7f7836817780 -1 osd.1 150 log_to_monitors true 2026-02-23T08:11:27.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:27.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:27.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:27.833 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:27.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:27.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 154 up_thru 154 down_at 151 last_clean_interval [143,150) [v2:127.0.0.1:6810/1571692233,v1:127.0.0.1:6811/1571692233] [v2:127.0.0.1:6812/1571692233,v1:127.0.0.1:6813/1571692233] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:28.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:28.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:28.002 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:28.002 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:28.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:28.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:28.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:28.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:28.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:28.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:28.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:28.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:28.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:28.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:28.250 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:28.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:28.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:28.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:28.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127108 2026-02-23T08:11:28.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127108 2026-02-23T08:11:28.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127108' 2026-02-23T08:11:28.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:28.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:28.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963586 2026-02-23T08:11:28.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963586 2026-02-23T08:11:28.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127108 1-661424963586' 2026-02-23T08:11:28.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:28.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127108 2026-02-23T08:11:28.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:28.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:28.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127108 2026-02-23T08:11:28.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127108 2026-02-23T08:11:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127108' 2026-02-23T08:11:28.402 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 639950127108 2026-02-23T08:11:28.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:28.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127108 -lt 639950127108 2026-02-23T08:11:28.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963586 2026-02-23T08:11:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:28.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:28.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963586 2026-02-23T08:11:28.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:28.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963586 2026-02-23T08:11:28.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963586' 2026-02-23T08:11:28.577 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 661424963586 2026-02-23T08:11:28.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 661424963586 2026-02-23T08:11:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:29.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:29.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:29.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 661424963586 2026-02-23T08:11:29.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:30.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:11:30.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:31.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963586 -lt 661424963586 2026-02-23T08:11:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:31.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:31.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:31.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:31.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:31.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:31.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:31.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:31.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:31.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:31.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:31.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:31.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:31.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:31.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:31.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:31.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:31.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ17 2026-02-23T08:11:31.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 17 % 2 2026-02-23T08:11:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1183: TEST_corrupt_scrub_replicated: local payload=ROBJ17 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1184: TEST_corrupt_scrub_replicated: echo ROBJ17 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1185: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:31.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:31.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:32.061 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:32.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:32.128 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:32.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:32.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:32.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:11:32.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:11:32.130 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:11:32.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:32.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:11:32.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:11:32.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:32.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:32.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:32.139 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:32.138+0000 7fbf008a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:32.140 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:32.139+0000 7fbf008a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:32.141 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:32.140+0000 7fbf008a6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:32.283 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:32.281+0000 7fbf008a6780 -1 Falling back to public interface 2026-02-23T08:11:32.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:11:32.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:32.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:32.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:32.603 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:32.601+0000 7fbf008a6780 -1 osd.0 156 log_to_monitors true 2026-02-23T08:11:33.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:33.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:33.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:33.462 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:33.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:33.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 160 up_thru 160 down_at 157 last_clean_interval [149,156) [v2:127.0.0.1:6800/3256508990,v1:127.0.0.1:6801/3256508990] [v2:127.0.0.1:6802/3256508990,v1:127.0.0.1:6803/3256508990] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:33.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:33.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:33.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:33.629 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:33.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:33.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:33.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:33.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:33.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:33.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:33.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:33.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:33.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:33.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:33.876 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:33.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:33.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:33.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:33.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767362 2026-02-23T08:11:33.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767362 2026-02-23T08:11:33.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767362' 2026-02-23T08:11:33.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:33.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:34.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963588 2026-02-23T08:11:34.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963588 2026-02-23T08:11:34.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767362 1-661424963588' 2026-02-23T08:11:34.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:34.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767362 2026-02-23T08:11:34.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:34.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:34.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767362 2026-02-23T08:11:34.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:34.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767362 2026-02-23T08:11:34.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767362' 2026-02-23T08:11:34.026 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 687194767362 2026-02-23T08:11:34.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:34.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127108 -lt 687194767362 2026-02-23T08:11:34.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:35.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:35.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:35.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767362 -lt 687194767362 2026-02-23T08:11:35.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:35.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963588 2026-02-23T08:11:35.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:35.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:35.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963588 2026-02-23T08:11:35.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:35.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963588 2026-02-23T08:11:35.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963588' 2026-02-23T08:11:35.360 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 661424963588 2026-02-23T08:11:35.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:35.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963588 -lt 661424963588 2026-02-23T08:11:35.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:35.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:35.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:35.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:35.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:35.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:35.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:35.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:35.738 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:35.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:35.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:35.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:35.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:35.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:35.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1186: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:36.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:36.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:36.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:11:36.337 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:11:36.338 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:36.399 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:36.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:36.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:36.401 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:36.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:36.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:36.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:36.410 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:36.409+0000 7f7473a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:36.411 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:36.410+0000 7f7473a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:36.412 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:36.411+0000 7f7473a0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:36.567 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:36.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:36.576+0000 7f7473a0c780 -1 Falling back to public interface 2026-02-23T08:11:36.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:36.925 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:36.923+0000 7f7473a0c780 -1 osd.1 161 log_to_monitors true 2026-02-23T08:11:37.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:37.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:37.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:37.730 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:37.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:37.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 165 up_thru 165 down_at 162 last_clean_interval [154,161) [v2:127.0.0.1:6810/3115347176,v1:127.0.0.1:6811/3115347176] [v2:127.0.0.1:6812/3115347176,v1:127.0.0.1:6813/3115347176] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:37.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:37.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:37.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:37.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:37.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:37.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:37.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:37.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:37.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:37.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:37.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:37.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:38.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:38.144 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:38.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:38.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:38.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:38.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767364 2026-02-23T08:11:38.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767364 2026-02-23T08:11:38.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767364' 2026-02-23T08:11:38.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:38.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:38.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603842 2026-02-23T08:11:38.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603842 2026-02-23T08:11:38.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767364 1-708669603842' 2026-02-23T08:11:38.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:38.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767364 2026-02-23T08:11:38.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:38.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:38.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767364 2026-02-23T08:11:38.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:38.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767364 2026-02-23T08:11:38.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767364' 2026-02-23T08:11:38.292 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 687194767364 2026-02-23T08:11:38.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:38.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767364 -lt 687194767364 2026-02-23T08:11:38.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:38.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603842 2026-02-23T08:11:38.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:38.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:38.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603842 2026-02-23T08:11:38.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:38.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603842 2026-02-23T08:11:38.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603842' 2026-02-23T08:11:38.461 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 708669603842 2026-02-23T08:11:38.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:38.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603842 -lt 708669603842 2026-02-23T08:11:38.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:38.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:38.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:38.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:38.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:38.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:38.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:38.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:38.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:38.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:38.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:38.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:38.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:38.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:38.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:39.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:39.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:39.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:39.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:39.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ18 2026-02-23T08:11:39.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 18 % 2 2026-02-23T08:11:39.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=0 2026-02-23T08:11:39.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:39.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1191: TEST_corrupt_scrub_replicated: local payload=ROBJ18 2026-02-23T08:11:39.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1192: TEST_corrupt_scrub_replicated: echo ROBJ18 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1193: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:39.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:39.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:39.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:39.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:39.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:11:39.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:39.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:39.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:39.427 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:11:39.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:39.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:39.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:11:39.496 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:11:39.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:39.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:11:39.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:11:39.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:39.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:39.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:39.505 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:39.504+0000 7fc731575780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:39.506 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:39.506+0000 7fc731575780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:39.507 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:39.506+0000 7fc731575780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:39.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:11:39.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:39.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:11:39.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:39.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:39.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:39.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:39.665 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:39.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:39.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:39.712 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:39.711+0000 7fc731575780 -1 Falling back to public interface 2026-02-23T08:11:39.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:40.058 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:40.057+0000 7fc731575780 -1 osd.0 167 log_to_monitors true 2026-02-23T08:11:40.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:40.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:40.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:40.830 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:40.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:40.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:11:40.996 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 171 up_thru 171 down_at 168 last_clean_interval [160,167) [v2:127.0.0.1:6800/179919996,v1:127.0.0.1:6801/179919996] [v2:127.0.0.1:6802/179919996,v1:127.0.0.1:6803/179919996] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:11:40.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:40.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:40.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:40.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:40.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:41.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:41.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:41.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:41.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:41.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:41.080 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:41.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:41.248 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:41.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:41.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:41.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:41.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407618 2026-02-23T08:11:41.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407618 2026-02-23T08:11:41.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407618' 2026-02-23T08:11:41.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:41.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:41.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603843 2026-02-23T08:11:41.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603843 2026-02-23T08:11:41.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407618 1-708669603843' 2026-02-23T08:11:41.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:41.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407618 2026-02-23T08:11:41.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:41.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:41.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407618 2026-02-23T08:11:41.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:41.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407618 2026-02-23T08:11:41.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407618' 2026-02-23T08:11:41.398 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 734439407618 2026-02-23T08:11:41.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:41.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 734439407618 2026-02-23T08:11:41.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:42.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:42.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:42.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407618 -lt 734439407618 2026-02-23T08:11:42.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:42.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603843 2026-02-23T08:11:42.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:42.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:42.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603843 2026-02-23T08:11:42.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:42.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603843 2026-02-23T08:11:42.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603843' 2026-02-23T08:11:42.735 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 708669603843 2026-02-23T08:11:42.736 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:42.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603844 -lt 708669603843 2026-02-23T08:11:42.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:42.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:42.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:43.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:43.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:43.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:43.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:43.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:43.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:43.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:43.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:43.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:43.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:43.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:43.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1194: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:43.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:43.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:43.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:43.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:11:43.915 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:11:43.915 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:11:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:43.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:43.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:43.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:43.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:43.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:43.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:43.988 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:43.987+0000 7f40b234f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:43.989 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:43.989+0000 7f40b234f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:43.990 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:43.989+0000 7f40b234f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:44.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:44.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:44.196 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:44.194+0000 7f40b234f780 -1 Falling back to public interface 2026-02-23T08:11:44.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:44.596 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:44.595+0000 7f40b234f780 -1 osd.1 172 log_to_monitors true 2026-02-23T08:11:45.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:45.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:45.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:45.312 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:45.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:45.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 176 up_thru 176 down_at 173 last_clean_interval [165,172) [v2:127.0.0.1:6810/2964592663,v1:127.0.0.1:6811/2964592663] [v2:127.0.0.1:6812/2964592663,v1:127.0.0.1:6813/2964592663] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:45.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:45.484 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:45.484 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:45.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:45.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:45.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:45.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:45.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:45.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:45.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:45.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:45.732 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:45.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:45.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:45.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:45.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407620 2026-02-23T08:11:45.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407620 2026-02-23T08:11:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407620' 2026-02-23T08:11:45.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:45.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:45.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=755914244098 2026-02-23T08:11:45.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 755914244098 2026-02-23T08:11:45.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407620 1-755914244098' 2026-02-23T08:11:45.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:45.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407620 2026-02-23T08:11:45.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:45.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:45.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407620 2026-02-23T08:11:45.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:45.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407620 2026-02-23T08:11:45.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407620' 2026-02-23T08:11:45.883 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 734439407620 2026-02-23T08:11:45.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:46.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407618 -lt 734439407620 2026-02-23T08:11:46.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:47.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:47.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:47.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407620 -lt 734439407620 2026-02-23T08:11:47.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:47.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-755914244098 2026-02-23T08:11:47.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:47.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:47.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-755914244098 2026-02-23T08:11:47.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:47.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=755914244098 2026-02-23T08:11:47.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 755914244098' 2026-02-23T08:11:47.218 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 755914244098 2026-02-23T08:11:47.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:47.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 755914244098 -lt 755914244098 2026-02-23T08:11:47.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:47.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:47.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:47.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:47.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:47.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:47.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:47.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:47.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1196: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-23T08:11:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:11:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:11:47.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:11:47.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:11:48.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:11:48.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-23T08:11:48.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:11:48.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:11:48.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:11:48.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:11:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 corrupt-info 2026-02-23T08:11:48.376 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:11:48.376 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:11:48.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:11:48.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:11:48.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:11:48.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:11:48.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:11:48.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:11:48.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:11:48.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:11:48.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:11:48.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:11:48.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:48.441+0000 7fca2434f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:48.444 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:48.443+0000 7fca2434f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:48.445 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:48.444+0000 7fca2434f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:11:48.595 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:11:48.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:48.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:48.657 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:48.656+0000 7fca2434f780 -1 Falling back to public interface 2026-02-23T08:11:48.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:11:49.004 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:11:49.003+0000 7fca2434f780 -1 osd.1 177 log_to_monitors true 2026-02-23T08:11:49.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:11:49.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:11:49.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:11:49.762 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:11:49.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:11:49.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:11:49.925 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 181 up_thru 181 down_at 178 last_clean_interval [176,177) [v2:127.0.0.1:6810/1893931708,v1:127.0.0.1:6811/1893931708] [v2:127.0.0.1:6812/1893931708,v1:127.0.0.1:6813/1893931708] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:49.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:49.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:49.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:49.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:11:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:11:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:11:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:11:50.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:50.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:50.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:50.174 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:50.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:50.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:50.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:50.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407622 2026-02-23T08:11:50.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407622 2026-02-23T08:11:50.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407622' 2026-02-23T08:11:50.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:50.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:50.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080578 2026-02-23T08:11:50.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080578 2026-02-23T08:11:50.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407622 1-777389080578' 2026-02-23T08:11:50.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:50.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407622 2026-02-23T08:11:50.323 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:50.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:50.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407622 2026-02-23T08:11:50.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407622 2026-02-23T08:11:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407622' 2026-02-23T08:11:50.325 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 734439407622 2026-02-23T08:11:50.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:50.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407622 -lt 734439407622 2026-02-23T08:11:50.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:50.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080578 2026-02-23T08:11:50.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:50.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:50.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080578 2026-02-23T08:11:50.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:50.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080578 2026-02-23T08:11:50.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080578' 2026-02-23T08:11:50.498 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 777389080578 2026-02-23T08:11:50.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:50.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080578 -lt 777389080578 2026-02-23T08:11:50.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:11:50.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:50.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:11:50.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:11:51.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:11:51.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:11:51.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:11:51.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:11:51.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:11:51.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:11:51.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:11:51.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1088: TEST_corrupt_scrub_replicated: for i in $(seq 1 $total_objs) 2026-02-23T08:11:51.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1089: TEST_corrupt_scrub_replicated: objname=ROBJ19 2026-02-23T08:11:51.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: expr 19 % 2 2026-02-23T08:11:51.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1092: TEST_corrupt_scrub_replicated: local osd=1 2026-02-23T08:11:51.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1094: TEST_corrupt_scrub_replicated: case $i in 2026-02-23T08:11:51.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1205: TEST_corrupt_scrub_replicated: get_pg csr_pool ROBJ0 2026-02-23T08:11:51.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-23T08:11:51.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-23T08:11:51.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:11:51.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:11:51.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1205: TEST_corrupt_scrub_replicated: local pg=3.0 2026-02-23T08:11:51.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1207: TEST_corrupt_scrub_replicated: ceph tell 'osd.*' injectargs -- --osd-max-object-size=1048576 2026-02-23T08:11:51.474 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: {} 2026-02-23T08:11:51.474 INFO:tasks.workunit.client.0.trial129.stderr:osd.0: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_max_object_size = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2026-02-23T08:11:51.482 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: {} 2026-02-23T08:11:51.483 INFO:tasks.workunit.client.0.trial129.stderr:osd.1: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_max_object_size = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2026-02-23T08:11:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1209: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ11 td/osd-scrub-repair 0 2026-02-23T08:11:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:11:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:11:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-23T08:11:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:11:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:11:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:11:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ11 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ11 2026-02-23T08:11:51.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:11:51.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ11 2026-02-23T08:11:51.496 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ11 2026-02-23T08:11:51.496 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:11:51.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:11:51.658 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:11:51.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:11:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:11:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:11:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-23T08:11:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:11:51.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:11:51.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-23T08:11:51.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:11:51.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-23T08:11:51.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:11:51.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T08:11:51.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:11:51.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:11:51.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:11:51.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:11:51.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:11:51.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:11:51.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-23T08:11:51.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:11:51.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:11:51.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:51.726 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:51.726 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:51.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:11:51.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:11:51.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.1.asok injectdataerr csr_pool ROBJ11 2026-02-23T08:11:51.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1210: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ12 td/osd-scrub-repair 1 2026-02-23T08:11:51.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:11:51.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ12 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ12 2026-02-23T08:11:51.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:11:51.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ12 2026-02-23T08:11:51.790 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ12 2026-02-23T08:11:51.790 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:11:51.955 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:11:51.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-23T08:11:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:11:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-23T08:11:51.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:51.959 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:11:51.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:11:52.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:11:52.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:11:52.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:11:52.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-23T08:11:52.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:11:52.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:11:52.025 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:52.026 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:52.026 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:52.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:11:52.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:11:52.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.0.asok injectmdataerr csr_pool ROBJ12 2026-02-23T08:11:52.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1211: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ13 td/osd-scrub-repair 1 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:11:52.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-23T08:11:52.092 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:11:52.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:11:52.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-23T08:11:52.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:11:52.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-23T08:11:52.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:11:52.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:11:52.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:11:52.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:11:52.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:11:52.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:11:52.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.0.asok injectmdataerr csr_pool ROBJ13 2026-02-23T08:11:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1212: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ13 td/osd-scrub-repair 0 2026-02-23T08:11:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:11:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:11:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-23T08:11:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:11:52.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-23T08:11:52.392 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:11:52.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:11:52.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-23T08:11:52.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:11:52.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:52.561 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:52.562 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:11:52.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:11:52.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:11:52.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:11:52.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:11:52.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-23T08:11:52.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:11:52.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:11:52.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:11:52.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:11:52.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:11:52.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:11:52.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:11:52.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.1.asok injectdataerr csr_pool ROBJ13 2026-02-23T08:11:52.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1214: TEST_corrupt_scrub_replicated: pg_scrub 3.0 2026-02-23T08:11:52.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:11:52.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:11:52.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:11:52.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:11:52.691 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:11:52.691 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:11:52.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:11:52.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:11:52.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:11:52.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:11:52.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:11:52.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:11:52.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:11:52.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:11:52.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:11:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:11:53.052 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:11:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:11:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:53.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:11:53.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407623 2026-02-23T08:11:53.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407623 2026-02-23T08:11:53.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407623' 2026-02-23T08:11:53.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:11:53.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:11:53.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080579 2026-02-23T08:11:53.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080579 2026-02-23T08:11:53.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407623 1-777389080579' 2026-02-23T08:11:53.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:53.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407623 2026-02-23T08:11:53.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:53.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:11:53.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407623 2026-02-23T08:11:53.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:53.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407623 2026-02-23T08:11:53.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407623' 2026-02-23T08:11:53.206 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407623 2026-02-23T08:11:53.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:53.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407622 -lt 734439407623 2026-02-23T08:11:53.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:11:54.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:11:54.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:11:54.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407623 -lt 734439407623 2026-02-23T08:11:54.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:11:54.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080579 2026-02-23T08:11:54.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:11:54.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:11:54.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080579 2026-02-23T08:11:54.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:11:54.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080579 2026-02-23T08:11:54.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080579' 2026-02-23T08:11:54.544 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080579 2026-02-23T08:11:54.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080580 -lt 777389080579 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:11:54.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:11:54.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:11:54.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:11:54.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:11:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:11:55.107 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:11:55.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:11:55.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:11:55.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:11:55.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:55.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:11:56.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:11:56.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:11:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:11:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:11:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:11:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:11:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:11:56.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:56.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:11:57.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:11:57.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:11:57.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:11:57.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:11:57.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:11:57.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:11:57.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:11:57.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:57.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:11:58.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:11:58.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:11:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:11:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:11:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:11:58.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:11:58.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:11:58.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:58.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:11:59.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:11:59.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:11:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:11:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:11:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:11:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:11:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:11:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:11:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:00.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:00.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:00.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:12:00.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:00.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:12:00.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:00.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:12:01.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:11:56.005993+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1216: TEST_corrupt_scrub_replicated: ERRORS=0 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1217: TEST_corrupt_scrub_replicated: declare -a s_err_strings 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1218: TEST_corrupt_scrub_replicated: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1219: TEST_corrupt_scrub_replicated: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : object info inconsistent ' 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1220: TEST_corrupt_scrub_replicated: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1221: TEST_corrupt_scrub_replicated: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1222: TEST_corrupt_scrub_replicated: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1223: TEST_corrupt_scrub_replicated: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' 2026-02-23T08:12:01.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1224: TEST_corrupt_scrub_replicated: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1225: TEST_corrupt_scrub_replicated: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1226: TEST_corrupt_scrub_replicated: err_strings[8]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1227: TEST_corrupt_scrub_replicated: err_strings[9]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1228: TEST_corrupt_scrub_replicated: err_strings[10]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1229: TEST_corrupt_scrub_replicated: err_strings[11]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1230: TEST_corrupt_scrub_replicated: err_strings[12]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1231: TEST_corrupt_scrub_replicated: err_strings[13]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1232: TEST_corrupt_scrub_replicated: err_strings[14]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : candidate size 1 info size 7 mismatch' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1233: TEST_corrupt_scrub_replicated: err_strings[15]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1234: TEST_corrupt_scrub_replicated: err_strings[16]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1235: TEST_corrupt_scrub_replicated: err_strings[17]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' 2026-02-23T08:12:01.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1236: TEST_corrupt_scrub_replicated: err_strings[18]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049713/1049720 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' 2026-02-23T08:12:01.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1237: TEST_corrupt_scrub_replicated: err_strings[19]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 1 missing, 8 inconsistent objects' 2026-02-23T08:12:01.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1238: TEST_corrupt_scrub_replicated: err_strings[20]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 18 errors' 2026-02-23T08:12:01.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1239: TEST_corrupt_scrub_replicated: err_strings[21]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:123a5f55:::ROBJ19:head : size 1049600 > 1048576 is too large' 2026-02-23T08:12:01.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : candidate size 1 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049713/1049720 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 1 missing, 8 inconsistent objects' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 18 errors' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1241: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:01.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1243: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:123a5f55:::ROBJ19:head : size 1049600 > 1048576 is too large' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:01.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1250: TEST_corrupt_scrub_replicated: rados list-inconsistent-pg csr_pool 2026-02-23T08:12:01.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1252: TEST_corrupt_scrub_replicated: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:12:01.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1252: TEST_corrupt_scrub_replicated: test 1 = 1 2026-02-23T08:12:01.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1254: TEST_corrupt_scrub_replicated: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:12:01.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1254: TEST_corrupt_scrub_replicated: test 3.0 = 3.0 2026-02-23T08:12:01.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1256: TEST_corrupt_scrub_replicated: rados list-inconsistent-obj 3.0 2026-02-23T08:12:01.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1258: TEST_corrupt_scrub_replicated: jq .epoch td/osd-scrub-repair/json 2026-02-23T08:12:01.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1258: TEST_corrupt_scrub_replicated: epoch=181 2026-02-23T08:12:01.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1260: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-23T08:12:01.274 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:12:01.274 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:12:01.274 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:12:01.274 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:12:01.274 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1260: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-23T08:12:01.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1260: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:12:01.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2173: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-23T08:12:01.287 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:12:01.287 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:12:01.287 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2173: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-23T08:12:01.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2173: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:12:01.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2174: TEST_corrupt_scrub_replicated: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:12:01.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:12:01.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2175: TEST_corrupt_scrub_replicated: test no = yes 2026-02-23T08:12:01.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2180: TEST_corrupt_scrub_replicated: test '' = yes 2026-02-23T08:12:01.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2185: TEST_corrupt_scrub_replicated: objname=ROBJ9 2026-02-23T08:12:01.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2187: TEST_corrupt_scrub_replicated: echo -n ZZZ 2026-02-23T08:12:01.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2188: TEST_corrupt_scrub_replicated: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/change 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2190: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:12:01.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:01.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:01.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:01.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:12:01.732 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:12:01.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:12:01.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:01.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:01.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:01.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:12:01.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:12:01.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:12:01.795 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:01.793+0000 7fdcbf57f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:01.797 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:01.795+0000 7fdcbf57f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:01.797 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:01.796+0000 7fdcbf57f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:12:01.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:01.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:01.997 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:01.994+0000 7fdcbf57f780 -1 Falling back to public interface 2026-02-23T08:12:02.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:02.329 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:02.327+0000 7fdcbf57f780 -1 osd.0 184 log_to_monitors true 2026-02-23T08:12:03.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:03.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:03.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:03.115 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:12:03.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:03.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:03.279 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 187 up_thru 187 down_at 184 last_clean_interval [171,184) [v2:127.0.0.1:6800/932449044,v1:127.0.0.1:6801/932449044] [v2:127.0.0.1:6802/932449044,v1:127.0.0.1:6803/932449044] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:12:03.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:03.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:03.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:03.280 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:03.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:03.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:03.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:03.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:03.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:03.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:03.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:03.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:03.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:03.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:03.525 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:03.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:03.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:03.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:03.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=803158884354 2026-02-23T08:12:03.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 803158884354 2026-02-23T08:12:03.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-803158884354' 2026-02-23T08:12:03.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:03.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:03.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080582 2026-02-23T08:12:03.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080582 2026-02-23T08:12:03.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-803158884354 1-777389080582' 2026-02-23T08:12:03.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:03.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-803158884354 2026-02-23T08:12:03.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:03.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:03.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-803158884354 2026-02-23T08:12:03.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:03.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=803158884354 2026-02-23T08:12:03.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 803158884354' 2026-02-23T08:12:03.673 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 803158884354 2026-02-23T08:12:03.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:03.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407625 -lt 803158884354 2026-02-23T08:12:03.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:04.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:04.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:05.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 803158884354 -lt 803158884354 2026-02-23T08:12:05.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:05.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080582 2026-02-23T08:12:05.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:05.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:05.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080582 2026-02-23T08:12:05.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:05.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080582 2026-02-23T08:12:05.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080582' 2026-02-23T08:12:05.008 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 777389080582 2026-02-23T08:12:05.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:05.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080583 -lt 777389080582 2026-02-23T08:12:05.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:05.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:05.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:05.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:05.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:05.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:05.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:05.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:05.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:05.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:05.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:05.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:05.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2191: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/oi td/osd-scrub-repair/change 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:rm: cannot remove 'td/osd-scrub-repair/oi': No such file or directory 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2193: TEST_corrupt_scrub_replicated: objname=ROBJ10 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2194: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ10 get-attr _ 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ10 get-attr _ 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:12:05.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:05.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ10 get-attr _ 2026-02-23T08:12:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:12:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:12:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:12:06.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:12:06.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:06.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ10 get-attr _ 2026-02-23T08:12:06.111 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:12:06.111 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:06.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:06.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:06.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:12:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:12:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:12:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:12:06.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:12:06.183 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:06.181+0000 7fd8978c3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:06.185 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:06.183+0000 7fd8978c3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:06.185 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:06.184+0000 7fd8978c3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:06.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:06.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:06.344 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:06.343+0000 7fd8978c3780 -1 Falling back to public interface 2026-02-23T08:12:06.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:06.726 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:06.724+0000 7fd8978c3780 -1 osd.1 189 log_to_monitors true 2026-02-23T08:12:07.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:07.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:07.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:07.505 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:12:07.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:07.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:07.673 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 192 up_thru 192 down_at 189 last_clean_interval [181,189) [v2:127.0.0.1:6810/2116723144,v1:127.0.0.1:6811/2116723144] [v2:127.0.0.1:6812/2116723144,v1:127.0.0.1:6813/2116723144] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:12:07.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:07.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:07.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:07.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:07.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:07.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:07.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:07.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:07.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:07.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:07.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:07.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:07.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:07.920 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:07.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:07.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:07.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:07.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=803158884356 2026-02-23T08:12:07.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 803158884356 2026-02-23T08:12:07.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-803158884356' 2026-02-23T08:12:07.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:07.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:08.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=824633720834 2026-02-23T08:12:08.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 824633720834 2026-02-23T08:12:08.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-803158884356 1-824633720834' 2026-02-23T08:12:08.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:08.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-803158884356 2026-02-23T08:12:08.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:08.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:08.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-803158884356 2026-02-23T08:12:08.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:08.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=803158884356 2026-02-23T08:12:08.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 803158884356' 2026-02-23T08:12:08.071 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 803158884356 2026-02-23T08:12:08.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:08.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 803158884354 -lt 803158884356 2026-02-23T08:12:08.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:09.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:09.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:09.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 803158884356 -lt 803158884356 2026-02-23T08:12:09.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:09.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-824633720834 2026-02-23T08:12:09.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:09.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:09.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-824633720834 2026-02-23T08:12:09.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:09.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=824633720834 2026-02-23T08:12:09.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 824633720834' 2026-02-23T08:12:09.412 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 824633720834 2026-02-23T08:12:09.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:09.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 824633720834 -lt 824633720834 2026-02-23T08:12:09.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:09.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:09.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:09.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:09.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:09.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:09.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:09.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:09.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:09.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:09.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:09.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:09.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:09.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:09.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:10.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:10.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:10.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:10.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2195: TEST_corrupt_scrub_replicated: rados --pool csr_pool setomapval ROBJ10 key2-ROBJ10 val2-ROBJ10 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2196: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:12:10.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:10.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:10.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:10.603 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:12:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:12:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:12:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:12:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:10.665 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:10.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:10.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:10.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:12:10.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:12:10.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:12:10.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:12:10.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:12:10.678 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:10.676+0000 7fbc0ae1d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:10.680 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:10.678+0000 7fbc0ae1d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:10.680 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:10.678+0000 7fbc0ae1d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:10.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:12:10.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:10.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:10.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:10.862 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:10.859+0000 7fbc0ae1d780 -1 Falling back to public interface 2026-02-23T08:12:10.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:11.261 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:11.259+0000 7fbc0ae1d780 -1 osd.0 193 log_to_monitors true 2026-02-23T08:12:11.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:11.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:11.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:11.996 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:12:11.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:11.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:12.162 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 197 up_thru 197 down_at 194 last_clean_interval [187,193) [v2:127.0.0.1:6800/1714382214,v1:127.0.0.1:6801/1714382214] [v2:127.0.0.1:6802/1714382214,v1:127.0.0.1:6803/1714382214] exists,up 14bda8b5-a097-4f6a-ac51-88c3b9d21cfe 2026-02-23T08:12:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:12.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:12.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:12.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:12.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:12.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:12.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:12.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:12.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:12.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:12.410 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:12.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:12.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:12.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:12.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=846108557314 2026-02-23T08:12:12.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 846108557314 2026-02-23T08:12:12.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557314' 2026-02-23T08:12:12.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:12.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:12.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=824633720836 2026-02-23T08:12:12.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 824633720836 2026-02-23T08:12:12.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557314 1-824633720836' 2026-02-23T08:12:12.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:12.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-846108557314 2026-02-23T08:12:12.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:12.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:12.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-846108557314 2026-02-23T08:12:12.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:12.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=846108557314 2026-02-23T08:12:12.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 846108557314' 2026-02-23T08:12:12.560 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 846108557314 2026-02-23T08:12:12.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:12.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 846108557314 2026-02-23T08:12:12.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:13.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:13.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:13.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 846108557314 2026-02-23T08:12:13.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:14.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:12:14.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:15.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557314 -lt 846108557314 2026-02-23T08:12:15.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:15.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-824633720836 2026-02-23T08:12:15.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:15.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:15.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-824633720836 2026-02-23T08:12:15.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:15.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=824633720836 2026-02-23T08:12:15.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 824633720836' 2026-02-23T08:12:15.063 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 824633720836 2026-02-23T08:12:15.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:15.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 824633720836 -lt 824633720836 2026-02-23T08:12:15.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:15.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:15.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:15.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:15.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:15.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:15.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:15.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:15.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:15.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:15.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:15.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:15.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:15.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:15.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2197: TEST_corrupt_scrub_replicated: objectstore_tool td/osd-scrub-repair 1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:12:15.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:15.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:12:16.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:16.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ10 set-attr _ td/osd-scrub-repair/oi 2026-02-23T08:12:16.241 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:12:16.241 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:12:16.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:16.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:12:16.295 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:12:16.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:16.296 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:12:16.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:12:16.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:12:16.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:12:16.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:12:16.307 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:16.305+0000 7f6e64d54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:16.309 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:16.307+0000 7f6e64d54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:16.309 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:16.308+0000 7f6e64d54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:16.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:12:16.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:16.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:12:16.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:16.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:16.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:16.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:16.465 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:12:16.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:16.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:16.495 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:16.493+0000 7f6e64d54780 -1 Falling back to public interface 2026-02-23T08:12:16.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:16.845 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:16.843+0000 7f6e64d54780 -1 osd.1 198 log_to_monitors true 2026-02-23T08:12:17.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:17.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:17.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:17.628 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:12:17.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:17.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:17.794 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 202 up_thru 202 down_at 199 last_clean_interval [192,198) [v2:127.0.0.1:6810/1808014033,v1:127.0.0.1:6811/1808014033] [v2:127.0.0.1:6812/1808014033,v1:127.0.0.1:6813/1808014033] exists,up 0b156bf7-3918-47a2-afb7-92e9980bcd6f 2026-02-23T08:12:17.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:17.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:17.796 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:17.796 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:17.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:17.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:17.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:17.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:17.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:18.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:18.042 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:18.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:18.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:18.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:18.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=846108557316 2026-02-23T08:12:18.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 846108557316 2026-02-23T08:12:18.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557316' 2026-02-23T08:12:18.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:18.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:18.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=867583393794 2026-02-23T08:12:18.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 867583393794 2026-02-23T08:12:18.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557316 1-867583393794' 2026-02-23T08:12:18.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:18.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-846108557316 2026-02-23T08:12:18.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:18.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:18.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-846108557316 2026-02-23T08:12:18.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:18.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=846108557316 2026-02-23T08:12:18.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 846108557316' 2026-02-23T08:12:18.195 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 846108557316 2026-02-23T08:12:18.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:18.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557315 -lt 846108557316 2026-02-23T08:12:18.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:19.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:19.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:19.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557316 -lt 846108557316 2026-02-23T08:12:19.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:19.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-867583393794 2026-02-23T08:12:19.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:19.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:19.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-867583393794 2026-02-23T08:12:19.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:19.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=867583393794 2026-02-23T08:12:19.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 867583393794' 2026-02-23T08:12:19.529 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 867583393794 2026-02-23T08:12:19.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:19.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 867583393794 -lt 867583393794 2026-02-23T08:12:19.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:19.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:19.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:19.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:19.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:19.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:19.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:19.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:19.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:19.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:19.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:20.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:20.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:20.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:20.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:20.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:20.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:20.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:20.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2198: TEST_corrupt_scrub_replicated: rm td/osd-scrub-repair/oi 2026-02-23T08:12:20.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2200: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ11 td/osd-scrub-repair 0 2026-02-23T08:12:20.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:12:20.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:12:20.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ11 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ11 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:12:20.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ11 2026-02-23T08:12:20.273 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ11 2026-02-23T08:12:20.273 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:12:20.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-23T08:12:20.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:12:20.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:20.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:12:20.442 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:12:20.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:12:20.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:12:20.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:12:20.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.1.asok injectdataerr csr_pool ROBJ11 2026-02-23T08:12:20.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2201: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ12 td/osd-scrub-repair 1 2026-02-23T08:12:20.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:12:20.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:12:20.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-23T08:12:20.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ12 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ12 2026-02-23T08:12:20.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:12:20.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ12 2026-02-23T08:12:20.572 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ12 2026-02-23T08:12:20.572 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:12:20.736 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:12:20.736 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:12:20.736 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:12:20.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:12:20.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:12:20.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-23T08:12:20.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:12:20.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:12:20.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:12:20.739 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:20.740 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:20.740 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:20.740 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:12:20.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:12:20.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:12:20.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:12:20.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.0.asok injectmdataerr csr_pool ROBJ12 2026-02-23T08:12:20.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2202: TEST_corrupt_scrub_replicated: inject_eio rep mdata csr_pool ROBJ13 td/osd-scrub-repair 1 2026-02-23T08:12:20.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-23T08:12:20.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:12:20.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-23T08:12:20.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:12:20.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-23T08:12:20.867 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-23T08:12:20.867 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:12:21.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:12:21.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-23T08:12:21.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:12:21.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-23T08:12:21.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:12:21.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-23T08:12:21.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:12:21.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:12:21.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:12:21.035 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-23T08:12:21.035 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:12:21.035 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:12:21.036 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:21.036 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:21.036 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:21.036 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:12:21.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:12:21.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:12:21.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:12:21.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:12:21.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:12:21.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.0.asok injectmdataerr csr_pool ROBJ13 2026-02-23T08:12:21.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2203: TEST_corrupt_scrub_replicated: inject_eio rep data csr_pool ROBJ13 td/osd-scrub-repair 0 2026-02-23T08:12:21.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:12:21.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:12:21.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-23T08:12:21.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-23T08:12:21.164 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:12:21.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:12:21.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-23T08:12:21.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:12:21.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-23T08:12:21.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:12:21.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T08:12:21.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:12:21.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:12:21.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:12:21.331 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:12:21.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:12:21.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:12:21.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:12:21.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:21.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:12:21.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:12:21.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.1.asok injectdataerr csr_pool ROBJ13 2026-02-23T08:12:21.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2206: TEST_corrupt_scrub_replicated: ceph tell 'osd.*' injectargs -- --osd-max-object-size=134217728 2026-02-23T08:12:21.526 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: {} 2026-02-23T08:12:21.526 INFO:tasks.workunit.client.0.trial129.stderr:osd.0: osd_max_object_size = '' 2026-02-23T08:12:21.535 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: {} 2026-02-23T08:12:21.535 INFO:tasks.workunit.client.0.trial129.stderr:osd.1: osd_max_object_size = '' 2026-02-23T08:12:21.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2208: TEST_corrupt_scrub_replicated: pg_deep_scrub 3.0 2026-02-23T08:12:21.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:12:21.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:12:21.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:12:21.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:12:21.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:21.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:21.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:21.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:21.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:21.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:12:21.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:12:21.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:12:21.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:12:21.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:21.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:21.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:21.913 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:21.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:21.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:21.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:21.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=846108557318 2026-02-23T08:12:21.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 846108557318 2026-02-23T08:12:21.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557318' 2026-02-23T08:12:21.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:21.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:22.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=867583393796 2026-02-23T08:12:22.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 867583393796 2026-02-23T08:12:22.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557318 1-867583393796' 2026-02-23T08:12:22.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:22.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-846108557318 2026-02-23T08:12:22.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:22.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:22.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-846108557318 2026-02-23T08:12:22.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:22.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=846108557318 2026-02-23T08:12:22.063 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 846108557318 2026-02-23T08:12:22.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 846108557318' 2026-02-23T08:12:22.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:22.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557316 -lt 846108557318 2026-02-23T08:12:22.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:23.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:23.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:23.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557318 -lt 846108557318 2026-02-23T08:12:23.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:23.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-867583393796 2026-02-23T08:12:23.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:23.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:23.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-867583393796 2026-02-23T08:12:23.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:23.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=867583393796 2026-02-23T08:12:23.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 867583393796' 2026-02-23T08:12:23.402 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 867583393796 2026-02-23T08:12:23.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:23.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 867583393796 -lt 867583393796 2026-02-23T08:12:23.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:12:23.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:12:23.566 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:12:23.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:12:23.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:12:23.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:12:23.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:12:23.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:12:23.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:12:23.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:12:23.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:12:23.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:12:23.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:12:23.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:23.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:12:23.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:23.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:12:23.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:23.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:12:23.956 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-23T08:12:23.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:10:06.478141+0000 last_deep_scrub_stamp 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:23.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:12:23.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:23.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:12:24.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:24.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:25.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:25.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:25.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:12:25.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:25.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:12:25.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:25.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:12:25.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:25.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:26.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:26.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:26.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:12:26.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:26.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:12:26.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:26.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:12:26.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:26.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:27.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:27.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:27.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:12:27.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:27.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:12:27.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:27.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:12:27.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:10:06.478141+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:27.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:28.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:28.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:28.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:12:28.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:28.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:12:28.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:28.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:24.724677+0000 '>' 2026-02-23T08:10:06.478141+0000 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2210: TEST_corrupt_scrub_replicated: err_strings=() 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2211: TEST_corrupt_scrub_replicated: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2212: TEST_corrupt_scrub_replicated: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)], object info inconsistent ' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2213: TEST_corrupt_scrub_replicated: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)]' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2214: TEST_corrupt_scrub_replicated: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : failed to pick suitable auth object' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2215: TEST_corrupt_scrub_replicated: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2216: TEST_corrupt_scrub_replicated: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2217: TEST_corrupt_scrub_replicated: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2218: TEST_corrupt_scrub_replicated: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2219: TEST_corrupt_scrub_replicated: err_strings[8]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:87abbf36:::ROBJ11:head : candidate had a read error' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2220: TEST_corrupt_scrub_replicated: err_strings[9]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2221: TEST_corrupt_scrub_replicated: err_strings[10]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2222: TEST_corrupt_scrub_replicated: err_strings[11]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8aa5320e:::ROBJ17:head : failed to pick suitable auth object' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2223: TEST_corrupt_scrub_replicated: err_strings[12]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0xefced57a != omap_digest 0x6a73cc07 from shard 1' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2224: TEST_corrupt_scrub_replicated: err_strings[13]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0x6a73cc07 != omap_digest 0xefced57a from auth oi 3:8b55fa4b:::ROBJ7:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 21 dd 2ddbf8f5 od efced57a alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2225: TEST_corrupt_scrub_replicated: err_strings[14]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:a53c12e8:::ROBJ6:head : omap_digest 0x689ee887 != omap_digest 0x179c919f from shard 1, omap_digest 0x689ee887 != omap_digest 0x179c919f from auth oi 3:a53c12e8:::ROBJ6:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 18 dd 2ddbf8f5 od 179c919f alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2226: TEST_corrupt_scrub_replicated: err_strings[15]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2227: TEST_corrupt_scrub_replicated: err_strings[16]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2228: TEST_corrupt_scrub_replicated: err_strings[17]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:b1f19cbd:::ROBJ10:head : failed to pick suitable auth object' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2229: TEST_corrupt_scrub_replicated: err_strings[18]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2230: TEST_corrupt_scrub_replicated: err_strings[19]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2231: TEST_corrupt_scrub_replicated: err_strings[20]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2232: TEST_corrupt_scrub_replicated: err_strings[21]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2233: TEST_corrupt_scrub_replicated: err_strings[22]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2234: TEST_corrupt_scrub_replicated: err_strings[23]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from shard 0, data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2235: TEST_corrupt_scrub_replicated: err_strings[24]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:d60617f9:::ROBJ13:head : candidate had a read error' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2236: TEST_corrupt_scrub_replicated: err_strings[25]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2237: TEST_corrupt_scrub_replicated: err_strings[26]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:d60617f9:::ROBJ13:head : failed to pick suitable object info' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2238: TEST_corrupt_scrub_replicated: err_strings[27]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:e97ce31e:::ROBJ2:head : data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from shard 1, data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from auth oi 3:e97ce31e:::ROBJ2:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 6 dd 2ddbf8f5 od f8e11918 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2239: TEST_corrupt_scrub_replicated: err_strings[28]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2240: TEST_corrupt_scrub_replicated: err_strings[29]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:f4981d31:::ROBJ4:head : omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from shard 1, omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from auth oi 3:f4981d31:::ROBJ4:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 12 dd 2ddbf8f5 od e2d46ea4 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2241: TEST_corrupt_scrub_replicated: err_strings[30]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x1a862a41 != omap_digest 0x6cac8f6 from shard 1' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2242: TEST_corrupt_scrub_replicated: err_strings[31]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x6cac8f6 != omap_digest 0x1a862a41 from auth oi 3:f4bfd4d1:::ROBJ5:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 15 dd 2ddbf8f5 od 1a862a41 alloc_hint [[]0 0 0[]][)]' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2243: TEST_corrupt_scrub_replicated: err_strings[32]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : candidate size 3 info size 7 mismatch' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2244: TEST_corrupt_scrub_replicated: err_strings[33]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2245: TEST_corrupt_scrub_replicated: err_strings[34]='log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' 2026-02-23T08:12:28.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2246: TEST_corrupt_scrub_replicated: err_strings[35]='log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' 2026-02-23T08:12:28.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2247: TEST_corrupt_scrub_replicated: err_strings[36]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049715/1049716 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' 2026-02-23T08:12:28.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2248: TEST_corrupt_scrub_replicated: err_strings[37]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 1 missing, 11 inconsistent objects' 2026-02-23T08:12:28.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2249: TEST_corrupt_scrub_replicated: err_strings[38]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 35 errors' 2026-02-23T08:12:28.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:30259878:::ROBJ15:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)], object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:33aca486:::ROBJ18:head : data_digest 0xbd89c912 != data_digest 0x2ddbf8f5 from auth oi 3:33aca486:::ROBJ18:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 54 dd 2ddbf8f5 od ddc3680f alloc_hint [[]0 0 255[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:33aca486:::ROBJ18:head : failed to pick suitable auth object' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:5c7b2c47:::ROBJ16:head : candidate had a corrupt snapset' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:5c7b2c47:::ROBJ16:head : candidate had a missing snapset key' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:5c7b2c47:::ROBJ16:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:86586531:::ROBJ8:head : attr value mismatch '\''_key1-ROBJ8'\'', attr name mismatch '\''_key3-ROBJ8'\'', attr name mismatch '\''_key2-ROBJ8'\''' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:87abbf36:::ROBJ11:head : candidate had a read error' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8aa5320e:::ROBJ17:head : data_digest 0x5af0c3ef != data_digest 0x2ddbf8f5 from auth oi 3:8aa5320e:::ROBJ17:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 51 dd 2ddbf8f5 od e9572720 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8aa5320e:::ROBJ17:head : failed to pick suitable auth object' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0xefced57a != omap_digest 0x6a73cc07 from shard 1' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:8b55fa4b:::ROBJ7:head : omap_digest 0x6a73cc07 != omap_digest 0xefced57a from auth oi 3:8b55fa4b:::ROBJ7:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 21 dd 2ddbf8f5 od efced57a alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:a53c12e8:::ROBJ6:head : omap_digest 0x689ee887 != omap_digest 0x179c919f from shard 1, omap_digest 0x689ee887 != omap_digest 0x179c919f from auth oi 3:a53c12e8:::ROBJ6:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 18 dd 2ddbf8f5 od 179c919f alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:b1f19cbd:::ROBJ10:head : omap_digest 0xa8dd5adc != omap_digest 0xc2025a24 from auth oi 3:b1f19cbd:::ROBJ10:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 30 dd 2ddbf8f5 od c2025a24 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:b1f19cbd:::ROBJ10:head : failed to pick suitable auth object' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:bc819597:::ROBJ12:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:c0c86b1d:::ROBJ14:head : candidate had a missing info key' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:c0c86b1d:::ROBJ14:head : candidate had a corrupt info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:c0c86b1d:::ROBJ14:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : candidate size 9 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:ce3f1d6a:::ROBJ1:head : data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from shard 0, data_digest 0x2d4a11c2 != data_digest 0x2ddbf8f5 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from auth oi 3:ce3f1d6a:::ROBJ1:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 3 dd 2ddbf8f5 od f5fba2c6 alloc_hint [[]0 0 0[]][)], size 9 != size 7 from shard 0' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:d60617f9:::ROBJ13:head : candidate had a read error' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:d60617f9:::ROBJ13:head : candidate had a stat error' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:d60617f9:::ROBJ13:head : failed to pick suitable object info' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:e97ce31e:::ROBJ2:head : data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from shard 1, data_digest 0x578a4830 != data_digest 0x2ddbf8f5 from auth oi 3:e97ce31e:::ROBJ2:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 6 dd 2ddbf8f5 od f8e11918 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 3:f2a5b2a4:::ROBJ3:head : missing' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:f4981d31:::ROBJ4:head : omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from shard 1, omap_digest 0xd7178dfe != omap_digest 0xe2d46ea4 from auth oi 3:f4981d31:::ROBJ4:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 12 dd 2ddbf8f5 od e2d46ea4 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x1a862a41 != omap_digest 0x6cac8f6 from shard 1' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 1 soid 3:f4bfd4d1:::ROBJ5:head : omap_digest 0x6cac8f6 != omap_digest 0x1a862a41 from auth oi 3:f4bfd4d1:::ROBJ5:head[(][0-9]*'\''[0-9]* osd.1.0:[0-9]* dirty|omap|data_digest|omap_digest s 7 uv 15 dd 2ddbf8f5 od 1a862a41 alloc_hint [[]0 0 0[]][)]' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : candidate size 3 info size 7 mismatch' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:28.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:28.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard 0 soid 3:ffdb2004:::ROBJ9:head : object info inconsistent ' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:29.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:29.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:c0c86b1d:::ROBJ14:head : no '\''_'\'' attr' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:29.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:29.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : deep-scrub [0-9]*[.]0 3:5c7b2c47:::ROBJ16:head : can'\''t decode '\''snapset'\'' attr .* v=3 cannot decode .* Malformed input' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:29.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:29.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub : stat mismatch, got 19/19 objects, 0/0 clones, 18/19 dirty, 18/19 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 1049715/1049716 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:29.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:29.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 1 missing, 11 inconsistent objects' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:29.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2251: TEST_corrupt_scrub_replicated: for err_string in "${err_strings[@]}" 2026-02-23T08:12:29.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2253: TEST_corrupt_scrub_replicated: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 deep-scrub 35 errors' td/osd-scrub-repair/osd.1.log 2026-02-23T08:12:29.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2260: TEST_corrupt_scrub_replicated: rados list-inconsistent-pg csr_pool 2026-02-23T08:12:29.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2262: TEST_corrupt_scrub_replicated: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:12:29.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2262: TEST_corrupt_scrub_replicated: test 1 = 1 2026-02-23T08:12:29.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2264: TEST_corrupt_scrub_replicated: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:12:29.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2264: TEST_corrupt_scrub_replicated: test 3.0 = 3.0 2026-02-23T08:12:29.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2266: TEST_corrupt_scrub_replicated: rados list-inconsistent-obj 3.0 2026-02-23T08:12:29.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2268: TEST_corrupt_scrub_replicated: jq .epoch td/osd-scrub-repair/json 2026-02-23T08:12:29.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2268: TEST_corrupt_scrub_replicated: epoch=202 2026-02-23T08:12:29.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2270: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-23T08:12:29.071 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:12:29.071 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:12:29.071 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:12:29.071 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:12:29.071 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2270: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-23T08:12:29.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:2270: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:12:29.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3698: TEST_corrupt_scrub_replicated: jq 'def walk(f): 2026-02-23T08:12:29.085 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:12:29.085 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3698: TEST_corrupt_scrub_replicated: jq .inconsistents 2026-02-23T08:12:29.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3698: TEST_corrupt_scrub_replicated: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:12:29.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3699: TEST_corrupt_scrub_replicated: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:12:29.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:12:29.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3700: TEST_corrupt_scrub_replicated: test no = yes 2026-02-23T08:12:29.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3705: TEST_corrupt_scrub_replicated: test '' = yes 2026-02-23T08:12:29.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3710: TEST_corrupt_scrub_replicated: repair 3.0 2026-02-23T08:12:29.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=3.0 2026-02-23T08:12:29.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 3.0 2026-02-23T08:12:29.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:29.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:12:29.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:29.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:12:29.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:29.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 3.0 2026-02-23T08:12:29.421 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to repair 2026-02-23T08:12:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 3.0 2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:29.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:29.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:12:29.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:24.724677+0000 '>' 2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:29.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:30.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:30.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:30.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:12:30.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:30.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:12:30.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:30.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:12:30.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:24.724677+0000 '>' 2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:30.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:31.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:31.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:31.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:12:31.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:31.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:12:31.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:31.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:12:31.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:24.724677+0000 '>' 2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:31.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:12:32.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:12:32.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:12:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:12:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:12:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:12:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:12:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:30.828726+0000 '>' 2026-02-23T08:12:24.724677+0000 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3711: TEST_corrupt_scrub_replicated: wait_for_clean 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:33.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:33.108 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:33.108 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:33.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:33.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:33.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:33.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:33.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:33.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:33.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:33.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:33.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:33.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:33.356 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:33.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:33.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:33.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:33.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=846108557321 2026-02-23T08:12:33.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 846108557321 2026-02-23T08:12:33.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557321' 2026-02-23T08:12:33.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:33.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=867583393799 2026-02-23T08:12:33.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 867583393799 2026-02-23T08:12:33.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-846108557321 1-867583393799' 2026-02-23T08:12:33.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:33.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-846108557321 2026-02-23T08:12:33.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:33.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:33.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-846108557321 2026-02-23T08:12:33.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:33.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=846108557321 2026-02-23T08:12:33.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 846108557321' 2026-02-23T08:12:33.509 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 846108557321 2026-02-23T08:12:33.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:33.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557320 -lt 846108557321 2026-02-23T08:12:33.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:34.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:34.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:34.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 846108557321 -lt 846108557321 2026-02-23T08:12:34.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:34.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-867583393799 2026-02-23T08:12:34.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:34.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:34.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-867583393799 2026-02-23T08:12:34.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:34.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=867583393799 2026-02-23T08:12:34.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 867583393799' 2026-02-23T08:12:34.847 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 867583393799 2026-02-23T08:12:34.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:35.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 867583393799 -lt 867583393799 2026-02-23T08:12:35.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:35.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:35.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:35.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:35.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:35.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:35.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:35.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:35.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3714: TEST_corrupt_scrub_replicated: timeout 30 rados -p csr_pool get ROBJ17 td/osd-scrub-repair/robj17.out 2026-02-23T08:12:35.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3715: TEST_corrupt_scrub_replicated: timeout 30 rados -p csr_pool get ROBJ18 td/osd-scrub-repair/robj18.out 2026-02-23T08:12:35.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3717: TEST_corrupt_scrub_replicated: diff -q td/osd-scrub-repair/new.ROBJ17 td/osd-scrub-repair/robj17.out 2026-02-23T08:12:35.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3718: TEST_corrupt_scrub_replicated: rm -f td/osd-scrub-repair/new.ROBJ17 td/osd-scrub-repair/robj17.out 2026-02-23T08:12:35.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3719: TEST_corrupt_scrub_replicated: diff -q td/osd-scrub-repair/new.ROBJ18 td/osd-scrub-repair/robj18.out 2026-02-23T08:12:35.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3720: TEST_corrupt_scrub_replicated: rm -f td/osd-scrub-repair/new.ROBJ18 td/osd-scrub-repair/robj18.out 2026-02-23T08:12:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3722: TEST_corrupt_scrub_replicated: '[' 0 '!=' 0 ']' 2026-02-23T08:12:35.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:3728: TEST_corrupt_scrub_replicated: ceph osd pool rm csr_pool csr_pool --yes-i-really-really-mean-it 2026-02-23T08:12:35.833 INFO:tasks.workunit.client.0.trial129.stderr:pool 'csr_pool' removed 2026-02-23T08:12:35.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:12:35.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:12:35.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:12:35.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:12:35.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:35.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:35.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:35.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:35.955 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:12:35.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:12:35.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:12:35.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:12:35.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:12:35.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:12:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:12:35.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:12:35.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:12:35.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:12:35.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:12:35.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:12:35.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:12:35.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:12:35.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:35.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:35.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:35.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:35.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:35.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:35.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:35.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:12:35.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:12:35.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:12:35.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:12:35.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:12:35.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:12:36.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:12:36.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:12:36.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:12:36.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:12:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:12:36.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:12:36.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:12:36.003 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:12:36.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:12:36.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:12:36.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:12:36.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:12:36.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:12:36.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.006 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:12:36.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_corrupt_snapset_scrub_rep td/osd-scrub-repair 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6100: TEST_corrupt_snapset_scrub_rep: local dir=td/osd-scrub-repair 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6101: TEST_corrupt_snapset_scrub_rep: local poolname=csr_pool 2026-02-23T08:12:36.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6102: TEST_corrupt_snapset_scrub_rep: local total_objs=2 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6104: TEST_corrupt_snapset_scrub_rep: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:12:36.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:36.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:12:36.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:12:36.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:12:36.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:12:36.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:12:36.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:12:36.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:12:36.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:12:36.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:12:36.113 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.114 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.114 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:12:36.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:12:36.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:12:36.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6105: TEST_corrupt_snapset_scrub_rep: run_mgr td/osd-scrub-repair x 2026-02-23T08:12:36.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:12:36.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:12:36.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:12:36.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:12:36.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:12:36.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:12:36.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:12:36.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:36.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:36.270 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:36.270 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.270 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:36.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:12:36.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:12:36.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6106: TEST_corrupt_snapset_scrub_rep: run_osd td/osd-scrub-repair 0 2026-02-23T08:12:36.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:12:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:12:36.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:12:36.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:12:36.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0acfe0cc-18a0-4bd4-a712-7eb322da39ce 2026-02-23T08:12:36.292 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 0acfe0cc-18a0-4bd4-a712-7eb322da39ce 2026-02-23T08:12:36.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0acfe0cc-18a0-4bd4-a712-7eb322da39ce' 2026-02-23T08:12:36.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:12:36.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD0C5xpjxKyERAAQgpQpy88355zOJrzZ0WdnA== 2026-02-23T08:12:36.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD0C5xpjxKyERAAQgpQpy88355zOJrzZ0WdnA=="}' 2026-02-23T08:12:36.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0acfe0cc-18a0-4bd4-a712-7eb322da39ce -i td/osd-scrub-repair/0/new.json 2026-02-23T08:12:36.385 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:12:36.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:12:36.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD0C5xpjxKyERAAQgpQpy88355zOJrzZ0WdnA== --osd-uuid 0acfe0cc-18a0-4bd4-a712-7eb322da39ce 2026-02-23T08:12:36.410 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.408+0000 7fdd2c60f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:36.412 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.410+0000 7fdd2c60f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:36.412 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.410+0000 7fdd2c60f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:36.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.411+0000 7fdd2c60f780 -1 bdev(0x557780891400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:12:36.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.411+0000 7fdd2c60f780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:12:36.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:12:36.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:12:36.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:12:36.863 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:12:36.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:12:36.959 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:12:36.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:12:36.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:36.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:12:36.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:12:36.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:12:36.971 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.969+0000 7f6d46812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:36.973 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.971+0000 7f6d46812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:36.973 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:36.971+0000 7f6d46812780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:37.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:37.055 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:12:37.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:37.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:37.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:37.171 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:37.169+0000 7f6d46812780 -1 Falling back to public interface 2026-02-23T08:12:37.558 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:37.556+0000 7f6d46812780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:12:38.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:38.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:38.147 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:12:38.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:38.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:38.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:38.238 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1582415435,v1:127.0.0.1:6801/1582415435] [v2:127.0.0.1:6802/1582415435,v1:127.0.0.1:6803/1582415435] exists,up 0acfe0cc-18a0-4bd4-a712-7eb322da39ce 2026-02-23T08:12:38.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:38.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:38.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:38.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6107: TEST_corrupt_snapset_scrub_rep: run_osd td/osd-scrub-repair 1 2026-02-23T08:12:38.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:38.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:12:38.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:38.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:12:38.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eeba17bb-44ce-48f0-bb92-e01d91804af0 2026-02-23T08:12:38.247 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 eeba17bb-44ce-48f0-bb92-e01d91804af0 2026-02-23T08:12:38.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 eeba17bb-44ce-48f0-bb92-e01d91804af0' 2026-02-23T08:12:38.247 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:12:38.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD2C5xpn931DhAABM3eF3++q19yqB+t+eISPg== 2026-02-23T08:12:38.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD2C5xpn931DhAABM3eF3++q19yqB+t+eISPg=="}' 2026-02-23T08:12:38.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eeba17bb-44ce-48f0-bb92-e01d91804af0 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:12:38.340 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:12:38.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:12:38.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD2C5xpn931DhAABM3eF3++q19yqB+t+eISPg== --osd-uuid eeba17bb-44ce-48f0-bb92-e01d91804af0 2026-02-23T08:12:38.362 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:38.360+0000 7f7d9740c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:38.363 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:38.361+0000 7f7d9740c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:38.364 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:38.362+0000 7f7d9740c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:38.364 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:38.362+0000 7f7d9740c780 -1 bdev(0x555a99bb1400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:12:38.365 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:38.362+0000 7f7d9740c780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:12:38.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:12:38.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:12:38.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:12:38.797 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:12:38.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:12:39.003 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:12:39.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:12:39.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:39.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:12:39.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:12:39.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:12:39.016 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:39.014+0000 7f5e2a14f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:39.017 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:39.015+0000 7f5e2a14f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:39.018 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:39.016+0000 7f5e2a14f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:39.167 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:12:39.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:39.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:39.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:39.248+0000 7f5e2a14f780 -1 Falling back to public interface 2026-02-23T08:12:39.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:39.585 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:39.583+0000 7f5e2a14f780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:12:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:40.329 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:12:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:40.496 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1812971474,v1:127.0.0.1:6811/1812971474] [v2:127.0.0.1:6812/1812971474,v1:127.0.0.1:6813/1812971474] exists,up eeba17bb-44ce-48f0-bb92-e01d91804af0 2026-02-23T08:12:40.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:40.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:40.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:40.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6108: TEST_corrupt_snapset_scrub_rep: create_rbd_pool 2026-02-23T08:12:40.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:12:40.650 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:12:40.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:12:40.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:12:40.871 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:12:40.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:12:41.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:12:42.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6109: TEST_corrupt_snapset_scrub_rep: wait_for_clean 2026-02-23T08:12:42.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:42.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:42.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:42.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:42.165 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:42.165 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:42.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:42.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:42.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:42.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:42.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:42.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:42.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:42.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:42.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:42.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:42.412 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:42.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:42.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:42.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:42.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:12:42.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:12:42.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:12:42.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:42.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:42.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-23T08:12:42.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-23T08:12:42.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705666' 2026-02-23T08:12:42.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:42.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:12:42.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:42.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:42.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:12:42.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:42.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:12:42.562 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:12:42.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:12:42.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:42.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:12:42.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:43.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:43.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:43.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:12:43.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:44.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:12:44.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:45.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-23T08:12:45.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:45.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-23T08:12:45.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:45.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:45.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-23T08:12:45.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:45.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-23T08:12:45.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-23T08:12:45.066 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705666 2026-02-23T08:12:45.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:45.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705666 -lt 38654705666 2026-02-23T08:12:45.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:45.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:45.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:45.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:12:45.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:45.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:45.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:45.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:45.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:45.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:45.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:45.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:12:45.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:45.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:45.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:45.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:12:45.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:45.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:45.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6111: TEST_corrupt_snapset_scrub_rep: create_pool foo 1 2026-02-23T08:12:45.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-23T08:12:46.017 INFO:tasks.workunit.client.0.trial129.stderr:pool 'foo' created 2026-02-23T08:12:46.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:12:47.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6112: TEST_corrupt_snapset_scrub_rep: create_pool csr_pool 1 1 2026-02-23T08:12:47.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create csr_pool 1 1 2026-02-23T08:12:47.244 INFO:tasks.workunit.client.0.trial129.stderr:pool 'csr_pool' created 2026-02-23T08:12:47.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:12:48.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6113: TEST_corrupt_snapset_scrub_rep: wait_for_clean 2026-02-23T08:12:48.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:48.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:48.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:48.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:48.258 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:48.258 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:48.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:48.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:48.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:48.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:48.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:48.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:48.508 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:48.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:48.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:48.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:48.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:12:48.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:12:48.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:12:48.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:48.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:48.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T08:12:48.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T08:12:48.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-23T08:12:48.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:48.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:12:48.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:48.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:48.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:12:48.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:48.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:12:48.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:12:48.658 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:12:48.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:48.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-23T08:12:48.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:49.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:49.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:49.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-23T08:12:49.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:50.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:12:50.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:51.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:12:51.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:51.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T08:12:51.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:51.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:51.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T08:12:51.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:51.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T08:12:51.166 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T08:12:51.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T08:12:51.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:51.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-23T08:12:51.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:51.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:51.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:51.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:51.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:51.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:51.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:51.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:51.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:51.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:51.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:51.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:51.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:51.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6115: TEST_corrupt_snapset_scrub_rep: seq 1 2 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6115: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6116: TEST_corrupt_snapset_scrub_rep: objname=ROBJ1 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6117: TEST_corrupt_snapset_scrub_rep: add_something td/osd-scrub-repair csr_pool ROBJ1 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ1 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:12:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:12:52.112 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:12:52.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:12:52.316 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:12:52.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:12:52.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:12:52.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:12:52.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6119: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapheader ROBJ1 hdr-ROBJ1 2026-02-23T08:12:52.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6120: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapval ROBJ1 key-ROBJ1 val-ROBJ1 2026-02-23T08:12:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6115: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-23T08:12:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6116: TEST_corrupt_snapset_scrub_rep: objname=ROBJ2 2026-02-23T08:12:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6117: TEST_corrupt_snapset_scrub_rep: add_something td/osd-scrub-repair csr_pool ROBJ2 2026-02-23T08:12:52.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:12:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:12:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ2 2026-02-23T08:12:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:12:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:12:52.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:12:52.579 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:12:52.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:12:52.783 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:12:52.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:12:52.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:12:52.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:12:52.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6119: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapheader ROBJ2 hdr-ROBJ2 2026-02-23T08:12:52.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6120: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool setomapval ROBJ2 key-ROBJ2 val-ROBJ2 2026-02-23T08:12:52.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6123: TEST_corrupt_snapset_scrub_rep: get_pg csr_pool ROBJ0 2026-02-23T08:12:52.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-23T08:12:52.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-23T08:12:52.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:12:52.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:12:53.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6123: TEST_corrupt_snapset_scrub_rep: local pg=3.0 2026-02-23T08:12:53.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6124: TEST_corrupt_snapset_scrub_rep: get_primary csr_pool ROBJ0 2026-02-23T08:12:53.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=csr_pool 2026-02-23T08:12:53.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=ROBJ0 2026-02-23T08:12:53.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:12:53.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:12:53.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6124: TEST_corrupt_snapset_scrub_rep: local primary=1 2026-02-23T08:12:53.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6126: TEST_corrupt_snapset_scrub_rep: rados -p csr_pool mksnap snap1 2026-02-23T08:12:53.237 INFO:tasks.workunit.client.0.trial129.stdout:created pool csr_pool snap snap1 2026-02-23T08:12:53.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6127: TEST_corrupt_snapset_scrub_rep: echo -n head_of_snapshot_data 2026-02-23T08:12:53.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6129: TEST_corrupt_snapset_scrub_rep: seq 1 2 2026-02-23T08:12:53.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6129: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-23T08:12:53.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6130: TEST_corrupt_snapset_scrub_rep: objname=ROBJ1 2026-02-23T08:12:53.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: expr 1 % 2 2026-02-23T08:12:53.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: local osd=1 2026-02-23T08:12:53.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6135: TEST_corrupt_snapset_scrub_rep: case $i in 2026-02-23T08:12:53.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6137: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/change 2026-02-23T08:12:53.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6138: TEST_corrupt_snapset_scrub_rep: objectstore_tool td/osd-scrub-repair 1 --head ROBJ1 clear-snapset corrupt 2026-02-23T08:12:53.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:12:53.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:12:53.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:12:53.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 --head ROBJ1 clear-snapset corrupt 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 --head ROBJ1 clear-snapset corrupt 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:53.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 --head ROBJ1 clear-snapset corrupt 2026-02-23T08:12:53.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:53.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:53.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:53.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:12:53.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:12:53.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:12:53.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:12:53.747 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:12:53.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:53.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:12:53.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:12:53.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:12:53.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:12:53.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:12:53.758 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:53.756+0000 7fcef7552780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:53.759 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:53.757+0000 7fcef7552780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:53.760 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:53.758+0000 7fcef7552780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:53.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:53.974 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:53.972+0000 7fcef7552780 -1 Falling back to public interface 2026-02-23T08:12:54.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:54.248 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:54.246+0000 7fcef7552780 -1 osd.1 27 log_to_monitors true 2026-02-23T08:12:55.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:55.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:55.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:55.077 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:12:55.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:55.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:12:55.243 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 31 up_thru 31 down_at 28 last_clean_interval [9,27) [v2:127.0.0.1:6810/3997878945,v1:127.0.0.1:6811/3997878945] [v2:127.0.0.1:6812/3997878945,v1:127.0.0.1:6813/3997878945] exists,up eeba17bb-44ce-48f0-bb92-e01d91804af0 2026-02-23T08:12:55.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:55.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:55.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:55.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:12:55.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:55.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:55.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:55.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:55.244 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:55.244 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:55.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:55.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:55.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:55.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:55.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:55.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:55.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:55.490 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:55.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:55.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:55.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:12:55.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:12:55.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:12:55.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:12:55.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:55.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:12:55.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-23T08:12:55.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-23T08:12:55.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-133143986178' 2026-02-23T08:12:55.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:55.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:12:55.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:55.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:12:55.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:12:55.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:55.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:12:55.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:12:55.641 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T08:12:55.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:55.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:12:55.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:12:56.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:12:56.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:12:56.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:12:56.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:12:56.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-133143986178 2026-02-23T08:12:56.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:12:56.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:12:56.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-133143986178 2026-02-23T08:12:56.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:12:56.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-23T08:12:56.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 133143986178' 2026-02-23T08:12:56.976 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 133143986178 2026-02-23T08:12:56.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:12:57.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986178 -lt 133143986178 2026-02-23T08:12:57.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:12:57.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:57.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:12:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:12:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:12:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:12:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:12:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:12:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:12:57.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:12:57.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:12:57.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:12:57.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:12:57.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:12:57.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:12:57.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:12:57.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:12:57.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6129: TEST_corrupt_snapset_scrub_rep: for i in $(seq 1 $total_objs) 2026-02-23T08:12:57.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6130: TEST_corrupt_snapset_scrub_rep: objname=ROBJ2 2026-02-23T08:12:57.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: expr 2 % 2 2026-02-23T08:12:57.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6133: TEST_corrupt_snapset_scrub_rep: local osd=0 2026-02-23T08:12:57.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6135: TEST_corrupt_snapset_scrub_rep: case $i in 2026-02-23T08:12:57.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6142: TEST_corrupt_snapset_scrub_rep: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/change 2026-02-23T08:12:57.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6143: TEST_corrupt_snapset_scrub_rep: objectstore_tool td/osd-scrub-repair 0 --head ROBJ2 clear-snapset corrupt 2026-02-23T08:12:57.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 --head ROBJ2 clear-snapset corrupt 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:12:57.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:12:57.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:12:57.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 --head ROBJ2 clear-snapset corrupt 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:58.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 --head ROBJ2 clear-snapset corrupt 2026-02-23T08:12:58.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:12:58.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:12:58.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:12:58.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:12:58.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:12:58.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:12:58.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:12:58.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:12:58.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:12:58.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:12:58.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:12:58.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:12:58.220 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:58.218+0000 7fe906011780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:58.221 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:58.219+0000 7fe906011780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:58.222 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:58.220+0000 7fe906011780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:12:58.374 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:12:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:58.412 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:58.409+0000 7fe906011780 -1 Falling back to public interface 2026-02-23T08:12:58.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:12:58.774 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:12:58.772+0000 7fe906011780 -1 osd.0 33 log_to_monitors true 2026-02-23T08:12:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:12:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:12:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:12:59.538 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:12:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:12:59.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:12:59.705 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 37 up_thru 37 down_at 34 last_clean_interval [5,33) [v2:127.0.0.1:6800/635494101,v1:127.0.0.1:6801/635494101] [v2:127.0.0.1:6802/635494101,v1:127.0.0.1:6803/635494101] exists,up 0acfe0cc-18a0-4bd4-a712-7eb322da39ce 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:12:59.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:12:59.707 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:12:59.707 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:12:59.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:12:59.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:12:59.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:12:59.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:12:59.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:12:59.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:12:59.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:12:59.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:12:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:12:59.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:12:59.959 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:12:59.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:12:59.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:12:59.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:00.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789954 2026-02-23T08:13:00.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789954 2026-02-23T08:13:00.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789954' 2026-02-23T08:13:00.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:00.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-23T08:13:00.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-23T08:13:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789954 1-133143986180' 2026-02-23T08:13:00.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:00.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-158913789954 2026-02-23T08:13:00.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:00.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:00.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-158913789954 2026-02-23T08:13:00.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:00.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789954 2026-02-23T08:13:00.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 158913789954' 2026-02-23T08:13:00.112 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 158913789954 2026-02-23T08:13:00.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:00.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 158913789954 2026-02-23T08:13:00.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:01.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:01.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:01.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789954 -lt 158913789954 2026-02-23T08:13:01.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:01.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-133143986180 2026-02-23T08:13:01.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:01.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:01.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-133143986180 2026-02-23T08:13:01.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:01.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986180 2026-02-23T08:13:01.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 133143986180' 2026-02-23T08:13:01.453 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 133143986180 2026-02-23T08:13:01.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:01.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986180 2026-02-23T08:13:01.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:01.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:01.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:01.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:01.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:13:02.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:02.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:02.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:13:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6148: TEST_corrupt_snapset_scrub_rep: rm td/osd-scrub-repair/change 2026-02-23T08:13:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6150: TEST_corrupt_snapset_scrub_rep: pg_scrub 3.0 2026-02-23T08:13:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:13:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:13:02.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:13:02.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:13:02.209 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:02.209 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:02.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:02.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:02.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:02.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:13:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:13:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:13:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:13:02.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:02.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:02.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:02.577 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:02.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:02.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:02.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:02.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-23T08:13:02.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-23T08:13:02.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789955' 2026-02-23T08:13:02.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:02.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:02.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986181 2026-02-23T08:13:02.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986181 2026-02-23T08:13:02.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-158913789955 1-133143986181' 2026-02-23T08:13:02.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:02.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-158913789955 2026-02-23T08:13:02.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:02.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:02.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-158913789955 2026-02-23T08:13:02.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:02.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-23T08:13:02.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 158913789955' 2026-02-23T08:13:02.726 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 158913789955 2026-02-23T08:13:02.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:02.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789954 -lt 158913789955 2026-02-23T08:13:02.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:03.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:03.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:04.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789954 -lt 158913789955 2026-02-23T08:13:04.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:05.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:13:05.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:05.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789955 2026-02-23T08:13:05.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:05.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-133143986181 2026-02-23T08:13:05.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:05.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:05.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-133143986181 2026-02-23T08:13:05.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:05.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986181 2026-02-23T08:13:05.242 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 133143986181 2026-02-23T08:13:05.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 133143986181' 2026-02-23T08:13:05.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:05.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986181 -lt 133143986181 2026-02-23T08:13:05.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:13:05.407 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:13:05.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:13:05.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:13:05.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:13:05.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:13:05.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:13:05.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:13:05.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:05.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:13:05.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:05.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:13:05.797 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-23T08:13:05.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:05.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:13:05.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:05.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:13:05.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:13:05.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:05.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:13:05.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:05.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:13:05.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:05.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:13:05.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:47.242644+0000 '>' 2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:05.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:13:06.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:13:06.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:06.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:13:06.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:06.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:13:06.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:06.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:13:07.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:47.242644+0000 '>' 2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:07.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:13:08.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:13:08.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:08.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:13:08.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:08.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:13:08.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:08.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:13:08.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:47.242644+0000 '>' 2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:08.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:13:09.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:13:09.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:09.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:13:09.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:09.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:13:09.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:09.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:13:09.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:12:47.242644+0000 '>' 2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:09.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:13:10.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:13:10.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:10.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:13:10.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:10.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:13:10.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:10.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:13:10.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:06.392315+0000 '>' 2026-02-23T08:12:47.242644+0000 2026-02-23T08:13:10.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:13:10.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6152: TEST_corrupt_snapset_scrub_rep: rados list-inconsistent-pg csr_pool 2026-02-23T08:13:10.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6154: TEST_corrupt_snapset_scrub_rep: jq '. | length' td/osd-scrub-repair/json 2026-02-23T08:13:10.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6154: TEST_corrupt_snapset_scrub_rep: test 1 = 1 2026-02-23T08:13:10.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6156: TEST_corrupt_snapset_scrub_rep: jq -r '.[0]' td/osd-scrub-repair/json 2026-02-23T08:13:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6156: TEST_corrupt_snapset_scrub_rep: test 3.0 = 3.0 2026-02-23T08:13:10.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6158: TEST_corrupt_snapset_scrub_rep: rados list-inconsistent-obj 3.0 2026-02-23T08:13:10.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6160: TEST_corrupt_snapset_scrub_rep: jq 'def walk(f): 2026-02-23T08:13:10.680 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:13:10.680 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:13:10.680 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6160: TEST_corrupt_snapset_scrub_rep: jq .inconsistents 2026-02-23T08:13:10.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6160: TEST_corrupt_snapset_scrub_rep: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:13:10.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6329: TEST_corrupt_snapset_scrub_rep: jq 'def walk(f): 2026-02-23T08:13:10.693 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:13:10.693 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:13:10.693 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:13:10.693 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' td/osd-scrub-repair/json 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6329: TEST_corrupt_snapset_scrub_rep: jq .inconsistents 2026-02-23T08:13:10.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6329: TEST_corrupt_snapset_scrub_rep: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:13:10.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6330: TEST_corrupt_snapset_scrub_rep: multidiff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:13:10.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-repair/checkcsjson td/osd-scrub-repair/csjson 2026-02-23T08:13:10.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6331: TEST_corrupt_snapset_scrub_rep: test no = yes 2026-02-23T08:13:10.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6336: TEST_corrupt_snapset_scrub_rep: test '' = yes 2026-02-23T08:13:10.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6341: TEST_corrupt_snapset_scrub_rep: ERRORS=0 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6342: TEST_corrupt_snapset_scrub_rep: declare -a err_strings 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6343: TEST_corrupt_snapset_scrub_rep: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ1:head : snapset inconsistent' 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6344: TEST_corrupt_snapset_scrub_rep: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ2:head : snapset inconsistent' 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6345: TEST_corrupt_snapset_scrub_rep: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 [0-9]*:.*:::ROBJ1:1 : is an unexpected clone' 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6346: TEST_corrupt_snapset_scrub_rep: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 3/4 objects, 1/2 clones, 3/4 dirty, 3/4 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 49/56 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6347: TEST_corrupt_snapset_scrub_rep: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 0 missing, 2 inconsistent objects' 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6348: TEST_corrupt_snapset_scrub_rep: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 4 errors' 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-23T08:13:10.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ1:head : snapset inconsistent' td/osd-scrub-repair/osd.1.log 2026-02-23T08:13:10.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-23T08:13:10.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid [0-9]*:.*:::ROBJ2:head : snapset inconsistent' td/osd-scrub-repair/osd.1.log 2026-02-23T08:13:10.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-23T08:13:10.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 [0-9]*:.*:::ROBJ1:1 : is an unexpected clone' td/osd-scrub-repair/osd.1.log 2026-02-23T08:13:10.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-23T08:13:10.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub : stat mismatch, got 3/4 objects, 1/2 clones, 3/4 dirty, 3/4 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 49/56 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.' td/osd-scrub-repair/osd.1.log 2026-02-23T08:13:10.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-23T08:13:10.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 0 missing, 2 inconsistent objects' td/osd-scrub-repair/osd.1.log 2026-02-23T08:13:10.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6350: TEST_corrupt_snapset_scrub_rep: for err_string in "${err_strings[@]}" 2026-02-23T08:13:10.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6352: TEST_corrupt_snapset_scrub_rep: grep -q 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 4 errors' td/osd-scrub-repair/osd.1.log 2026-02-23T08:13:10.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6359: TEST_corrupt_snapset_scrub_rep: '[' 0 '!=' 0 ']' 2026-02-23T08:13:10.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6365: TEST_corrupt_snapset_scrub_rep: ceph osd pool rm csr_pool csr_pool --yes-i-really-really-mean-it 2026-02-23T08:13:10.921 INFO:tasks.workunit.client.0.trial129.stderr:pool 'csr_pool' removed 2026-02-23T08:13:10.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:13:10.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:13:10.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:13:10.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:13:10.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:10.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:10.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:10.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:10.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:11.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:11.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:13:11.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:13:11.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:13:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:13:11.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:13:11.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:13:11.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:13:11.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:13:11.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:13:11.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:13:11.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:13:11.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:13:11.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:13:11.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:13:11.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:13:11.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:13:11.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:13:11.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:13:11.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:13:11.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:11.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:11.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:11.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:13:11.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:13:11.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:13:11.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:13:11.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:13:11.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:13:11.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:13:11.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:13:11.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:13:11.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:13:11.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:13:11.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:13:11.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:13:11.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:13:11.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:13:11.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:13:11.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:13:11.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:13:11.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:13:11.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:13:11.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:13:11.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:13:11.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:13:11.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:13:11.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_dual_store_replicated_cluster td/osd-scrub-repair 2026-02-23T08:13:11.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6432: TEST_dual_store_replicated_cluster: local dir=td/osd-scrub-repair 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6433: TEST_dual_store_replicated_cluster: local poolname=csr_pool 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6434: TEST_dual_store_replicated_cluster: local total_objs=19 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6435: TEST_dual_store_replicated_cluster: local extr_dbg=1 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6437: TEST_dual_store_replicated_cluster: run_mon td/osd-scrub-repair a --osd_pool_default_size=2 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:13:11.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=2 2026-02-23T08:13:11.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:13:11.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:11.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:11.097 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:11.097 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.097 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:11.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:13:11.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:13:11.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:13:11.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:13:11.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:13:11.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:13:11.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:13:11.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:13:11.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:13:11.120 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:13:11.120 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:13:11.121 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.121 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:13:11.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:13:11.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:13:11.184 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:13:11.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:13:11.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6438: TEST_dual_store_replicated_cluster: run_mgr td/osd-scrub-repair x --mgr_stats_period=1 2026-02-23T08:13:11.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:13:11.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:13:11.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:13:11.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:13:11.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:13:11.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:11.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:13:11.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:13:11.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6439: TEST_dual_store_replicated_cluster: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 ' 2026-02-23T08:13:11.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6440: TEST_dual_store_replicated_cluster: ceph_osd_args+='--osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 ' 2026-02-23T08:13:11.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6441: TEST_dual_store_replicated_cluster: ceph_osd_args+='--osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 ' 2026-02-23T08:13:11.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6442: TEST_dual_store_replicated_cluster: seq 0 1 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6442: TEST_dual_store_replicated_cluster: for osd in $(seq 0 1) 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6444: TEST_dual_store_replicated_cluster: run_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:11.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:11.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:13:11.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:13:11.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:13:11.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 e0a2b4ee-d5fc-45b1-808e-155de08c0e97' 2026-02-23T08:13:11.358 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:13:11.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:13:11.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAXDJxpoamgFRAAsolQKedbetSY1yluJ+COJg== 2026-02-23T08:13:11.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAXDJxpoamgFRAAsolQKedbetSY1yluJ+COJg=="}' 2026-02-23T08:13:11.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e0a2b4ee-d5fc-45b1-808e-155de08c0e97 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:13:11.452 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:13:11.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:13:11.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 --mkfs --key AQAXDJxpoamgFRAAsolQKedbetSY1yluJ+COJg== --osd-uuid e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:13:11.479 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:11.477+0000 7f7c0700c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:11.480 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:11.479+0000 7f7c0700c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:11.481 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:11.479+0000 7f7c0700c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:11.482 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:11.480+0000 7f7c0700c780 -1 bdev(0x5603a245b400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:13:11.482 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:11.480+0000 7f7c0700c780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:13:11.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:13:11.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:13:11.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:13:11.892 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:13:11.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:13:11.987 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:13:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:13:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:13:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:13:11.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:13:12.001 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:11.999+0000 7efde8f71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:12.002 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:12.000+0000 7efde8f71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:12.003 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:12.001+0000 7efde8f71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:12.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:13:12.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:12.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:13:12.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:12.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:12.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:12.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:12.085 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:13:12.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:12.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:13:12.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:12.192 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:12.190+0000 7efde8f71780 -1 Falling back to public interface 2026-02-23T08:13:12.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:12.500+0000 7efde8f71780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:13:13.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:13:13.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:13.175 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:13:13.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:13:13.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:13.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:13:13.267 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/153344872,v1:127.0.0.1:6801/153344872] [v2:127.0.0.1:6802/153344872,v1:127.0.0.1:6803/153344872] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6442: TEST_dual_store_replicated_cluster: for osd in $(seq 0 1) 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6444: TEST_dual_store_replicated_cluster: run_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:13.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:13:13.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:13.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:13.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:13.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:13.269 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:13:13.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:13:13.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:13:13.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c' 2026-02-23T08:13:13.271 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:13:13.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:13:13.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAZDJxpNHOfEBAAAmW1khQFzZ/jrW7iILROeQ== 2026-02-23T08:13:13.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAZDJxpNHOfEBAAAmW1khQFzZ/jrW7iILROeQ=="}' 2026-02-23T08:13:13.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c -i td/osd-scrub-repair/1/new.json 2026-02-23T08:13:13.370 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:13:13.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:13:13.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 --mkfs --key AQAZDJxpNHOfEBAAAmW1khQFzZ/jrW7iILROeQ== --osd-uuid bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:13:13.394 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:13.392+0000 7f2badf71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:13.396 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:13.394+0000 7f2badf71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:13.396 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:13.395+0000 7f2badf71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:13.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:13.395+0000 7f2badf71780 -1 bdev(0x5628f8791400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:13:13.397 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:13.395+0000 7f2badf71780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:13:13.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:13:13.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:13:13.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:13:13.810 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:13:13.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:13:14.018 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:13:14.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:13:14.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:13:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:13:14.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:13:14.033 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:14.031+0000 7f662ad4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:14.034 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:14.032+0000 7f662ad4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:14.035 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:14.033+0000 7f662ad4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:14.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:13:14.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:14.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:13:14.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:14.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:14.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:14.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:14.185 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:13:14.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:14.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:14.227 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:14.224+0000 7f662ad4f780 -1 Falling back to public interface 2026-02-23T08:13:14.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:14.556 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:14.554+0000 7f662ad4f780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:13:15.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:13:15.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:15.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:13:15.352 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:13:15.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:15.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:15.516 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3783404597,v1:127.0.0.1:6811/3783404597] [v2:127.0.0.1:6812/3783404597,v1:127.0.0.1:6813/3783404597] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:13:15.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:13:15.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:13:15.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:13:15.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6447: TEST_dual_store_replicated_cluster: create_rbd_pool 2026-02-23T08:13:15.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:13:15.671 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:13:15.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:13:15.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:13:15.889 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:13:15.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:13:16.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:13:17.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6448: TEST_dual_store_replicated_cluster: wait_for_clean 2026-02-23T08:13:17.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:13:17.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:13:17.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:13:17.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:13:17.182 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:17.182 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:17.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:17.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:17.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:17.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:13:17.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:13:17.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:13:17.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:13:17.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:17.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:17.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:17.434 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:17.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:17.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:17.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:17.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836486 2026-02-23T08:13:17.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836486 2026-02-23T08:13:17.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486' 2026-02-23T08:13:17.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:17.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:17.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T08:13:17.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T08:13:17.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836486 1-38654705668' 2026-02-23T08:13:17.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:17.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836486 2026-02-23T08:13:17.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:17.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:17.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836486 2026-02-23T08:13:17.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:17.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836486 2026-02-23T08:13:17.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836486' 2026-02-23T08:13:17.588 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836486 2026-02-23T08:13:17.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:17.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-23T08:13:17.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:18.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:18.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:18.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836486 2026-02-23T08:13:18.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:19.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:13:19.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:20.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836486 2026-02-23T08:13:20.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:20.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T08:13:20.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:20.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:20.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T08:13:20.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:20.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T08:13:20.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T08:13:20.092 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T08:13:20.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:20.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705670 -lt 38654705668 2026-02-23T08:13:20.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:20.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:20.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:20.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:13:20.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:20.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:20.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:20.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:20.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:20.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:20.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:20.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:13:20.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:20.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:20.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:20.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:13:20.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:20.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:20.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6450: TEST_dual_store_replicated_cluster: create_pool foo 1 2026-02-23T08:13:20.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 1 2026-02-23T08:13:21.037 INFO:tasks.workunit.client.0.trial129.stderr:pool 'foo' created 2026-02-23T08:13:21.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:13:22.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6451: TEST_dual_store_replicated_cluster: create_pool csr_pool 1 1 2026-02-23T08:13:22.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create csr_pool 1 1 2026-02-23T08:13:22.266 INFO:tasks.workunit.client.0.trial129.stderr:pool 'csr_pool' created 2026-02-23T08:13:22.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:13:23.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6452: TEST_dual_store_replicated_cluster: wait_for_clean 2026-02-23T08:13:23.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:13:23.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:13:23.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:13:23.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:13:23.281 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:23.281 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:23.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:23.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:23.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:13:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:13:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:13:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:13:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:23.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:23.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:23.529 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:23.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:23.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:23.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:23.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-23T08:13:23.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-23T08:13:23.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-23T08:13:23.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:23.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:23.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705675 2026-02-23T08:13:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705675 2026-02-23T08:13:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705675' 2026-02-23T08:13:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:23.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-23T08:13:23.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:23.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-23T08:13:23.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:23.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-23T08:13:23.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-23T08:13:23.677 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836493 2026-02-23T08:13:23.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-23T08:13:23.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:24.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:24.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:25.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-23T08:13:25.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:26.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:13:26.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:26.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836493 2026-02-23T08:13:26.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:26.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705675 2026-02-23T08:13:26.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:26.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:26.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705675 2026-02-23T08:13:26.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:26.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705675 2026-02-23T08:13:26.179 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705675 2026-02-23T08:13:26.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705675' 2026-02-23T08:13:26.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:26.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705677 -lt 38654705675 2026-02-23T08:13:26.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:26.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:26.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:26.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:13:26.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:26.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:26.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:26.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:26.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:26.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:26.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:26.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:13:26.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:26.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:26.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:26.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:13:26.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:26.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:26.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6454: TEST_dual_store_replicated_cluster: ceph osd pool set csr_pool noscrub 1 2026-02-23T08:13:27.123 INFO:tasks.workunit.client.0.trial129.stderr:set pool 3 noscrub to 1 2026-02-23T08:13:27.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6455: TEST_dual_store_replicated_cluster: ceph osd pool set csr_pool nodeep-scrub 1 2026-02-23T08:13:27.328 INFO:tasks.workunit.client.0.trial129.stderr:set pool 3 nodeep-scrub to 1 2026-02-23T08:13:27.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: seq 1 19 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ1 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ1 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ1 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:27.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:27.531 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:27.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:27.731 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:27.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:27.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:27.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:27.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ1 hdr-ROBJ1 2026-02-23T08:13:27.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ1 key-ROBJ1 val-ROBJ1 2026-02-23T08:13:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ2 2026-02-23T08:13:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ2 2026-02-23T08:13:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ2 2026-02-23T08:13:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:27.998 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:28.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:28.203 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:28.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:28.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:28.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:28.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ2 hdr-ROBJ2 2026-02-23T08:13:28.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ2 key-ROBJ2 val-ROBJ2 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ3 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ3 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ3 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:28.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:28.471 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:28.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:28.676 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:28.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:28.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:28.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ3 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:28.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ3 hdr-ROBJ3 2026-02-23T08:13:28.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ3 key-ROBJ3 val-ROBJ3 2026-02-23T08:13:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ4 2026-02-23T08:13:28.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ4 2026-02-23T08:13:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ4 2026-02-23T08:13:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:28.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:28.948 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:28.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:29.152 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:29.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:29.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:29.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ4 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:29.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ4 hdr-ROBJ4 2026-02-23T08:13:29.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ4 key-ROBJ4 val-ROBJ4 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ5 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ5 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ5 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:29.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:29.456 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:29.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:29.659 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:29.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:29.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:29.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ5 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:29.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ5 hdr-ROBJ5 2026-02-23T08:13:29.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ5 key-ROBJ5 val-ROBJ5 2026-02-23T08:13:29.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:29.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ6 2026-02-23T08:13:29.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ6 2026-02-23T08:13:29.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:29.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:29.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ6 2026-02-23T08:13:29.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:29.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:29.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:29.928 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:29.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:30.132 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:30.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:30.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:30.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ6 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:30.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ6 hdr-ROBJ6 2026-02-23T08:13:30.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ6 key-ROBJ6 val-ROBJ6 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ7 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ7 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ7 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:30.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:30.401 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:30.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:30.606 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:30.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:30.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:30.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ7 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:30.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ7 hdr-ROBJ7 2026-02-23T08:13:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ7 key-ROBJ7 val-ROBJ7 2026-02-23T08:13:30.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:30.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ8 2026-02-23T08:13:30.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ8 2026-02-23T08:13:30.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:30.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:30.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ8 2026-02-23T08:13:30.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:30.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:30.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:30.875 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:30.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:31.080 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:31.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:31.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:31.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ8 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:31.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ8 hdr-ROBJ8 2026-02-23T08:13:31.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ8 key-ROBJ8 val-ROBJ8 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ9 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ9 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ9 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:31.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:31.345 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:31.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:31.549 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:31.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:31.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ9 hdr-ROBJ9 2026-02-23T08:13:31.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ9 key-ROBJ9 val-ROBJ9 2026-02-23T08:13:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ10 2026-02-23T08:13:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ10 2026-02-23T08:13:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ10 2026-02-23T08:13:31.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:31.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:31.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:31.821 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:31.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:32.025 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:32.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:32.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:32.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ10 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:32.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ10 hdr-ROBJ10 2026-02-23T08:13:32.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ10 key-ROBJ10 val-ROBJ10 2026-02-23T08:13:32.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:32.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ11 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ11 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ11 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:32.292 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:32.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:32.497 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:32.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:32.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:32.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ11 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:32.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ11 hdr-ROBJ11 2026-02-23T08:13:32.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ11 key-ROBJ11 val-ROBJ11 2026-02-23T08:13:32.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:32.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ12 2026-02-23T08:13:32.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ12 2026-02-23T08:13:32.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:32.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:32.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ12 2026-02-23T08:13:32.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:32.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:32.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:32.763 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:32.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:32.966 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:32.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:32.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:32.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ12 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:32.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ12 hdr-ROBJ12 2026-02-23T08:13:33.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ12 key-ROBJ12 val-ROBJ12 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ13 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ13 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ13 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:33.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:33.237 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:33.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:33.441 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:33.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:33.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:33.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ13 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:33.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ13 hdr-ROBJ13 2026-02-23T08:13:33.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ13 key-ROBJ13 val-ROBJ13 2026-02-23T08:13:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:33.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ14 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ14 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ14 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:33.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:33.710 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:33.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:33.913 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:33.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:33.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:33.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ14 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:33.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ14 hdr-ROBJ14 2026-02-23T08:13:33.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ14 key-ROBJ14 val-ROBJ14 2026-02-23T08:13:33.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ15 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ15 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ15 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:33.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:34.184 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:34.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:34.389 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:34.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:34.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:34.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ15 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:34.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ15 hdr-ROBJ15 2026-02-23T08:13:34.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ15 key-ROBJ15 val-ROBJ15 2026-02-23T08:13:34.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ16 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ16 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ16 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:34.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:34.655 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:34.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:34.858 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:34.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:34.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:34.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ16 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:34.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ16 hdr-ROBJ16 2026-02-23T08:13:34.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ16 key-ROBJ16 val-ROBJ16 2026-02-23T08:13:34.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:34.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ17 2026-02-23T08:13:34.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ17 2026-02-23T08:13:34.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:34.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:34.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ17 2026-02-23T08:13:34.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:34.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:34.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:35.125 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:35.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:35.330 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:35.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:35.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:35.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ17 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:35.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ17 hdr-ROBJ17 2026-02-23T08:13:35.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ17 key-ROBJ17 val-ROBJ17 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ18 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ18 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ18 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:35.597 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:35.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:35.801 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ18 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:35.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ18 hdr-ROBJ18 2026-02-23T08:13:35.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ18 key-ROBJ18 val-ROBJ18 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6457: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6458: TEST_dual_store_replicated_cluster: objname=ROBJ19 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6459: TEST_dual_store_replicated_cluster: add_something td/osd-scrub-repair csr_pool ROBJ19 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=csr_pool 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=ROBJ19 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:13:35.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:13:36.069 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:13:36.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:13:36.273 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:13:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:13:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:13:36.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:13:36.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6461: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapheader ROBJ19 hdr-ROBJ19 2026-02-23T08:13:36.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6462: TEST_dual_store_replicated_cluster: rados --pool csr_pool setomapval ROBJ19 key-ROBJ19 val-ROBJ19 2026-02-23T08:13:36.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6466: TEST_dual_store_replicated_cluster: dd if=/dev/zero of=td/osd-scrub-repair/new.ROBJ19 bs=1024 count=1025 2026-02-23T08:13:36.340 INFO:tasks.workunit.client.0.trial129.stderr:1025+0 records in 2026-02-23T08:13:36.340 INFO:tasks.workunit.client.0.trial129.stderr:1025+0 records out 2026-02-23T08:13:36.340 INFO:tasks.workunit.client.0.trial129.stderr:1049600 bytes (1.0 MB, 1.0 MiB) copied, 0.00144834 s, 725 MB/s 2026-02-23T08:13:36.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6467: TEST_dual_store_replicated_cluster: rados --pool csr_pool put ROBJ19 td/osd-scrub-repair/new.ROBJ19 2026-02-23T08:13:36.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6468: TEST_dual_store_replicated_cluster: rm -f td/osd-scrub-repair/new.ROBJ19 2026-02-23T08:13:36.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6470: TEST_dual_store_replicated_cluster: get_pg csr_pool ROBJ0 2026-02-23T08:13:36.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-23T08:13:36.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-23T08:13:36.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:13:36.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:13:36.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6470: TEST_dual_store_replicated_cluster: local pg=3.0 2026-02-23T08:13:36.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6471: TEST_dual_store_replicated_cluster: get_primary csr_pool ROBJ0 2026-02-23T08:13:36.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=csr_pool 2026-02-23T08:13:36.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=ROBJ0 2026-02-23T08:13:36.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:13:36.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:13:36.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6471: TEST_dual_store_replicated_cluster: local primary=1 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6474: TEST_dual_store_replicated_cluster: get_asok_path osd.0 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6474: TEST_dual_store_replicated_cluster: CEPH_ARGS= 2026-02-23T08:13:36.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6474: TEST_dual_store_replicated_cluster: ceph daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-23T08:13:36.746 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:13:36.746 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-23T08:13:36.746 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:13:36.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6476: TEST_dual_store_replicated_cluster: get_asok_path osd.1 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6476: TEST_dual_store_replicated_cluster: CEPH_ARGS= 2026-02-23T08:13:36.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6476: TEST_dual_store_replicated_cluster: ceph daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set osd_deep_scrub_update_digest_min_age 0 2026-02-23T08:13:36.807 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:13:36.807 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_update_digest_min_age = '' (not observed, change may require restart) " 2026-02-23T08:13:36.807 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:13:36.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6478: TEST_dual_store_replicated_cluster: pg_deep_scrub 3.0 2026-02-23T08:13:36.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:13:36.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:13:36.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:13:36.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:13:36.815 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:36.815 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:36.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:36.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:36.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:13:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:13:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:13:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:13:37.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:37.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:37.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:37.182 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:37.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:37.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:37.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-23T08:13:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-23T08:13:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-23T08:13:37.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:37.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:37.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705690 2026-02-23T08:13:37.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705690 2026-02-23T08:13:37.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705690' 2026-02-23T08:13:37.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:37.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-23T08:13:37.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:37.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:37.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-23T08:13:37.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:37.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-23T08:13:37.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-23T08:13:37.333 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836507 2026-02-23T08:13:37.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:37.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836507 -lt 21474836507 2026-02-23T08:13:37.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:37.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705690 2026-02-23T08:13:37.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:37.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:37.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705690 2026-02-23T08:13:37.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:37.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705690 2026-02-23T08:13:37.500 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705690 2026-02-23T08:13:37.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705690' 2026-02-23T08:13:37.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:37.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705690 -lt 38654705690 2026-02-23T08:13:37.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:13:37.666 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:13:37.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:13:37.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:13:37.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:13:37.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:13:37.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:13:37.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:37.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:13:37.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:37.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:13:37.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:13:22.264734+0000 2026-02-23T08:13:37.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:13:38.058 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-23T08:13:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:13:22.264734+0000 last_deep_scrub_stamp 2026-02-23T08:13:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:13:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:13:22.264734+0000 2026-02-23T08:13:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:13:38.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:13:38.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:38.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:13:38.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:38.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:13:38.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:38.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:13:38.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:22.264734+0000 '>' 2026-02-23T08:13:22.264734+0000 2026-02-23T08:13:38.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:13:39.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:13:39.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:13:39.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:13:39.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:13:39.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:13:39.237 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:13:39.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:13:39.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:22.264734+0000 2026-02-23T08:13:39.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:13:39.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: seq 1 19 2026-02-23T08:13:39.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:39.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ1 2026-02-23T08:13:39.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 1 % 2 2026-02-23T08:13:39.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:13:39.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6489: TEST_dual_store_replicated_cluster: local payload=UVWXYZZZ 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6490: TEST_dual_store_replicated_cluster: echo UVWXYZZZ 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6491: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:39.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:39.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:39.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:39.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:13:39.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:13:39.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:13:39.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:13:39.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:39.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ1 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:39.815 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#-5:00000000:::deep_scrub_3.0:head#, (61) No data available 2026-02-23T08:13:39.816 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#-5:00000000:::scrub_3.0:head#, (61) No data available 2026-02-23T08:13:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:13:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:13:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:13:39.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:13:39.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:39.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:13:39.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:39.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:13:39.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:13:39.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:13:39.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:13:39.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:13:39.885 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:39.883+0000 7f90bdb54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:39.886 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:39.884+0000 7f90bdb54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:39.887 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:39.885+0000 7f90bdb54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:40.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:13:40.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:40.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:13:40.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:40.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:40.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:40.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:40.041 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:13:40.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:40.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:40.083 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:40.080+0000 7f90bdb54780 -1 Falling back to public interface 2026-02-23T08:13:40.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:40.444 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:40.442+0000 7f90bdb54780 -1 osd.1 62 log_to_monitors true 2026-02-23T08:13:41.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:13:41.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:41.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:13:41.203 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:13:41.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:41.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 66 up_thru 66 down_at 63 last_clean_interval [9,62) [v2:127.0.0.1:6810/1047376514,v1:127.0.0.1:6811/1047376514] [v2:127.0.0.1:6812/1047376514,v1:127.0.0.1:6813/1047376514] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:13:41.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:13:41.372 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:41.372 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:41.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:41.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:41.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:13:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:13:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:13:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:13:41.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:41.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:41.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:41.620 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:41.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:41.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:41.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:41.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836513 2026-02-23T08:13:41.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836513 2026-02-23T08:13:41.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836513' 2026-02-23T08:13:41.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:41.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:41.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841539 2026-02-23T08:13:41.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841539 2026-02-23T08:13:41.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836513 1-283467841539' 2026-02-23T08:13:41.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:41.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836513 2026-02-23T08:13:41.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:41.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:41.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836513 2026-02-23T08:13:41.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:41.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836513 2026-02-23T08:13:41.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836513' 2026-02-23T08:13:41.772 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836513 2026-02-23T08:13:41.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:41.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836513 2026-02-23T08:13:41.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:42.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:42.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:43.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836513 2026-02-23T08:13:43.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:44.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:13:44.106 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836513 2026-02-23T08:13:44.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:44.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-283467841539 2026-02-23T08:13:44.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:44.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:44.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-283467841539 2026-02-23T08:13:44.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:44.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841539 2026-02-23T08:13:44.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 283467841539' 2026-02-23T08:13:44.275 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 283467841539 2026-02-23T08:13:44.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:44.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841540 -lt 283467841539 2026-02-23T08:13:44.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:44.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:44.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:44.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:13:44.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:44.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:44.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:44.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:44.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:44.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:44.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:44.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:13:44.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:44.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:44.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:45.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:13:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ2 2026-02-23T08:13:45.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 2 % 2 2026-02-23T08:13:45.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:13:45.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:13:45.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6496: TEST_dual_store_replicated_cluster: local payload=UVWXYZ 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6497: TEST_dual_store_replicated_cluster: echo UVWXYZ 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6498: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:45.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:45.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:45.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:45.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:13:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ2 set-bytes td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:45.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:45.502 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:45.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:13:45.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:13:45.504 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:13:45.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:45.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:13:45.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:13:45.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:13:45.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:13:45.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:13:45.514 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:45.512+0000 7f86c547e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:45.516 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:45.514+0000 7f86c547e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:45.516 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:45.514+0000 7f86c547e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:45.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:13:45.711 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:45.710+0000 7f86c547e780 -1 Falling back to public interface 2026-02-23T08:13:45.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:46.080 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:46.078+0000 7f86c547e780 -1 osd.0 69 log_to_monitors true 2026-02-23T08:13:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:13:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:13:46.840 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:13:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:46.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:13:47.006 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 73 up_thru 73 down_at 70 last_clean_interval [5,69) [v2:127.0.0.1:6800/1040971572,v1:127.0.0.1:6801/1040971572] [v2:127.0.0.1:6802/1040971572,v1:127.0.0.1:6803/1040971572] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:13:47.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:13:47.008 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:47.008 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:47.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:47.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:47.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:47.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:13:47.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:13:47.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:13:47.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:13:47.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:47.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:47.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:47.255 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:47.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:47.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:47.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:47.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612611 2026-02-23T08:13:47.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612611 2026-02-23T08:13:47.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612611' 2026-02-23T08:13:47.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:47.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:47.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=283467841545 2026-02-23T08:13:47.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 283467841545 2026-02-23T08:13:47.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612611 1-283467841545' 2026-02-23T08:13:47.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:47.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-313532612611 2026-02-23T08:13:47.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:47.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:47.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-313532612611 2026-02-23T08:13:47.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:47.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612611 2026-02-23T08:13:47.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 313532612611' 2026-02-23T08:13:47.409 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 313532612611 2026-02-23T08:13:47.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:47.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612611 -lt 313532612611 2026-02-23T08:13:47.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:47.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-283467841545 2026-02-23T08:13:47.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:47.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-283467841545 2026-02-23T08:13:47.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:47.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=283467841545 2026-02-23T08:13:47.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 283467841545' 2026-02-23T08:13:47.577 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 283467841545 2026-02-23T08:13:47.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:47.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841544 -lt 283467841545 2026-02-23T08:13:47.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:48.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:48.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:48.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841544 -lt 283467841545 2026-02-23T08:13:48.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:49.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:13:49.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:50.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 283467841547 -lt 283467841545 2026-02-23T08:13:50.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:50.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:50.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:50.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:13:50.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:50.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:50.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:50.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:50.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:50.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:50.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:50.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:13:50.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:50.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:50.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:50.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:13:50.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:50.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:50.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:50.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ3 2026-02-23T08:13:50.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 3 % 2 2026-02-23T08:13:50.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:13:50.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:13:50.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6503: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ3 remove 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ3 remove 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:50.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:50.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ3 remove 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:50.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ3 remove 2026-02-23T08:13:50.893 INFO:tasks.workunit.client.0.trial129.stdout:remove #3:f2a5b2a4:::ROBJ3:head# 2026-02-23T08:13:50.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:50.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:50.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:13:50.943 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:13:50.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:50.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:13:50.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:13:50.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:13:50.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:13:50.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:13:50.955 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:50.953+0000 7f4831b54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:50.956 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:50.954+0000 7f4831b54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:50.957 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:50.955+0000 7f4831b54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:51.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:51.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:51.153 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:51.151+0000 7f4831b54780 -1 Falling back to public interface 2026-02-23T08:13:51.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:51.489 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:51.487+0000 7f4831b54780 -1 osd.1 75 log_to_monitors true 2026-02-23T08:13:52.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:13:52.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:52.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:13:52.275 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:13:52.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:52.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:52.442 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 79 up_thru 79 down_at 76 last_clean_interval [66,75) [v2:127.0.0.1:6810/3417180817,v1:127.0.0.1:6811/3417180817] [v2:127.0.0.1:6812/3417180817,v1:127.0.0.1:6813/3417180817] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:13:52.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:13:52.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:13:52.444 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:52.444 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:52.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:52.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:52.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:13:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:13:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:13:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:13:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:52.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:52.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:52.695 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:52.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:52.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:52.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612617 2026-02-23T08:13:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612617 2026-02-23T08:13:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612617' 2026-02-23T08:13:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:52.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:52.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=339302416387 2026-02-23T08:13:52.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 339302416387 2026-02-23T08:13:52.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612617 1-339302416387' 2026-02-23T08:13:52.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:52.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-313532612617 2026-02-23T08:13:52.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:52.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:52.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-313532612617 2026-02-23T08:13:52.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:52.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612617 2026-02-23T08:13:52.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 313532612617' 2026-02-23T08:13:52.849 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 313532612617 2026-02-23T08:13:52.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:53.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612615 -lt 313532612617 2026-02-23T08:13:53.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:13:54.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:13:54.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:54.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612618 -lt 313532612617 2026-02-23T08:13:54.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:54.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-339302416387 2026-02-23T08:13:54.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:54.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:54.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:54.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-339302416387 2026-02-23T08:13:54.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=339302416387 2026-02-23T08:13:54.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 339302416387' 2026-02-23T08:13:54.187 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 339302416387 2026-02-23T08:13:54.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:54.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 339302416387 -lt 339302416387 2026-02-23T08:13:54.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:54.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:54.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:54.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:13:54.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:54.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:54.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:54.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:54.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:54.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:54.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:54.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:13:54.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:54.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:54.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:54.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:13:54.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:54.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:54.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:54.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ4 2026-02-23T08:13:54.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 4 % 2 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6508: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:13:54.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:13:54.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:54.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:54.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:54.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:54.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:55.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:55.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:55.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:13:55.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:13:55.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:13:55.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:13:55.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:13:55.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ4 set-omap key-ROBJ4 td/osd-scrub-repair/CORRUPT 2026-02-23T08:13:55.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:55.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:55.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:55.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:55.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:13:55.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:13:55.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:13:55.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:13:55.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:13:55.428 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:55.426+0000 7f2dbf87d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:55.429 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:55.428+0000 7f2dbf87d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:55.430 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:55.429+0000 7f2dbf87d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:55.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:13:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:13:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:55.583 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:13:55.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:55.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:13:55.639 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:55.637+0000 7f2dbf87d780 -1 Falling back to public interface 2026-02-23T08:13:55.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:55.981 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:55.980+0000 7f2dbf87d780 -1 osd.0 80 log_to_monitors true 2026-02-23T08:13:56.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:13:56.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:56.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:13:56.747 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:13:56.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:56.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:13:56.914 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 84 up_thru 84 down_at 81 last_clean_interval [73,80) [v2:127.0.0.1:6800/1423468226,v1:127.0.0.1:6801/1423468226] [v2:127.0.0.1:6802/1423468226,v1:127.0.0.1:6803/1423468226] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:13:56.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:13:56.916 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:13:56.916 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:13:56.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:13:56.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:13:56.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:13:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:13:56.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:13:56.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:13:56.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:13:56.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:13:56.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:13:57.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:13:57.161 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:13:57.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:13:57.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:57.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:13:57.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252867 2026-02-23T08:13:57.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252867 2026-02-23T08:13:57.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867' 2026-02-23T08:13:57.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:13:57.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:13:57.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=339302416392 2026-02-23T08:13:57.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 339302416392 2026-02-23T08:13:57.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252867 1-339302416392' 2026-02-23T08:13:57.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:57.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252867 2026-02-23T08:13:57.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:57.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:13:57.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252867 2026-02-23T08:13:57.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:57.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252867 2026-02-23T08:13:57.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252867' 2026-02-23T08:13:57.317 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 360777252867 2026-02-23T08:13:57.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:13:57.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252867 -lt 360777252867 2026-02-23T08:13:57.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:13:57.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-339302416392 2026-02-23T08:13:57.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:13:57.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:13:57.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-339302416392 2026-02-23T08:13:57.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:13:57.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=339302416392 2026-02-23T08:13:57.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 339302416392' 2026-02-23T08:13:57.490 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 339302416392 2026-02-23T08:13:57.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:13:57.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 339302416392 -lt 339302416392 2026-02-23T08:13:57.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:13:57.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:57.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:57.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:13:57.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:13:57.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:13:57.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:13:57.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:13:57.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:13:57.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:13:57.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:13:58.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:13:58.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:13:58.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:13:58.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:13:58.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:13:58.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:13:58.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:13:58.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:13:58.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ5 2026-02-23T08:13:58.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 5 % 2 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6513: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:13:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:13:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:13:58.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:13:58.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:13:58.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:13:58.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:13:58.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:13:58.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:13:58.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:58.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ5 rm-omap key-ROBJ5 2026-02-23T08:13:58.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:58.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:13:58.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:13:58.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:13:58.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:13:58.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:13:58.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:13:58.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:13:58.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:13:58.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:13:58.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:13:58.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:13:58.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:13:58.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:13:58.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:13:58.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:13:58.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:13:58.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:13:58.732 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:13:58.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:13:58.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:13:58.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:58.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:13:58.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:13:58.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:13:58.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:13:58.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:13:58.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:13:58.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:13:58.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:13:58.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:13:58.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:13:58.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:13:58.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:13:58.735 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:13:58.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:13:58.735 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:13:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:13:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:13:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:13:58.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:13:58.738 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:58.737+0000 7fed3ae13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:58.740 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:58.738+0000 7fed3ae13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:58.740 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:58.739+0000 7fed3ae13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:13:58.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:13:58.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:13:58.943 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:58.942+0000 7fed3ae13780 -1 Falling back to public interface 2026-02-23T08:13:59.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:13:59.300 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:13:59.298+0000 7fed3ae13780 -1 osd.1 86 log_to_monitors true 2026-02-23T08:14:00.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:00.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:00.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:00.057 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:00.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:00.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:00.224 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 90 up_thru 90 down_at 87 last_clean_interval [79,86) [v2:127.0.0.1:6810/893578039,v1:127.0.0.1:6811/893578039] [v2:127.0.0.1:6812/893578039,v1:127.0.0.1:6813/893578039] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:00.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:00.226 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:00.226 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:00.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:00.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:00.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:00.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:00.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:00.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:00.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:00.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:00.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:00.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:00.474 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:00.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:00.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:00.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:00.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252871 2026-02-23T08:14:00.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252871 2026-02-23T08:14:00.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252871' 2026-02-23T08:14:00.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:00.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:00.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056643 2026-02-23T08:14:00.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056643 2026-02-23T08:14:00.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-360777252871 1-386547056643' 2026-02-23T08:14:00.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:00.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-360777252871 2026-02-23T08:14:00.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:00.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:00.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-360777252871 2026-02-23T08:14:00.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:00.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252871 2026-02-23T08:14:00.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 360777252871' 2026-02-23T08:14:00.625 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 360777252871 2026-02-23T08:14:00.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:00.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252869 -lt 360777252871 2026-02-23T08:14:00.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:01.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252872 -lt 360777252871 2026-02-23T08:14:01.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:01.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-386547056643 2026-02-23T08:14:01.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:01.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:01.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-386547056643 2026-02-23T08:14:01.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:01.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056643 2026-02-23T08:14:01.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 386547056643' 2026-02-23T08:14:01.957 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 386547056643 2026-02-23T08:14:01.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:02.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056643 -lt 386547056643 2026-02-23T08:14:02.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:02.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:02.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:02.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:02.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:02.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:02.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:02.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:02.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:02.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:02.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:02.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:02.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:02.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ6 2026-02-23T08:14:02.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 6 % 2 2026-02-23T08:14:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:14:02.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6518: TEST_dual_store_replicated_cluster: echo extra 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6519: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:02.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:14:02.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:02.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:02.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:02.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:02.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:03.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:03.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:14:03.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:03.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:03.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:14:03.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:03.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:03.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ6 set-omap key2-ROBJ6 td/osd-scrub-repair/extra-val 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:03.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:03.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:14:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:03.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:14:03.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:14:03.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:03.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:03.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:03.191 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:03.190+0000 7f7c8834f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:03.192 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:03.191+0000 7f7c8834f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:03.193 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:03.192+0000 7f7c8834f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:03.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:03.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:03.413 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:03.412+0000 7f7c8834f780 -1 Falling back to public interface 2026-02-23T08:14:03.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:03.795 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:03.793+0000 7f7c8834f780 -1 osd.0 91 log_to_monitors true 2026-02-23T08:14:04.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:04.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:04.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:04.510 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:04.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:04.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 95 up_thru 95 down_at 92 last_clean_interval [84,91) [v2:127.0.0.1:6800/1857785907,v1:127.0.0.1:6801/1857785907] [v2:127.0.0.1:6802/1857785907,v1:127.0.0.1:6803/1857785907] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:04.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:04.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:04.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:04.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:04.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:04.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:04.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:04.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:04.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:04.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:04.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:04.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:04.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:04.922 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:04.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:04.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:04.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:04.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893123 2026-02-23T08:14:04.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893123 2026-02-23T08:14:04.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893123' 2026-02-23T08:14:04.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:04.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:05.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=386547056648 2026-02-23T08:14:05.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 386547056648 2026-02-23T08:14:05.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893123 1-386547056648' 2026-02-23T08:14:05.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:05.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893123 2026-02-23T08:14:05.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:05.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:05.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893123 2026-02-23T08:14:05.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:05.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893123 2026-02-23T08:14:05.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893123' 2026-02-23T08:14:05.072 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 408021893123 2026-02-23T08:14:05.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:05.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252873 -lt 408021893123 2026-02-23T08:14:05.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:06.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:06.239 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:06.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893123 -lt 408021893123 2026-02-23T08:14:06.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:06.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-386547056648 2026-02-23T08:14:06.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:06.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:06.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-386547056648 2026-02-23T08:14:06.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:06.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=386547056648 2026-02-23T08:14:06.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 386547056648' 2026-02-23T08:14:06.411 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 386547056648 2026-02-23T08:14:06.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:06.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 386547056648 -lt 386547056648 2026-02-23T08:14:06.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:06.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:06.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:06.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:06.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:06.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:06.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:06.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:06.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:06.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:06.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:06.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:06.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:06.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:06.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:07.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:07.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:07.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:07.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6520: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/extra-val 2026-02-23T08:14:07.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:07.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ7 2026-02-23T08:14:07.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 7 % 2 2026-02-23T08:14:07.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:14:07.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:07.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6525: TEST_dual_store_replicated_cluster: echo -n newheader 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6526: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:07.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:07.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:07.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:07.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:07.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:07.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:07.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:07.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:14:07.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:07.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:07.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:07.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:07.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:07.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ7 set-omaphdr td/osd-scrub-repair/hdr 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:07.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:07.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:07.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:07.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:07.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:07.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:07.640 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:07.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:07.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:07.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:07.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:07.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:07.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:07.651 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:07.650+0000 7fb473c0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:07.652 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:07.652+0000 7fb473c0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:07.653 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:07.652+0000 7fb473c0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:07.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:07.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:07.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:07.869 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:07.867+0000 7fb473c0c780 -1 Falling back to public interface 2026-02-23T08:14:07.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:08.203 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:08.202+0000 7fb473c0c780 -1 osd.1 96 log_to_monitors true 2026-02-23T08:14:08.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:08.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:08.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:08.970 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:08.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:08.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 100 up_thru 100 down_at 97 last_clean_interval [90,96) [v2:127.0.0.1:6810/3566257252,v1:127.0.0.1:6811/3566257252] [v2:127.0.0.1:6812/3566257252,v1:127.0.0.1:6813/3566257252] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:09.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:09.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:09.146 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:09.146 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:09.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:09.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:09.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:09.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:09.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:09.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:09.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:09.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:09.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:09.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:09.394 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:09.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:09.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:09.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:09.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=408021893128 2026-02-23T08:14:09.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 408021893128 2026-02-23T08:14:09.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893128' 2026-02-23T08:14:09.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:09.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:09.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=429496729603 2026-02-23T08:14:09.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 429496729603 2026-02-23T08:14:09.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-408021893128 1-429496729603' 2026-02-23T08:14:09.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:09.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-408021893128 2026-02-23T08:14:09.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:09.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:09.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-408021893128 2026-02-23T08:14:09.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:09.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=408021893128 2026-02-23T08:14:09.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 408021893128' 2026-02-23T08:14:09.546 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 408021893128 2026-02-23T08:14:09.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:09.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893127 -lt 408021893128 2026-02-23T08:14:09.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:10.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:10.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:10.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893127 -lt 408021893128 2026-02-23T08:14:10.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:11.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:14:11.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:12.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893130 -lt 408021893128 2026-02-23T08:14:12.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:12.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-429496729603 2026-02-23T08:14:12.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:12.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:12.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-429496729603 2026-02-23T08:14:12.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:12.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=429496729603 2026-02-23T08:14:12.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 429496729603' 2026-02-23T08:14:12.050 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 429496729603 2026-02-23T08:14:12.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:12.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729605 -lt 429496729603 2026-02-23T08:14:12.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:12.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:12.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:12.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:12.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:12.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:12.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:12.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:12.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6527: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/hdr 2026-02-23T08:14:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:12.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ8 2026-02-23T08:14:12.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 8 % 2 2026-02-23T08:14:12.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:14:12.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:12.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6531: TEST_dual_store_replicated_cluster: rados --pool csr_pool setxattr ROBJ8 key1-ROBJ8 val1-ROBJ8 2026-02-23T08:14:12.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6532: TEST_dual_store_replicated_cluster: rados --pool csr_pool setxattr ROBJ8 key2-ROBJ8 val2-ROBJ8 2026-02-23T08:14:12.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6535: TEST_dual_store_replicated_cluster: echo -n bad-val 2026-02-23T08:14:12.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6536: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:14:12.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:12.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:12.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:14:12.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:12.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:12.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:12.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:12.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:14:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:14:13.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:13.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:13.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ8 set-attr _key1-ROBJ8 td/osd-scrub-repair/bad-val 2026-02-23T08:14:13.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:13.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:13.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:13.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:13.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:13.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:13.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:14:13.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:14:13.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:13.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:13.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:13.315 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:13.314+0000 7f1e90171780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:13.316 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:13.315+0000 7f1e90171780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:13.317 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:13.316+0000 7f1e90171780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:13.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:14:13.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:13.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:14:13.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:13.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:13.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:13.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:13.468 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:13.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:13.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:13.514 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:13.513+0000 7f1e90171780 -1 Falling back to public interface 2026-02-23T08:14:13.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:13.854 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:13.853+0000 7f1e90171780 -1 osd.0 101 log_to_monitors true 2026-02-23T08:14:14.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:14.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:14.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:14.631 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:14.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:14.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 105 up_thru 105 down_at 102 last_clean_interval [95,101) [v2:127.0.0.1:6800/2702292794,v1:127.0.0.1:6801/2702292794] [v2:127.0.0.1:6802/2702292794,v1:127.0.0.1:6803/2702292794] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:14.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:14.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:14.799 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:14.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:14.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:14.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:14.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:14.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:14.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:14.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:14.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:14.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:15.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:15.045 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:15.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:15.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:15.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:15.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=450971566083 2026-02-23T08:14:15.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 450971566083 2026-02-23T08:14:15.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566083' 2026-02-23T08:14:15.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:15.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:15.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=429496729609 2026-02-23T08:14:15.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 429496729609 2026-02-23T08:14:15.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566083 1-429496729609' 2026-02-23T08:14:15.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:15.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-450971566083 2026-02-23T08:14:15.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:15.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:15.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-450971566083 2026-02-23T08:14:15.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:15.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=450971566083 2026-02-23T08:14:15.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 450971566083' 2026-02-23T08:14:15.201 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 450971566083 2026-02-23T08:14:15.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:15.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 408021893132 -lt 450971566083 2026-02-23T08:14:15.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:16.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:16.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:16.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566083 -lt 450971566083 2026-02-23T08:14:16.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:16.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-429496729609 2026-02-23T08:14:16.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:16.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:16.535 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-429496729609 2026-02-23T08:14:16.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:16.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=429496729609 2026-02-23T08:14:16.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 429496729609' 2026-02-23T08:14:16.537 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 429496729609 2026-02-23T08:14:16.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:16.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 429496729610 -lt 429496729609 2026-02-23T08:14:16.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:16.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:16.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:16.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:16.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:16.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:16.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:16.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:16.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:16.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:16.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:17.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:17.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:17.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:17.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6537: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:17.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 rm-attr _key2-ROBJ8 2026-02-23T08:14:17.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:17.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:17.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:17.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:17.760 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:17.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:17.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:17.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:17.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:17.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:17.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:17.773 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:17.772+0000 7f6470611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:17.774 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:17.774+0000 7f6470611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:17.775 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:17.774+0000 7f6470611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:17.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:17.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:17.971 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:17.970+0000 7f6470611780 -1 Falling back to public interface 2026-02-23T08:14:18.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:18.308 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:18.307+0000 7f6470611780 -1 osd.1 106 log_to_monitors true 2026-02-23T08:14:19.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:19.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:19.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:19.099 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:19.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:19.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 110 up_thru 110 down_at 107 last_clean_interval [100,106) [v2:127.0.0.1:6810/16290033,v1:127.0.0.1:6811/16290033] [v2:127.0.0.1:6812/16290033,v1:127.0.0.1:6813/16290033] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:19.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:19.264 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:19.264 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:19.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:19.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:19.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:19.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:19.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:19.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:19.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:19.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:19.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:19.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:19.512 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:19.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:19.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:19.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:19.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=450971566088 2026-02-23T08:14:19.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 450971566088 2026-02-23T08:14:19.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566088' 2026-02-23T08:14:19.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:19.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:19.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=472446402563 2026-02-23T08:14:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 472446402563 2026-02-23T08:14:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566088 1-472446402563' 2026-02-23T08:14:19.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:19.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-450971566088 2026-02-23T08:14:19.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:19.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:19.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-450971566088 2026-02-23T08:14:19.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:19.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=450971566088 2026-02-23T08:14:19.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 450971566088' 2026-02-23T08:14:19.666 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 450971566088 2026-02-23T08:14:19.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:19.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566087 -lt 450971566088 2026-02-23T08:14:19.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:20.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:20.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:20.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566087 -lt 450971566088 2026-02-23T08:14:20.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:21.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:14:21.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:22.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566090 -lt 450971566088 2026-02-23T08:14:22.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:22.168 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-472446402563 2026-02-23T08:14:22.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:22.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:22.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-472446402563 2026-02-23T08:14:22.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:22.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=472446402563 2026-02-23T08:14:22.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 472446402563' 2026-02-23T08:14:22.171 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 472446402563 2026-02-23T08:14:22.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:22.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 472446402564 -lt 472446402563 2026-02-23T08:14:22.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:22.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:22.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:22.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:22.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:22.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:22.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:22.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:22.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:22.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:22.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6538: TEST_dual_store_replicated_cluster: echo -n val3-ROBJ8 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6539: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:22.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:22.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:22.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:23.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:23.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ8 set-attr _key3-ROBJ8 td/osd-scrub-repair/newval 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:23.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:23.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:23.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:23.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:23.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:23.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:23.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:23.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:23.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:23.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:23.215 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:23.215+0000 7fe996d86780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:23.217 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:23.216+0000 7fe996d86780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:23.218 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:23.217+0000 7fe996d86780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:23.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:23.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:23.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:23.430 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:23.429+0000 7fe996d86780 -1 Falling back to public interface 2026-02-23T08:14:23.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:23.795 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:23.794+0000 7fe996d86780 -1 osd.1 112 log_to_monitors true 2026-02-23T08:14:24.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:24.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:24.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:24.537 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:24.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:24.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:24.704 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 116 up_thru 116 down_at 113 last_clean_interval [110,112) [v2:127.0.0.1:6810/1113662188,v1:127.0.0.1:6811/1113662188] [v2:127.0.0.1:6812/1113662188,v1:127.0.0.1:6813/1113662188] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:24.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:24.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:24.705 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:24.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:24.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:24.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:24.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:24.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:24.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:24.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:24.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:24.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:24.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:24.955 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:24.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:24.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:24.955 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:25.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=450971566095 2026-02-23T08:14:25.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 450971566095 2026-02-23T08:14:25.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566095' 2026-02-23T08:14:25.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:25.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:25.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=498216206339 2026-02-23T08:14:25.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 498216206339 2026-02-23T08:14:25.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566095 1-498216206339' 2026-02-23T08:14:25.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:25.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-450971566095 2026-02-23T08:14:25.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:25.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:25.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-450971566095 2026-02-23T08:14:25.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:25.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=450971566095 2026-02-23T08:14:25.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 450971566095' 2026-02-23T08:14:25.104 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 450971566095 2026-02-23T08:14:25.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:25.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566092 -lt 450971566095 2026-02-23T08:14:25.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:26.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:26.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:26.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566095 -lt 450971566095 2026-02-23T08:14:26.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:26.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-498216206339 2026-02-23T08:14:26.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:26.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:26.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-498216206339 2026-02-23T08:14:26.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:26.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=498216206339 2026-02-23T08:14:26.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 498216206339' 2026-02-23T08:14:26.449 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 498216206339 2026-02-23T08:14:26.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:26.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 498216206339 -lt 498216206339 2026-02-23T08:14:26.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:26.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:26.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:26.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:26.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:26.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:26.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:26.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:26.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:26.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:26.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:26.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:26.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:26.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:26.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:27.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:27.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:27.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:27.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6540: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/bad-val td/osd-scrub-repair/newval 2026-02-23T08:14:27.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:27.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ9 2026-02-23T08:14:27.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 9 % 2 2026-02-23T08:14:27.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:14:27.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:27.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6544: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-23T08:14:27.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:27.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:27.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:27.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:27.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 get-attr _ 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:27.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 get-attr _ 2026-02-23T08:14:27.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:27.617 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:27.618 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:27.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:27.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:27.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:27.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:27.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:27.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:27.632 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:27.631+0000 7f49c7f4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:27.633 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:27.632+0000 7f49c7f4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:27.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:27.633+0000 7f49c7f4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:27.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:27.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:27.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:27.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:27.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:27.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:27.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:27.786 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:27.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:27.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:27.816 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:27.815+0000 7f49c7f4d780 -1 Falling back to public interface 2026-02-23T08:14:27.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:28.156 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:28.155+0000 7f49c7f4d780 -1 osd.1 117 log_to_monitors true 2026-02-23T08:14:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:28.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:28.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:28.952 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:28.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:28.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:29.127 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 121 up_thru 121 down_at 118 last_clean_interval [116,117) [v2:127.0.0.1:6810/2087274511,v1:127.0.0.1:6811/2087274511] [v2:127.0.0.1:6812/2087274511,v1:127.0.0.1:6813/2087274511] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:29.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:29.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:29.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:29.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:29.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:29.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:29.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:29.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:29.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:29.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:29.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:29.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:29.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:29.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:29.375 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:29.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:29.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:29.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:29.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=450971566100 2026-02-23T08:14:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 450971566100 2026-02-23T08:14:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566100' 2026-02-23T08:14:29.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:29.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:29.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=519691042819 2026-02-23T08:14:29.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 519691042819 2026-02-23T08:14:29.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566100 1-519691042819' 2026-02-23T08:14:29.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:29.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-450971566100 2026-02-23T08:14:29.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:29.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:29.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-450971566100 2026-02-23T08:14:29.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:29.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=450971566100 2026-02-23T08:14:29.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 450971566100' 2026-02-23T08:14:29.527 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 450971566100 2026-02-23T08:14:29.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:29.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566099 -lt 450971566100 2026-02-23T08:14:29.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:30.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:30.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:30.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566099 -lt 450971566100 2026-02-23T08:14:30.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:31.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:14:31.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:32.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566102 -lt 450971566100 2026-02-23T08:14:32.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:32.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-519691042819 2026-02-23T08:14:32.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:32.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:32.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-519691042819 2026-02-23T08:14:32.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:32.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=519691042819 2026-02-23T08:14:32.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 519691042819' 2026-02-23T08:14:32.039 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 519691042819 2026-02-23T08:14:32.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:32.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 519691042821 -lt 519691042819 2026-02-23T08:14:32.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:32.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:32.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:32.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:32.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:32.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:32.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:32.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:32.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:32.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:32.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:32.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:32.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:32.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:32.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:32.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:32.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:32.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:32.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6545: TEST_dual_store_replicated_cluster: echo -n D 2026-02-23T08:14:32.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6546: TEST_dual_store_replicated_cluster: rados --pool csr_pool put ROBJ9 td/osd-scrub-repair/change 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6547: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:32.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:32.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:32.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:32.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:32.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:32.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:32.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:14:32.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:32.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:32.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:32.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:32.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:32.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ9 set-attr _ td/osd-scrub-repair/robj9-oi 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:33.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:33.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:33.086 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:33.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:33.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:33.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:33.100 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:33.100+0000 7fbf0bc13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:33.102 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:33.101+0000 7fbf0bc13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:33.103 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:33.102+0000 7fbf0bc13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:33.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:33.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:33.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:33.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:33.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:33.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:33.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:33.253 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:33.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:33.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:33.295 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:33.294+0000 7fbf0bc13780 -1 Falling back to public interface 2026-02-23T08:14:33.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:33.646 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:33.645+0000 7fbf0bc13780 -1 osd.1 123 log_to_monitors true 2026-02-23T08:14:34.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:34.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:34.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:34.419 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:34.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:34.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 127 up_thru 127 down_at 124 last_clean_interval [121,123) [v2:127.0.0.1:6810/886936703,v1:127.0.0.1:6811/886936703] [v2:127.0.0.1:6812/886936703,v1:127.0.0.1:6813/886936703] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:34.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:34.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:34.586 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:34.586 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:34.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:34.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:34.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:34.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:34.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:34.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:34.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:34.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:34.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:34.834 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:34.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=450971566106 2026-02-23T08:14:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 450971566106 2026-02-23T08:14:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566106' 2026-02-23T08:14:34.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:34.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:34.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=545460846595 2026-02-23T08:14:34.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 545460846595 2026-02-23T08:14:34.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-450971566106 1-545460846595' 2026-02-23T08:14:34.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:34.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-450971566106 2026-02-23T08:14:34.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:34.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-450971566106 2026-02-23T08:14:34.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:34.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=450971566106 2026-02-23T08:14:34.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 450971566106' 2026-02-23T08:14:34.985 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 450971566106 2026-02-23T08:14:34.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566104 -lt 450971566106 2026-02-23T08:14:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:36.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:36.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:36.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 450971566107 -lt 450971566106 2026-02-23T08:14:36.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:36.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-545460846595 2026-02-23T08:14:36.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:36.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:36.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-545460846595 2026-02-23T08:14:36.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:36.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=545460846595 2026-02-23T08:14:36.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 545460846595' 2026-02-23T08:14:36.320 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 545460846595 2026-02-23T08:14:36.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:36.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 545460846595 -lt 545460846595 2026-02-23T08:14:36.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:36.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:36.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:36.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:36.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:36.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:36.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:36.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:36.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:37.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:37.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:37.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:37.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6548: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/oi td/osd-scrub-repair/change 2026-02-23T08:14:37.062 INFO:tasks.workunit.client.0.trial129.stderr:rm: cannot remove 'td/osd-scrub-repair/oi': No such file or directory 2026-02-23T08:14:37.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:37.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ10 2026-02-23T08:14:37.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 10 % 2 2026-02-23T08:14:37.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:14:37.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:37.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:37.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ11 2026-02-23T08:14:37.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 11 % 2 2026-02-23T08:14:37.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:14:37.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:37.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:37.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ12 2026-02-23T08:14:37.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 12 % 2 2026-02-23T08:14:37.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:14:37.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:37.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:37.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ13 2026-02-23T08:14:37.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 13 % 2 2026-02-23T08:14:37.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:14:37.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:37.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:37.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ14 2026-02-23T08:14:37.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 14 % 2 2026-02-23T08:14:37.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:14:37.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6557: TEST_dual_store_replicated_cluster: echo -n bad-val 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6558: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:37.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:14:37.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:37.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:37.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:37.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:37.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:37.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ14 set-attr _ td/osd-scrub-repair/bad-val 2026-02-23T08:14:37.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:37.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:37.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:14:37.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:37.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:37.541 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:37.540+0000 7ff641588780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:37.542 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:37.541+0000 7ff641588780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:37.543 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:37.542+0000 7ff641588780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:37.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:14:37.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:37.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:14:37.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:37.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:37.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:37.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:37.693 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:37.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:37.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:37.752 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:37.751+0000 7ff641588780 -1 Falling back to public interface 2026-02-23T08:14:37.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:38.094 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:38.093+0000 7ff641588780 -1 osd.0 129 log_to_monitors true 2026-02-23T08:14:38.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:38.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:38.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:38.861 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:38.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:38.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:39.027 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 133 up_thru 133 down_at 130 last_clean_interval [105,129) [v2:127.0.0.1:6800/2072924594,v1:127.0.0.1:6801/2072924594] [v2:127.0.0.1:6802/2072924594,v1:127.0.0.1:6803/2072924594] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:14:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:39.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:39.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:39.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:39.029 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:39.029 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:39.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:39.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:39.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:39.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:39.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:39.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:39.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:39.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:39.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:39.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:39.275 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:39.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:39.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:39.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:39.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=571230650371 2026-02-23T08:14:39.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 571230650371 2026-02-23T08:14:39.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-571230650371' 2026-02-23T08:14:39.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:39.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=545460846600 2026-02-23T08:14:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 545460846600 2026-02-23T08:14:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-571230650371 1-545460846600' 2026-02-23T08:14:39.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:39.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-571230650371 2026-02-23T08:14:39.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:39.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:39.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-571230650371 2026-02-23T08:14:39.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:39.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=571230650371 2026-02-23T08:14:39.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 571230650371' 2026-02-23T08:14:39.423 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 571230650371 2026-02-23T08:14:39.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:39.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650370 -lt 571230650371 2026-02-23T08:14:39.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:40.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:40.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:40.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650370 -lt 571230650371 2026-02-23T08:14:40.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:41.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:14:41.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:41.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650373 -lt 571230650371 2026-02-23T08:14:41.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:41.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-545460846600 2026-02-23T08:14:41.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:41.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:41.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-545460846600 2026-02-23T08:14:41.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:41.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=545460846600 2026-02-23T08:14:41.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 545460846600' 2026-02-23T08:14:41.928 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 545460846600 2026-02-23T08:14:41.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:42.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 545460846602 -lt 545460846600 2026-02-23T08:14:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:42.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:42.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:42.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:42.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:42.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:42.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:42.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:42.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:42.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6559: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:42.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:42.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:42.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:42.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:42.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ14 rm-attr _ 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:42.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ14 rm-attr _ 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:43.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:43.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:43.143 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:43.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:43.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:43.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:43.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:43.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:43.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:43.158 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:43.158+0000 7f3262809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:43.160 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:43.159+0000 7f3262809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:43.161 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:43.160+0000 7f3262809780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:43.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:43.311 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:43.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:43.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:43.354 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:43.353+0000 7f3262809780 -1 Falling back to public interface 2026-02-23T08:14:43.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:43.719 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:43.718+0000 7f3262809780 -1 osd.1 134 log_to_monitors true 2026-02-23T08:14:44.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:44.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:44.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:44.478 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:44.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:44.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:44.644 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 138 up_thru 138 down_at 135 last_clean_interval [127,134) [v2:127.0.0.1:6810/708386904,v1:127.0.0.1:6811/708386904] [v2:127.0.0.1:6812/708386904,v1:127.0.0.1:6813/708386904] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:44.645 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:44.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:44.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:44.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:44.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:44.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:44.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:44.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:44.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:44.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:44.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:44.893 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:44.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:44.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:44.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:44.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=571230650377 2026-02-23T08:14:44.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 571230650377 2026-02-23T08:14:44.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-571230650377' 2026-02-23T08:14:44.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:44.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:45.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=592705486851 2026-02-23T08:14:45.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 592705486851 2026-02-23T08:14:45.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-571230650377 1-592705486851' 2026-02-23T08:14:45.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:45.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-571230650377 2026-02-23T08:14:45.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:45.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:45.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-571230650377 2026-02-23T08:14:45.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=571230650377 2026-02-23T08:14:45.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 571230650377' 2026-02-23T08:14:45.043 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 571230650377 2026-02-23T08:14:45.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:45.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650375 -lt 571230650377 2026-02-23T08:14:45.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:46.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:46.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:46.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650378 -lt 571230650377 2026-02-23T08:14:46.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:46.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-592705486851 2026-02-23T08:14:46.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:46.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:46.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-592705486851 2026-02-23T08:14:46.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:46.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=592705486851 2026-02-23T08:14:46.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 592705486851' 2026-02-23T08:14:46.381 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 592705486851 2026-02-23T08:14:46.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:46.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 592705486851 -lt 592705486851 2026-02-23T08:14:46.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:46.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:46.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:46.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:46.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:46.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:46.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:46.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:46.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:46.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:46.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:46.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:46.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:47.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:47.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:47.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:47.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6560: TEST_dual_store_replicated_cluster: rm td/osd-scrub-repair/bad-val 2026-02-23T08:14:47.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:47.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ15 2026-02-23T08:14:47.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 15 % 2 2026-02-23T08:14:47.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:14:47.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:47.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6564: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-23T08:14:47.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:47.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:47.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:47.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ15 rm-attr _ 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:47.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:47.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ15 rm-attr _ 2026-02-23T08:14:47.546 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:47.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:47.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:47.623 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:47.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:47.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:47.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:47.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:47.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:47.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:47.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:47.633+0000 7fa4f1150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:47.636 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:47.635+0000 7fa4f1150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:47.636 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:47.636+0000 7fa4f1150780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:47.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:47.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:47.842 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:47.841+0000 7fa4f1150780 -1 Falling back to public interface 2026-02-23T08:14:47.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:48.189 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:48.188+0000 7fa4f1150780 -1 osd.1 140 log_to_monitors true 2026-02-23T08:14:48.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:48.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:48.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:48.956 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:48.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:48.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 144 up_thru 144 down_at 141 last_clean_interval [138,140) [v2:127.0.0.1:6810/2088796547,v1:127.0.0.1:6811/2088796547] [v2:127.0.0.1:6812/2088796547,v1:127.0.0.1:6813/2088796547] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:49.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:49.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:49.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:49.123 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:49.123 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:49.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:49.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:49.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:49.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:49.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:49.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:49.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:49.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:49.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:49.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:49.369 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:49.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:49.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:49.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:49.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=571230650383 2026-02-23T08:14:49.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 571230650383 2026-02-23T08:14:49.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-571230650383' 2026-02-23T08:14:49.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:49.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:49.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=618475290627 2026-02-23T08:14:49.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 618475290627 2026-02-23T08:14:49.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-571230650383 1-618475290627' 2026-02-23T08:14:49.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:49.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-571230650383 2026-02-23T08:14:49.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:49.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:49.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-571230650383 2026-02-23T08:14:49.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:49.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=571230650383 2026-02-23T08:14:49.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 571230650383' 2026-02-23T08:14:49.519 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 571230650383 2026-02-23T08:14:49.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650382 -lt 571230650383 2026-02-23T08:14:49.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:50.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:50.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:50.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650382 -lt 571230650383 2026-02-23T08:14:50.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:51.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:14:51.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:52.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650385 -lt 571230650383 2026-02-23T08:14:52.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:52.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-618475290627 2026-02-23T08:14:52.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:52.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:52.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-618475290627 2026-02-23T08:14:52.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:52.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=618475290627 2026-02-23T08:14:52.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 618475290627' 2026-02-23T08:14:52.024 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 618475290627 2026-02-23T08:14:52.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:52.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290629 -lt 618475290627 2026-02-23T08:14:52.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:52.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:52.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:52.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:52.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:52.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:52.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:52.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:52.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:52.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:52.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:52.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:52.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:52.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:14:52.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ16 2026-02-23T08:14:52.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 16 % 2 2026-02-23T08:14:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:14:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6568: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:14:52.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:52.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:52.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:52.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:52.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:52.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ16 rm-attr snapset 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:52.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ16 rm-attr snapset 2026-02-23T08:14:52.994 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:53.051 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:14:53.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:53.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:14:53.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:14:53.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:53.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:53.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:53.065 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:53.064+0000 7fbbf4406780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:53.066 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:53.065+0000 7fbbf4406780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:53.067 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:53.066+0000 7fbbf4406780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:53.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:14:53.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:53.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:53.265 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:53.265+0000 7fbbf4406780 -1 Falling back to public interface 2026-02-23T08:14:53.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:53.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:53.653+0000 7fbbf4406780 -1 osd.0 145 log_to_monitors true 2026-02-23T08:14:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:54.387 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 149 up_thru 149 down_at 146 last_clean_interval [133,145) [v2:127.0.0.1:6800/1307088137,v1:127.0.0.1:6801/1307088137] [v2:127.0.0.1:6802/1307088137,v1:127.0.0.1:6803/1307088137] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:54.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:54.554 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:54.554 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:54.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:54.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:54.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:54.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:54.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:54.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:54.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:54.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:54.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:54.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:54.803 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:54.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:54.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:54.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:54.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127107 2026-02-23T08:14:54.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127107 2026-02-23T08:14:54.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127107' 2026-02-23T08:14:54.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:54.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:54.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=618475290633 2026-02-23T08:14:54.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 618475290633 2026-02-23T08:14:54.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127107 1-618475290633' 2026-02-23T08:14:54.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:54.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127107 2026-02-23T08:14:54.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:54.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:54.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127107 2026-02-23T08:14:54.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127107 2026-02-23T08:14:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127107' 2026-02-23T08:14:54.952 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 639950127107 2026-02-23T08:14:54.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 571230650386 -lt 639950127107 2026-02-23T08:14:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:14:56.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:14:56.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:56.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127107 -lt 639950127107 2026-02-23T08:14:56.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-618475290633 2026-02-23T08:14:56.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:56.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:56.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-618475290633 2026-02-23T08:14:56.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:56.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=618475290633 2026-02-23T08:14:56.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 618475290633' 2026-02-23T08:14:56.290 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 618475290633 2026-02-23T08:14:56.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:56.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 618475290634 -lt 618475290633 2026-02-23T08:14:56.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:14:56.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:56.460 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:56.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:14:56.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:14:56.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:14:56.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:14:56.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:14:56.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:14:56.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:14:56.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:14:56.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:14:56.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:14:56.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:14:56.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:14:57.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6569: TEST_dual_store_replicated_cluster: echo -n bad-val 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6570: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:14:57.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:14:57.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:14:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:14:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:14:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:14:57.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:14:57.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:14:57.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:14:57.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:57.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ16 set-attr snapset td/osd-scrub-repair/bad-val 2026-02-23T08:14:57.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:14:57.459 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:14:57.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:57.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:14:57.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:14:57.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:14:57.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:14:57.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:14:57.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:14:57.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:14:57.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:14:57.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:14:57.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:14:57.530 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:57.530+0000 7fc05334b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:57.532 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:57.531+0000 7fc05334b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:57.532 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:57.532+0000 7fc05334b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:14:57.683 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:14:57.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:57.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:57.756 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:57.755+0000 7fc05334b780 -1 Falling back to public interface 2026-02-23T08:14:57.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:14:58.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:14:58.096+0000 7fc05334b780 -1 osd.1 150 log_to_monitors true 2026-02-23T08:14:58.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:14:58.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:14:58.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:14:58.850 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:14:58.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:14:58.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:14:59.016 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 154 up_thru 154 down_at 151 last_clean_interval [144,150) [v2:127.0.0.1:6810/1238746454,v1:127.0.0.1:6811/1238746454] [v2:127.0.0.1:6812/1238746454,v1:127.0.0.1:6813/1238746454] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:14:59.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:14:59.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:14:59.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:14:59.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:14:59.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:14:59.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:14:59.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:14:59.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:14:59.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:14:59.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:14:59.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:14:59.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:14:59.263 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:14:59.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:14:59.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:59.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:14:59.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=639950127112 2026-02-23T08:14:59.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 639950127112 2026-02-23T08:14:59.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127112' 2026-02-23T08:14:59.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:14:59.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:14:59.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963587 2026-02-23T08:14:59.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963587 2026-02-23T08:14:59.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-639950127112 1-661424963587' 2026-02-23T08:14:59.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:59.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-639950127112 2026-02-23T08:14:59.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:59.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:14:59.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-639950127112 2026-02-23T08:14:59.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:59.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=639950127112 2026-02-23T08:14:59.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 639950127112' 2026-02-23T08:14:59.413 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 639950127112 2026-02-23T08:14:59.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:14:59.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127112 -lt 639950127112 2026-02-23T08:14:59.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:14:59.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963587 2026-02-23T08:14:59.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:14:59.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:14:59.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963587 2026-02-23T08:14:59.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:14:59.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963587 2026-02-23T08:14:59.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963587' 2026-02-23T08:14:59.585 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 661424963587 2026-02-23T08:14:59.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:14:59.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963586 -lt 661424963587 2026-02-23T08:14:59.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:00.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:00.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:00.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963586 -lt 661424963587 2026-02-23T08:15:00.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:01.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:15:01.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:02.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963589 -lt 661424963587 2026-02-23T08:15:02.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:15:02.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:02.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:02.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:15:02.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:15:02.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:15:02.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:15:02.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:15:02.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:15:02.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:15:02.290 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:15:02.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:15:02.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:15:02.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:02.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:02.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:15:02.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:15:02.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:15:02.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:15:02.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ17 2026-02-23T08:15:02.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 17 % 2 2026-02-23T08:15:02.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:15:02.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:15:02.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6575: TEST_dual_store_replicated_cluster: local payload=ROBJ17 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6576: TEST_dual_store_replicated_cluster: echo ROBJ17 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6577: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:15:02.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:15:02.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:15:02.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:02.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:02.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:02.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:02.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:15:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:15:02.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:15:02.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:15:02.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:15:02.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:03.069 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:15:03.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:15:03.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:15:03.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:15:03.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:15:03.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:15:03.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:15:03.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:15:03.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:15:03.132 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:03.131+0000 7f309d549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:03.134 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:03.133+0000 7f309d549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:03.135 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:03.134+0000 7f309d549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:03.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:15:03.361 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:03.360+0000 7f309d549780 -1 Falling back to public interface 2026-02-23T08:15:03.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:15:03.696 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:03.694+0000 7f309d549780 -1 osd.0 156 log_to_monitors true 2026-02-23T08:15:04.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:15:04.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:04.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:15:04.450 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:15:04.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:04.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:15:04.616 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 160 up_thru 160 down_at 157 last_clean_interval [149,156) [v2:127.0.0.1:6800/777871295,v1:127.0.0.1:6801/777871295] [v2:127.0.0.1:6802/777871295,v1:127.0.0.1:6803/777871295] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:15:04.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:15:04.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:15:04.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:15:04.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:15:04.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:15:04.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:15:04.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:15:04.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:15:04.618 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:04.618 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:04.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:04.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:04.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:04.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:15:04.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:15:04.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:15:04.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:15:04.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:04.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:04.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:04.865 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:04.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:04.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:04.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:04.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767363 2026-02-23T08:15:04.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767363 2026-02-23T08:15:04.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767363' 2026-02-23T08:15:04.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:04.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:05.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=661424963593 2026-02-23T08:15:05.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 661424963593 2026-02-23T08:15:05.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767363 1-661424963593' 2026-02-23T08:15:05.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:05.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767363 2026-02-23T08:15:05.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:05.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:05.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767363 2026-02-23T08:15:05.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:05.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767363 2026-02-23T08:15:05.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767363' 2026-02-23T08:15:05.012 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 687194767363 2026-02-23T08:15:05.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:05.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 639950127115 -lt 687194767363 2026-02-23T08:15:05.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:06.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767363 -lt 687194767363 2026-02-23T08:15:06.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:06.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-661424963593 2026-02-23T08:15:06.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:06.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:06.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-661424963593 2026-02-23T08:15:06.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:06.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=661424963593 2026-02-23T08:15:06.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 661424963593' 2026-02-23T08:15:06.357 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 661424963593 2026-02-23T08:15:06.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:06.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 661424963594 -lt 661424963593 2026-02-23T08:15:06.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:15:06.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:06.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:06.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:15:06.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:15:06.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:15:06.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:15:06.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:15:06.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:15:06.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:15:06.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:15:06.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:15:06.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:15:06.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:06.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:07.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:15:07.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:15:07.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6578: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:15:07.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:07.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:15:07.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ17 set-bytes td/osd-scrub-repair/new.ROBJ17 2026-02-23T08:15:07.511 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:15:07.511 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:15:07.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:15:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:15:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:07.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:15:07.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:15:07.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:15:07.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:15:07.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:15:07.578 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:07.577+0000 7f6d8b762780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:07.579 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:07.578+0000 7f6d8b762780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:07.580 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:07.579+0000 7f6d8b762780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:15:07.728 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:15:07.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:07.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:15:07.768 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:07.767+0000 7f6d8b762780 -1 Falling back to public interface 2026-02-23T08:15:07.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:15:08.113 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:08.112+0000 7f6d8b762780 -1 osd.1 161 log_to_monitors true 2026-02-23T08:15:08.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:15:08.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:08.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:15:08.896 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:15:08.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:08.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 165 up_thru 165 down_at 162 last_clean_interval [154,161) [v2:127.0.0.1:6810/2617681075,v1:127.0.0.1:6811/2617681075] [v2:127.0.0.1:6812/2617681075,v1:127.0.0.1:6813/2617681075] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:15:09.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:15:09.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:15:09.062 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:09.062 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:09.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:09.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:09.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:09.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:15:09.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:15:09.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:15:09.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:15:09.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:09.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:09.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:09.315 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:09.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:09.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:09.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:09.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=687194767368 2026-02-23T08:15:09.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 687194767368 2026-02-23T08:15:09.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767368' 2026-02-23T08:15:09.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:09.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:09.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603843 2026-02-23T08:15:09.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603843 2026-02-23T08:15:09.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-687194767368 1-708669603843' 2026-02-23T08:15:09.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:09.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-687194767368 2026-02-23T08:15:09.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:09.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:09.463 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-687194767368 2026-02-23T08:15:09.463 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:09.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=687194767368 2026-02-23T08:15:09.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 687194767368' 2026-02-23T08:15:09.465 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 687194767368 2026-02-23T08:15:09.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:09.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767367 -lt 687194767368 2026-02-23T08:15:09.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:10.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:10.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767367 -lt 687194767368 2026-02-23T08:15:10.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:11.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:15:11.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:11.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767370 -lt 687194767368 2026-02-23T08:15:11.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:11.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603843 2026-02-23T08:15:11.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:11.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:11.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603843 2026-02-23T08:15:11.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:11.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603843 2026-02-23T08:15:11.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603843' 2026-02-23T08:15:11.973 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 708669603843 2026-02-23T08:15:11.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:12.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603845 -lt 708669603843 2026-02-23T08:15:12.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:15:12.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:12.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:12.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:15:12.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:15:12.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:15:12.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:15:12.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:12.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:12.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:15:12.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:15:12.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:15:12.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:15:12.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ18 2026-02-23T08:15:12.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 18 % 2 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=0 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6583: TEST_dual_store_replicated_cluster: local payload=ROBJ18 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6584: TEST_dual_store_replicated_cluster: echo ROBJ18 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6585: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:15:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:12.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:13.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:13.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:13.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:15:13.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:15:13.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:15:13.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:15:13.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:15:13.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:13.138 INFO:tasks.workunit.client.0.trial129.stderr:Error decoding attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (22) Invalid argument 2026-02-23T08:15:13.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:15:13.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:15:13.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:15:13.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:13.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:15:13.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:15:13.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:15:13.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:15:13.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:15:13.210 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:13.209+0000 7f8bd8b46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:13.211 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:13.210+0000 7f8bd8b46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:13.212 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:13.211+0000 7f8bd8b46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:13.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:13.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:15:13.407 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:13.406+0000 7f8bd8b46780 -1 Falling back to public interface 2026-02-23T08:15:13.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:15:13.763 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:13.762+0000 7f8bd8b46780 -1 osd.0 167 log_to_monitors true 2026-02-23T08:15:14.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:15:14.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:14.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:15:14.527 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:15:14.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:14.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 171 up_thru 171 down_at 168 last_clean_interval [160,167) [v2:127.0.0.1:6800/3571128314,v1:127.0.0.1:6801/3571128314] [v2:127.0.0.1:6802/3571128314,v1:127.0.0.1:6803/3571128314] exists,up e0a2b4ee-d5fc-45b1-808e-155de08c0e97 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:15:14.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:15:14.694 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:14.694 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:14.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:14.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:14.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:14.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:15:14.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:15:14.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:15:14.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:15:14.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:14.778 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:14.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:14.948 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:14.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:14.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:14.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:15.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407619 2026-02-23T08:15:15.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407619 2026-02-23T08:15:15.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407619' 2026-02-23T08:15:15.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:15.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:15.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=708669603849 2026-02-23T08:15:15.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 708669603849 2026-02-23T08:15:15.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407619 1-708669603849' 2026-02-23T08:15:15.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407619 2026-02-23T08:15:15.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:15.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:15.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407619 2026-02-23T08:15:15.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407619 2026-02-23T08:15:15.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407619' 2026-02-23T08:15:15.099 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 734439407619 2026-02-23T08:15:15.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:15.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 687194767372 -lt 734439407619 2026-02-23T08:15:15.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:16.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:16.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:16.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407619 -lt 734439407619 2026-02-23T08:15:16.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:16.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-708669603849 2026-02-23T08:15:16.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:16.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:16.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-708669603849 2026-02-23T08:15:16.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:16.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=708669603849 2026-02-23T08:15:16.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 708669603849' 2026-02-23T08:15:16.437 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 708669603849 2026-02-23T08:15:16.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:16.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 708669603850 -lt 708669603849 2026-02-23T08:15:16.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:15:16.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:16.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:15:16.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:15:16.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:15:16.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:15:16.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:15:16.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:16.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:17.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:15:17.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:15:17.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:15:17.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6586: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:17.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:17.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:17.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:17.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:17.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:17.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:15:17.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 set-bytes td/osd-scrub-repair/new.ROBJ18 2026-02-23T08:15:17.407 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:15:17.407 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:15:17.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:17.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:15:17.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:15:17.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:15:17.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:15:17.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:17.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:15:17.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:15:17.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:15:17.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:15:17.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:15:17.481 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:17.480+0000 7fa6c1a7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:17.482 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:17.481+0000 7fa6c1a7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:17.483 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:17.482+0000 7fa6c1a7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:17.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:15:17.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:15:17.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:17.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:15:17.706 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:17.705+0000 7fa6c1a7e780 -1 Falling back to public interface 2026-02-23T08:15:17.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:15:18.074 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:18.073+0000 7fa6c1a7e780 -1 osd.1 172 log_to_monitors true 2026-02-23T08:15:18.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:15:18.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:18.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:15:18.798 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:15:18.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:18.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:15:18.967 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 176 up_thru 176 down_at 173 last_clean_interval [165,172) [v2:127.0.0.1:6810/771559204,v1:127.0.0.1:6811/771559204] [v2:127.0.0.1:6812/771559204,v1:127.0.0.1:6813/771559204] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:18.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:18.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:18.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:15:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:15:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:15:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:15:19.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:19.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:19.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:19.215 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:19.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:19.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:19.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:19.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407624 2026-02-23T08:15:19.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407624 2026-02-23T08:15:19.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407624' 2026-02-23T08:15:19.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:19.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:19.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=755914244099 2026-02-23T08:15:19.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 755914244099 2026-02-23T08:15:19.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407624 1-755914244099' 2026-02-23T08:15:19.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:19.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407624 2026-02-23T08:15:19.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:19.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:19.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407624 2026-02-23T08:15:19.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:19.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407624 2026-02-23T08:15:19.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407624' 2026-02-23T08:15:19.371 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 734439407624 2026-02-23T08:15:19.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:19.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407624 -lt 734439407624 2026-02-23T08:15:19.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:19.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-755914244099 2026-02-23T08:15:19.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:19.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:19.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-755914244099 2026-02-23T08:15:19.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:19.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=755914244099 2026-02-23T08:15:19.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 755914244099' 2026-02-23T08:15:19.541 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 755914244099 2026-02-23T08:15:19.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:19.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 755914244098 -lt 755914244099 2026-02-23T08:15:19.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:20.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:20.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:20.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 755914244098 -lt 755914244099 2026-02-23T08:15:20.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:21.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:15:21.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:22.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 755914244101 -lt 755914244099 2026-02-23T08:15:22.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:15:22.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:22.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:22.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:15:22.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:15:22.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:15:22.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:15:22.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:15:22.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:15:22.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:15:22.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:15:22.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:15:22.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:15:22.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:22.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6588: TEST_dual_store_replicated_cluster: objectstore_tool td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:22.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:22.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:22.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:22.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 1 ROBJ18 corrupt-info 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:15:22.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 ROBJ18 corrupt-info 2026-02-23T08:15:23.003 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:30259878:::ROBJ15:head#, (61) No data available 2026-02-23T08:15:23.003 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 3.0_head,#3:c0c86b1d:::ROBJ14:head#, (61) No data available 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:15:23.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:15:23.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0' 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:15:23.062 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:15:23.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --osd_op_queue=wpq --osd_scrub_auto_repair=0 2026-02-23T08:15:23.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:15:23.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:15:23.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:15:23.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:15:23.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:15:23.077 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:23.076+0000 7f23def50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:23.078 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:23.078+0000 7f23def50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:23.079 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:23.078+0000 7f23def50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:15:23.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:15:23.231 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:15:23.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:23.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:15:23.304 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:23.303+0000 7f23def50780 -1 Falling back to public interface 2026-02-23T08:15:23.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:15:23.634 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:15:23.633+0000 7f23def50780 -1 osd.1 177 log_to_monitors true 2026-02-23T08:15:24.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:15:24.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:15:24.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:15:24.395 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:15:24.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:15:24.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:15:24.559 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 181 up_thru 181 down_at 178 last_clean_interval [176,177) [v2:127.0.0.1:6810/3813494481,v1:127.0.0.1:6811/3813494481] [v2:127.0.0.1:6812/3813494481,v1:127.0.0.1:6813/3813494481] exists,up bfcc5c4f-e0d3-4d2c-82e7-31bd0e1d658c 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:24.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:24.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:24.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:24.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:24.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:15:24.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:15:24.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:15:24.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:15:24.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:24.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:24.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:24.811 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:24.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:24.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:24.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:24.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407631 2026-02-23T08:15:24.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407631 2026-02-23T08:15:24.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407631' 2026-02-23T08:15:24.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:24.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:24.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080579 2026-02-23T08:15:24.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080579 2026-02-23T08:15:24.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407631 1-777389080579' 2026-02-23T08:15:24.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:24.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407631 2026-02-23T08:15:24.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:24.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:24.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407631 2026-02-23T08:15:24.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:24.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407631 2026-02-23T08:15:24.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407631' 2026-02-23T08:15:24.960 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 734439407631 2026-02-23T08:15:24.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:25.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407628 -lt 734439407631 2026-02-23T08:15:25.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:26.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:26.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:26.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407631 -lt 734439407631 2026-02-23T08:15:26.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:26.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080579 2026-02-23T08:15:26.294 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:26.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:26.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080579 2026-02-23T08:15:26.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:26.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080579 2026-02-23T08:15:26.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080579' 2026-02-23T08:15:26.297 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 777389080579 2026-02-23T08:15:26.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:26.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080579 -lt 777389080579 2026-02-23T08:15:26.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:15:26.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:26.463 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:26.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:15:26.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:15:26.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:15:26.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:15:26.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:15:26.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:15:26.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:15:26.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:15:26.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:15:26.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:15:26.835 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:15:26.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:15:27.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:15:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:15:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:15:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6480: TEST_dual_store_replicated_cluster: for i in $(seq 1 $total_objs) 2026-02-23T08:15:27.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6481: TEST_dual_store_replicated_cluster: objname=ROBJ19 2026-02-23T08:15:27.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: expr 19 % 2 2026-02-23T08:15:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6484: TEST_dual_store_replicated_cluster: local osd=1 2026-02-23T08:15:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6486: TEST_dual_store_replicated_cluster: case $i in 2026-02-23T08:15:27.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6597: TEST_dual_store_replicated_cluster: get_pg csr_pool ROBJ0 2026-02-23T08:15:27.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=csr_pool 2026-02-23T08:15:27.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=ROBJ0 2026-02-23T08:15:27.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map csr_pool ROBJ0 2026-02-23T08:15:27.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:15:27.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6597: TEST_dual_store_replicated_cluster: local pg=3.0 2026-02-23T08:15:27.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6599: TEST_dual_store_replicated_cluster: ceph tell 'osd.*' injectargs -- --osd-max-object-size=1048576 2026-02-23T08:15:27.273 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: {} 2026-02-23T08:15:27.274 INFO:tasks.workunit.client.0.trial129.stderr:osd.0: osd_max_object_size = '' 2026-02-23T08:15:27.282 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: {} 2026-02-23T08:15:27.283 INFO:tasks.workunit.client.0.trial129.stderr:osd.1: osd_max_object_size = '' 2026-02-23T08:15:27.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6601: TEST_dual_store_replicated_cluster: inject_eio rep data csr_pool ROBJ11 td/osd-scrub-repair 0 2026-02-23T08:15:27.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:15:27.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:15:27.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ11 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ11 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:15:27.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ11 2026-02-23T08:15:27.296 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ11 2026-02-23T08:15:27.296 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:15:27.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:15:27.465 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:15:27.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-23T08:15:27.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:15:27.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:15:27.469 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:27.469 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:27.469 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:27.469 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:15:27.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:15:27.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:15:27.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:15:27.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:15:27.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-23T08:15:27.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:15:27.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:15:27.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:27.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:27.537 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:27.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:15:27.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:15:27.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.1.asok injectdataerr csr_pool ROBJ11 2026-02-23T08:15:27.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6602: TEST_dual_store_replicated_cluster: inject_eio rep mdata csr_pool ROBJ12 td/osd-scrub-repair 1 2026-02-23T08:15:27.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:15:27.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:15:27.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ12 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ12 2026-02-23T08:15:27.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:15:27.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ12 2026-02-23T08:15:27.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ12 2026-02-23T08:15:27.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-23T08:15:27.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:15:27.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:15:27.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-23T08:15:27.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:15:27.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-23T08:15:27.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:15:27.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-23T08:15:27.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:15:27.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:15:27.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:15:27.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-23T08:15:27.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:15:27.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:15:27.773 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:27.774 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:27.774 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:27.774 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:15:27.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:15:27.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:15:27.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:15:27.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:15:27.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.0.asok injectmdataerr csr_pool ROBJ12 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6603: TEST_dual_store_replicated_cluster: inject_eio rep data csr_pool ROBJ13 td/osd-scrub-repair 0 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:15:27.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:15:27.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-23T08:15:27.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:15:27.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:15:27.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:15:27.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-23T08:15:27.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:15:27.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-23T08:15:27.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:15:27.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-23T08:15:27.904 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-23T08:15:27.904 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:15:28.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:15:28.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/1/type 2026-02-23T08:15:28.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:15:28.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-23T08:15:28.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:15:28.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-23T08:15:28.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:15:28.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:15:28.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:15:28.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:15:28.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:15:28.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-23T08:15:28.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:15:28.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:15:28.139 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:28.139 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:28.139 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:28.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.1.asok 2026-02-23T08:15:28.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:15:28.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.1.asok injectdataerr csr_pool ROBJ13 2026-02-23T08:15:28.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6606: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-23T08:15:28.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:15:28.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:15:28.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:15:28.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:15:28.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:28.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:28.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:28.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:28.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:28.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:15:28.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:15:28.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:15:28.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:15:28.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:28.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:28.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:28.570 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:28.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:28.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:28.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:28.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407635 2026-02-23T08:15:28.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407635 2026-02-23T08:15:28.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407635' 2026-02-23T08:15:28.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:28.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:28.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080584 2026-02-23T08:15:28.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080584 2026-02-23T08:15:28.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407635 1-777389080584' 2026-02-23T08:15:28.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:28.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407635 2026-02-23T08:15:28.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:28.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:28.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407635 2026-02-23T08:15:28.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:28.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407635 2026-02-23T08:15:28.720 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407635 2026-02-23T08:15:28.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407635' 2026-02-23T08:15:28.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:28.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407633 -lt 734439407635 2026-02-23T08:15:28.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:29.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:29.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:30.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407636 -lt 734439407635 2026-02-23T08:15:30.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:30.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080584 2026-02-23T08:15:30.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:30.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:30.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080584 2026-02-23T08:15:30.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:30.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080584 2026-02-23T08:15:30.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080584' 2026-02-23T08:15:30.062 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080584 2026-02-23T08:15:30.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:30.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080584 -lt 777389080584 2026-02-23T08:15:30.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:15:30.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:15:30.229 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:15:30.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:15:30.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:15:30.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:15:30.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:15:30.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:15:30.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:15:30.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:15:30.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:15:30.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:15:30.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:15:30.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:30.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:30.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:30.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:30.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:30.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:15:30.621 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-23T08:15:30.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:30.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:15:30.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:30.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:30.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:30.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:30.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:31.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:31.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:31.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:31.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:31.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:31.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:31.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:31.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:31.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:32.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:32.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:32.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:32.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:32.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:32.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:32.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:33.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:33.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:34.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:34.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:34.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:34.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:34.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:34.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:34.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:34.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:31.563408+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6607: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6608: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:15:34.300 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:34.301 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:34.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:34.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:34.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:34.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:15:34.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:15:34.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:15:34.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:15:34.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:34.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:34.668 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:34.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:34.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:34.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407642 2026-02-23T08:15:34.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407642 2026-02-23T08:15:34.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407642' 2026-02-23T08:15:34.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:34.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:34.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080591 2026-02-23T08:15:34.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080591 2026-02-23T08:15:34.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407642 1-777389080591' 2026-02-23T08:15:34.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:34.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407642 2026-02-23T08:15:34.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:34.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:34.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407642 2026-02-23T08:15:34.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:34.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407642 2026-02-23T08:15:34.821 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407642 2026-02-23T08:15:34.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407642' 2026-02-23T08:15:34.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:34.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407640 -lt 734439407642 2026-02-23T08:15:34.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:35.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:35.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:36.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407643 -lt 734439407642 2026-02-23T08:15:36.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:36.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080591 2026-02-23T08:15:36.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:36.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:36.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080591 2026-02-23T08:15:36.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:36.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080591 2026-02-23T08:15:36.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080591' 2026-02-23T08:15:36.162 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080591 2026-02-23T08:15:36.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:36.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080591 -lt 777389080591 2026-02-23T08:15:36.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:15:36.329 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:15:36.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:15:36.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:15:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:15:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:15:36.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:15:36.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:15:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:15:36.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:36.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:15:36.720 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-23T08:15:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:15:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:15:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:15:36.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:36.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:36.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:31.563408+0000 '>' 2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:36.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:37.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:37.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:37.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:37.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:37.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:37.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:37.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:38.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:31.563408+0000 '>' 2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:38.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:39.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:39.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:39.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:39.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:39.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:39.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:39.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:39.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:31.563408+0000 '>' 2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:39.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:40.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:40.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:40.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:40.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:40.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:40.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:40.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:40.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:37.584505+0000 '>' 2026-02-23T08:15:31.563408+0000 2026-02-23T08:15:40.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:15:40.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6609: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:40.397 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:40.398 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:40.398 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:40.398 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:40.398 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:40.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6610: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:40.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6611: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:40.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6614: TEST_dual_store_replicated_cluster: pg_deep_scrub 3.0 2026-02-23T08:15:40.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:15:40.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:15:40.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:15:40.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:15:40.420 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:40.420 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:40.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:40.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:40.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:40.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:15:40.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:15:40.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:15:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:15:40.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:40.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:40.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:40.786 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:40.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:40.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:40.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:40.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407650 2026-02-23T08:15:40.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407650 2026-02-23T08:15:40.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407650' 2026-02-23T08:15:40.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:40.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:40.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080598 2026-02-23T08:15:40.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080598 2026-02-23T08:15:40.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407650 1-777389080598' 2026-02-23T08:15:40.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:40.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407650 2026-02-23T08:15:40.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:40.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:40.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407650 2026-02-23T08:15:40.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:40.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407650 2026-02-23T08:15:40.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407650' 2026-02-23T08:15:40.938 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407650 2026-02-23T08:15:40.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:41.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407647 -lt 734439407650 2026-02-23T08:15:41.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:42.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:42.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:42.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407650 -lt 734439407650 2026-02-23T08:15:42.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:42.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080598 2026-02-23T08:15:42.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:42.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:42.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080598 2026-02-23T08:15:42.272 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:42.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080598 2026-02-23T08:15:42.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080598' 2026-02-23T08:15:42.274 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080598 2026-02-23T08:15:42.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:42.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080598 -lt 777389080598 2026-02-23T08:15:42.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:15:42.437 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:15:42.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:15:42.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:15:42.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:15:42.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:15:42.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:15:42.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:15:42.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:15:42.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:42.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:42.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:42.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:15:42.831 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:13:38.548323+0000 last_deep_scrub_stamp 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:42.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:42.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:42.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:43.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:43.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:44.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:44.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:44.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:44.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:44.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:44.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:44.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:44.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:44.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:45.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:45.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:45.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:45.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:45.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:45.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:45.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:13:38.548323+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:45.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:46.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:46.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:46.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:46.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:46.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:46.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:46.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:46.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:43.549726+0000 '>' 2026-02-23T08:13:38.548323+0000 2026-02-23T08:15:46.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:15:46.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6615: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:46.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:46.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:46.513 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:46.514 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:46.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6616: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:46.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6617: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:46.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6620: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-23T08:15:46.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:15:46.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:15:46.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:15:46.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:15:46.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:46.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:46.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:46.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:46.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:46.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:15:46.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:15:46.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:15:46.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:15:46.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:46.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:46.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:46.903 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:46.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:46.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:46.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:46.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407657 2026-02-23T08:15:46.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407657 2026-02-23T08:15:46.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407657' 2026-02-23T08:15:46.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:46.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:47.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080605 2026-02-23T08:15:47.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080605 2026-02-23T08:15:47.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407657 1-777389080605' 2026-02-23T08:15:47.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:47.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407657 2026-02-23T08:15:47.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:47.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:47.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407657 2026-02-23T08:15:47.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:47.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407657 2026-02-23T08:15:47.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407657' 2026-02-23T08:15:47.055 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407657 2026-02-23T08:15:47.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:47.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407654 -lt 734439407657 2026-02-23T08:15:47.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:48.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:48.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407657 -lt 734439407657 2026-02-23T08:15:48.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:48.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080605 2026-02-23T08:15:48.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:48.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:48.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080605 2026-02-23T08:15:48.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:48.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080605 2026-02-23T08:15:48.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080605' 2026-02-23T08:15:48.393 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080605 2026-02-23T08:15:48.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:48.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080605 -lt 777389080605 2026-02-23T08:15:48.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:15:48.559 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:15:48.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:15:48.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:15:48.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:15:48.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:15:48.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:15:48.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:15:48.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:15:48.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:15:48.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:15:48.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:15:48.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:15:48.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:48.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:48.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:48.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:48.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:48.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:15:48.950 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:48.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:48.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:48.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:49.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:43.549726+0000 '>' 2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:49.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:50.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:50.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:50.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:50.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:50.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:50.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:50.129 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:50.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:43.549726+0000 '>' 2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:50.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:51.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:51.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:51.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:51.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:51.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:51.295 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:51.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:49.627055+0000 '>' 2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:51.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:15:51.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6621: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:51.460 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:51.461 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:51.461 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:51.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:51.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6622: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:51.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6623: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:51.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6626: TEST_dual_store_replicated_cluster: diff -u td/osd-scrub-repair/dp_results.json td/osd-scrub-repair/sh2_results.json 2026-02-23T08:15:51.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6630: TEST_dual_store_replicated_cluster: inject_eio rep mdata csr_pool ROBJ13 td/osd-scrub-repair 1 2026-02-23T08:15:51.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-23T08:15:51.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-23T08:15:51.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=mdata 2026-02-23T08:15:51.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-23T08:15:51.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=csr_pool 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=ROBJ13 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/osd-scrub-repair 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=1 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds csr_pool ROBJ13 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=csr_pool 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=ROBJ13 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map csr_pool ROBJ13 2026-02-23T08:15:51.488 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:15:51.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0') 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=0 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-23T08:15:51.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/osd-scrub-repair/0/type 2026-02-23T08:15:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-23T08:15:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 0 bluestore_debug_inject_read_err true 2026-02-23T08:15:51.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=0 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.0 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:51.657 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:15:51.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.424317/ceph-osd.0.asok config set bluestore_debug_inject_read_err true 2026-02-23T08:15:51.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-23T08:15:51.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.0 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:51.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-osd.0.asok 2026-02-23T08:15:51.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-23T08:15:51.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.424317/ceph-osd.0.asok injectmdataerr csr_pool ROBJ13 2026-02-23T08:15:51.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6632: TEST_dual_store_replicated_cluster: pg_deep_scrub 3.0 2026-02-23T08:15:51.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=3.0 2026-02-23T08:15:51.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 3.0 2026-02-23T08:15:51.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:15:51.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:15:51.785 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:51.785 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:51.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:51.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:51.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:51.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:15:51.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:15:51.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:15:51.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:15:51.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:51.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:52.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:52.153 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:52.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:52.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:52.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407663 2026-02-23T08:15:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407663 2026-02-23T08:15:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407663' 2026-02-23T08:15:52.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:52.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:52.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080611 2026-02-23T08:15:52.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080611 2026-02-23T08:15:52.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407663 1-777389080611' 2026-02-23T08:15:52.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:52.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407663 2026-02-23T08:15:52.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:52.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:52.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407663 2026-02-23T08:15:52.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:52.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407663 2026-02-23T08:15:52.301 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407663 2026-02-23T08:15:52.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407663' 2026-02-23T08:15:52.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:52.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407661 -lt 734439407663 2026-02-23T08:15:52.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:53.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:53.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:53.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407664 -lt 734439407663 2026-02-23T08:15:53.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:53.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080611 2026-02-23T08:15:53.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:53.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:53.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080611 2026-02-23T08:15:53.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:53.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080611 2026-02-23T08:15:53.638 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080611 2026-02-23T08:15:53.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080611' 2026-02-23T08:15:53.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:53.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080612 -lt 777389080611 2026-02-23T08:15:53.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:15:53.803 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:15:53.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:15:53.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:15:53.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:15:53.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:15:53.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:15:53.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:15:53.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:53.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:54.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:54.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 3.0 2026-02-23T08:15:54.192 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2026-02-23T08:15:54.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 3.0 2026-02-23T08:15:43.549726+0000 last_deep_scrub_stamp 2026-02-23T08:15:54.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:15:54.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:54.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:54.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:54.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:43.549726+0000 '>' 2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:54.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:55.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:55.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:55.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_deep_scrub_stamp 2026-02-23T08:15:55.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:55.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:15:55.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_deep_scrub_stamp' 2026-02-23T08:15:55.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:55.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:54.598536+0000 '>' 2026-02-23T08:15:43.549726+0000 2026-02-23T08:15:55.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:15:55.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6634: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6635: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6637: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6641: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6641: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6641: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:55.535 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:55.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6642: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:55.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6644: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:55.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6644: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:55.561 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:55.561 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:55.561 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:55.561 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6644: TEST_dual_store_replicated_cluster: jq 'del(.inconsistents[] | select(.object.name == "ROBJ13"))' 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6645: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:55.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6645: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:55.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6646: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:55.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6649: TEST_dual_store_replicated_cluster: pg_scrub 3.0 2026-02-23T08:15:55.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=3.0 2026-02-23T08:15:55.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 3.0 2026-02-23T08:15:55.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=3.0 2026-02-23T08:15:55.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:15:55.587 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:15:55.587 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:15:55.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:15:55.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:15:55.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:15:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:15:55.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:15:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:15:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:15:55.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:15:55.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:15:55.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:15:55.952 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:15:55.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:15:55.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:55.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:15:56.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=734439407668 2026-02-23T08:15:56.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 734439407668 2026-02-23T08:15:56.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407668' 2026-02-23T08:15:56.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:15:56.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:15:56.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=777389080616 2026-02-23T08:15:56.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 777389080616 2026-02-23T08:15:56.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-734439407668 1-777389080616' 2026-02-23T08:15:56.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:56.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-734439407668 2026-02-23T08:15:56.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:56.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:15:56.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-734439407668 2026-02-23T08:15:56.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:56.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=734439407668 2026-02-23T08:15:56.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 734439407668' 2026-02-23T08:15:56.100 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 734439407668 2026-02-23T08:15:56.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:56.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407666 -lt 734439407668 2026-02-23T08:15:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:15:57.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:15:57.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:15:57.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 734439407669 -lt 734439407668 2026-02-23T08:15:57.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:15:57.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-777389080616 2026-02-23T08:15:57.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:15:57.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:15:57.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-777389080616 2026-02-23T08:15:57.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:15:57.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=777389080616 2026-02-23T08:15:57.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 777389080616' 2026-02-23T08:15:57.437 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 777389080616 2026-02-23T08:15:57.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:15:57.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 777389080617 -lt 777389080616 2026-02-23T08:15:57.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:15:57.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 3.0 loop 0' 2026-02-23T08:15:57.606 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 3.0 loop 0 2026-02-23T08:15:57.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 3.0 2026-02-23T08:15:57.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=3.0 2026-02-23T08:15:57.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:15:57.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 3.0 query 2026-02-23T08:15:57.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:15:57.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+inconsistent 2026-02-23T08:15:57.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+inconsistent == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 3.0 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:57.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:57.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:15:54.598536+0000 2026-02-23T08:15:57.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 3.0 2026-02-23T08:15:58.002 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 3.0 on osd.1 to scrub 2026-02-23T08:15:58.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 3.0 2026-02-23T08:15:54.598536+0000 2026-02-23T08:15:58.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=3.0 2026-02-23T08:15:58.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:15:54.598536+0000 2026-02-23T08:15:58.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:15:58.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:15:58.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:58.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:58.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:58.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:58.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:58.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:58.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:54.598536+0000 '>' 2026-02-23T08:15:54.598536+0000 2026-02-23T08:15:58.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:15:59.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:15:59.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:15:59.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 3.0 last_scrub_stamp 2026-02-23T08:15:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=3.0 2026-02-23T08:15:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:15:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:15:59.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="3.0") | .last_scrub_stamp' 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:15:58.560474+0000 '>' 2026-02-23T08:15:54.598536+0000 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6651: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6652: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6654: TEST_dual_store_replicated_cluster: (( extr_dbg >= 3 )) 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:59.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:59.366 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:59.367 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:59.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6658: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:59.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6660: TEST_dual_store_replicated_cluster: rados list-inconsistent-obj 3.0 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6660: TEST_dual_store_replicated_cluster: jq 'del(.inconsistents[] | select(.object.name == "ROBJ13"))' 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6660: TEST_dual_store_replicated_cluster: jq 'def walk(f): 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr: . as $in 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr: | if type == "object" then 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr: reduce keys[] as $key 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr: ( {}; . + { ($key): ($in[$key] | walk(f)) } ) | f 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr: elif type == "array" then map( walk(f) ) | f 2026-02-23T08:15:59.390 INFO:tasks.workunit.client.0.trial129.stderr: else f 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr: end; 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:walk(if type == "object" then del(.mtime) else . end) 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.local_mtime) else . end) 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.last_reqid) else . end) 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.version) else . end) 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:| walk(if type == "object" then del(.prior_version) else . end)' 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6661: TEST_dual_store_replicated_cluster: jq .inconsistents 2026-02-23T08:15:59.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6661: TEST_dual_store_replicated_cluster: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print(json.dumps(ud, sort_keys=True, indent=2))' 2026-02-23T08:15:59.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6665: TEST_dual_store_replicated_cluster: diff -u td/osd-scrub-repair/dpPart2_w13_results.json td/osd-scrub-repair/sh2Part2_w13_results.json 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout:--- td/osd-scrub-repair/dpPart2_w13_results.json 2026-02-23 08:15:55.556849702 +0000 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout:+++ td/osd-scrub-repair/sh2Part2_w13_results.json 2026-02-23 08:15:59.385831379 +0000 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout:@@ -233,6 +233,38 @@ 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head" 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout:+ "selected_object_info": { 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout:+ "alloc_hint_flags": 0, 2026-02-23T08:15:59.416 INFO:tasks.workunit.client.0.trial129.stdout:+ "data_digest": "0x2ddbf8f5", 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "expected_object_size": 0, 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "expected_write_size": 0, 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "flags": [ 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "dirty", 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "omap", 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "data_digest", 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "omap_digest" 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ ], 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "lost": 0, 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "manifest": { 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "type": 0 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ }, 2026-02-23T08:15:59.417 INFO:tasks.workunit.client.0.trial129.stdout:+ "oid": { 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "hash": 2682806379, 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "key": "", 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "max": 0, 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "namespace": "", 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "oid": "ROBJ13", 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "pool": 3, 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "snapid": -2 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ }, 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "omap_digest": "0x6441854d", 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "shard_versions": [], 2026-02-23T08:15:59.418 INFO:tasks.workunit.client.0.trial129.stdout:+ "size": 7, 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:+ "truncate_seq": 0, 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:+ "truncate_size": 0, 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:+ "user_version": 39, 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:+ "watchers": {} 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:+ }, 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:@@ -242,17 +274,14 @@ 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:15:59.419 INFO:tasks.workunit.client.0.trial129.stdout:- "errors": [ 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout:- "read_error" 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout:- ], 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout:+ "errors": [], 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: "size": 7 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout:- "stat_error", 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout:- "read_error" 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout:+ "stat_error" 2026-02-23T08:15:59.420 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:15:59.421 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:15:59.421 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:15:59.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6666: TEST_dual_store_replicated_cluster: diff -u td/osd-scrub-repair/dpPart2_wo13_results.json td/osd-scrub-repair/shPart2_wo13_results.json 2026-02-23T08:15:59.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6668: TEST_dual_store_replicated_cluster: ceph osd pool rm csr_pool csr_pool --yes-i-really-really-mean-it 2026-02-23T08:15:59.621 INFO:tasks.workunit.client.0.trial129.stderr:pool 'csr_pool' removed 2026-02-23T08:15:59.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6669: TEST_dual_store_replicated_cluster: return 0 2026-02-23T08:15:59.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:15:59.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:15:59.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:15:59.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:15:59.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:59.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:59.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:59.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:59.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:59.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:15:59.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:15:59.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:15:59.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:15:59.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:15:59.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:15:59.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:15:59.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:15:59.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:15:59.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:15:59.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:15:59.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:15:59.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:15:59.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:15:59.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:59.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:59.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:15:59.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:15:59.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:15:59.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:15:59.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:15:59.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:15:59.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:15:59.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:15:59.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:15:59.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:15:59.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:15:59.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:15:59.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:15:59.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:15:59.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:15:59.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:15:59.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:15:59.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:15:59.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:15:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:15:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:59.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:59.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:15:59.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:15:59.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:15:59.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:15:59.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:15:59.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:59.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:59.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:15:59.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_list_missing_erasure_coded_appends td/osd-scrub-repair 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1037: TEST_list_missing_erasure_coded_appends: list_missing_erasure_coded td/osd-scrub-repair false 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:975: list_missing_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:976: list_missing_erasure_coded: local allow_overwrites=false 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:977: list_missing_erasure_coded: local poolname=ecpool 2026-02-23T08:15:59.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:979: list_missing_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-23T08:15:59.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:15:59.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:15:59.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:15:59.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:15:59.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:15:59.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:59.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:15:59.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:15:59.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:15:59.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:15:59.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:15:59.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:15:59.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:15:59.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:15:59.838 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:15:59.838 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:15:59.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:15:59.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:15:59.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:15:59.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:15:59.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:15:59.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:15:59.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:15:59.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:15:59.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:15:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:980: list_missing_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-23T08:15:59.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:15:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:15:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:15:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:15:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:15:59.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:16:00.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:16:00.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:00.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:00.050 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:00.050 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:00.050 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:00.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:00.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:16:00.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:16:00.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: seq 0 2 2026-02-23T08:16:00.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:00.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-23T08:16:00.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:00.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:16:00.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:16:00.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:16:00.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7e607066-4fbd-4bdf-a93d-8c012e08d0d0 2026-02-23T08:16:00.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 7e607066-4fbd-4bdf-a93d-8c012e08d0d0' 2026-02-23T08:16:00.072 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 7e607066-4fbd-4bdf-a93d-8c012e08d0d0 2026-02-23T08:16:00.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:16:00.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDADJxp47XABBAAo3fzJWWjfRcguwIVPnJKlg== 2026-02-23T08:16:00.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDADJxp47XABBAAo3fzJWWjfRcguwIVPnJKlg=="}' 2026-02-23T08:16:00.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7e607066-4fbd-4bdf-a93d-8c012e08d0d0 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:16:00.171 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:00.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:16:00.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDADJxp47XABBAAo3fzJWWjfRcguwIVPnJKlg== --osd-uuid 7e607066-4fbd-4bdf-a93d-8c012e08d0d0 2026-02-23T08:16:00.195 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.194+0000 7f6b91551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:00.197 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.195+0000 7f6b91551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:00.197 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.196+0000 7f6b91551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:00.198 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.196+0000 7f6b91551780 -1 bdev(0x55617afdf400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:16:00.198 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.196+0000 7f6b91551780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:16:00.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:16:00.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:16:00.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:16:00.619 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:16:00.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:16:00.715 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:16:00.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:16:00.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:00.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:16:00.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:16:00.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:16:00.727 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.725+0000 7fe79dec3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:00.729 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.727+0000 7fe79dec3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:00.729 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.727+0000 7fe79dec3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:00.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:00.809 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:00.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:00.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:00.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:00.953 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:00.951+0000 7fe79dec3780 -1 Falling back to public interface 2026-02-23T08:16:01.358 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:01.355+0000 7fe79dec3780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:16:01.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:01.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:01.900 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:01.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:01.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:01.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:01.991 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3371272038,v1:127.0.0.1:6801/3371272038] [v2:127.0.0.1:6802/3371272038,v1:127.0.0.1:6803/3371272038] exists,up 7e607066-4fbd-4bdf-a93d-8c012e08d0d0 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:16:01.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:16:01.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:16:01.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:16:01.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:16:01.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c 2026-02-23T08:16:01.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c' 2026-02-23T08:16:01.995 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c 2026-02-23T08:16:01.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:16:02.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDCDJxpEX0+ABAAClImQQVJ3Gkb3b0I39ezZw== 2026-02-23T08:16:02.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDCDJxpEX0+ABAAClImQQVJ3Gkb3b0I39ezZw=="}' 2026-02-23T08:16:02.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c -i td/osd-scrub-repair/1/new.json 2026-02-23T08:16:02.093 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:02.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:16:02.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDCDJxpEX0+ABAAClImQQVJ3Gkb3b0I39ezZw== --osd-uuid cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c 2026-02-23T08:16:02.117 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.115+0000 7f1cda171780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:02.118 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.116+0000 7f1cda171780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:02.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.117+0000 7f1cda171780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:02.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.118+0000 7f1cda171780 -1 bdev(0x5561b21a9400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:16:02.119 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.118+0000 7f1cda171780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:16:02.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:16:02.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:16:02.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:16:02.524 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:16:02.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:16:02.731 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:16:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:16:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:16:02.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:02.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:16:02.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:16:02.744 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.742+0000 7f5a578a4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:02.745 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.744+0000 7f5a578a4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:02.746 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.744+0000 7f5a578a4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:02.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:16:02.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:02.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:16:02.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:02.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:02.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:02.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:02.898 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:02.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:02.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:02.938 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:02.936+0000 7f5a578a4780 -1 Falling back to public interface 2026-02-23T08:16:03.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:03.350 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:03.347+0000 7f5a578a4780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:16:04.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:04.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:04.059 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:04.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:04.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:04.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:04.224 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/779777245,v1:127.0.0.1:6811/779777245] [v2:127.0.0.1:6812/779777245,v1:127.0.0.1:6813/779777245] exists,up cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c 2026-02-23T08:16:04.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:16:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:16:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:16:04.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:16:04.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=774f4e6d-902a-482b-b5be-126092b9064b 2026-02-23T08:16:04.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 774f4e6d-902a-482b-b5be-126092b9064b' 2026-02-23T08:16:04.233 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 774f4e6d-902a-482b-b5be-126092b9064b 2026-02-23T08:16:04.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:16:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDEDJxpQcsUDhAAqKceqHmDV+DJAzSjIWteOA== 2026-02-23T08:16:04.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDEDJxpQcsUDhAAqKceqHmDV+DJAzSjIWteOA=="}' 2026-02-23T08:16:04.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 774f4e6d-902a-482b-b5be-126092b9064b -i td/osd-scrub-repair/2/new.json 2026-02-23T08:16:04.398 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:16:04.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:16:04.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDEDJxpQcsUDhAAqKceqHmDV+DJAzSjIWteOA== --osd-uuid 774f4e6d-902a-482b-b5be-126092b9064b 2026-02-23T08:16:04.423 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:04.421+0000 7f55900bf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:04.424 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:04.422+0000 7f55900bf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:04.425 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:04.423+0000 7f55900bf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:04.426 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:04.423+0000 7f55900bf780 -1 bdev(0x560534911400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:16:04.426 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:04.423+0000 7f55900bf780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:16:04.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:16:04.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:16:04.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:16:04.881 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:16:04.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:16:05.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:16:05.086 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:16:05.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:05.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:16:05.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:16:05.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:16:05.098 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:05.096+0000 7fc462e7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:05.099 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:05.097+0000 7fc462e7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:05.100 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:05.098+0000 7fc462e7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:05.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:16:05.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:16:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:05.251 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:05.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:05.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:05.305 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:05.303+0000 7fc462e7e780 -1 Falling back to public interface 2026-02-23T08:16:05.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:05.664 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:05.662+0000 7fc462e7e780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:16:06.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:06.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:06.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:06.423 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:06.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:06.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:06.588 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2118799015,v1:127.0.0.1:6819/2118799015] [v2:127.0.0.1:6820/2118799015,v1:127.0.0.1:6821/2118799015] exists,up 774f4e6d-902a-482b-b5be-126092b9064b 2026-02-23T08:16:06.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:06.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:06.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:06.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:984: list_missing_erasure_coded: create_rbd_pool 2026-02-23T08:16:06.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:16:06.744 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:16:06.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:16:06.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:16:06.961 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:16:06.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:16:07.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:16:08.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:985: list_missing_erasure_coded: wait_for_clean 2026-02-23T08:16:08.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:16:08.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:16:08.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:16:08.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:16:08.255 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:16:08.255 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:16:08.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:16:08.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:16:08.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:16:08.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:16:08.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:16:08.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:16:08.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:16:08.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:16:08.338 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:16:08.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:16:08.503 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:08.503 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:16:08.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:16:08.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:08.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:16:08.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:16:08.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:16:08.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:16:08.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:08.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:16:08.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-23T08:16:08.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-23T08:16:08.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666' 2026-02-23T08:16:08.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:08.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:16:08.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574850 2026-02-23T08:16:08.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574850 2026-02-23T08:16:08.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705666 2-55834574850' 2026-02-23T08:16:08.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:08.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:16:08.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:08.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:16:08.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:16:08.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:08.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:16:08.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:16:08.732 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:16:08.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:08.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:16:08.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:09.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:16:09.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:10.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:16:10.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:11.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:16:11.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:16:11.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:11.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-23T08:16:11.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:11.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:16:11.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-23T08:16:11.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:11.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-23T08:16:11.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-23T08:16:11.234 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705666 2026-02-23T08:16:11.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:16:11.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705666 2026-02-23T08:16:11.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:11.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574850 2026-02-23T08:16:11.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:11.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:16:11.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574850 2026-02-23T08:16:11.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:11.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574850 2026-02-23T08:16:11.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574850' 2026-02-23T08:16:11.401 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574850 2026-02-23T08:16:11.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:11.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574850 -lt 55834574850 2026-02-23T08:16:11.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:16:11.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:11.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:11.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:16:11.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:16:11.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:16:11.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:16:11.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:16:11.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:16:11.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:16:11.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:16:11.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:16:11.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:16:11.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:11.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:12.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:987: list_missing_erasure_coded: create_ec_pool ecpool false k=2 m=1 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:16:12.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-23T08:16:12.320 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:16:12.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:16:12.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:16:12.623 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:16:12.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:16:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T08:16:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:16:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:16:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:16:13.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:16:13.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:16:13.640 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:16:13.640 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:16:13.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:16:13.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:16:13.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:16:13.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:16:13.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:16:13.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:16:13.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:16:13.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:16:13.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:16:13.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:16:13.893 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:13.893 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:16:13.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:16:13.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:13.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:16:13.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:16:13.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:16:13.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:16:13.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:13.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:16:14.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-23T08:16:14.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-23T08:16:14.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-23T08:16:14.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:14.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:16:14.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574852 2026-02-23T08:16:14.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574852 2026-02-23T08:16:14.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574852' 2026-02-23T08:16:14.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:14.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:16:14.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:14.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:16:14.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:16:14.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:14.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:16:14.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:16:14.117 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:16:14.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:14.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:16:14.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:14.281 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-23T08:16:14.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:14.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:16:14.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-23T08:16:14.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:14.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-23T08:16:14.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-23T08:16:14.285 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705668 2026-02-23T08:16:14.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:16:14.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-23T08:16:14.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:14.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574852 2026-02-23T08:16:14.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:14.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:16:14.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574852 2026-02-23T08:16:14.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:14.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574852 2026-02-23T08:16:14.454 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574852 2026-02-23T08:16:14.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574852' 2026-02-23T08:16:14.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:14.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574852 2026-02-23T08:16:14.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:15.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:16:15.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:15.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574852 2026-02-23T08:16:15.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:16.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:16:16.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:16.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574852 2026-02-23T08:16:16.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:16:16.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:16.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:17.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:16:17.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:16:17.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:16:17.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:16:17.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:16:17.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:16:17.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:16:17.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:16:17.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:16:17.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:16:17.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:17.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:17.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:990: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ0 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ0 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:16:17.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:16:17.729 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:16:17.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:16:17.933 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:16:17.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:16:17.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:16:17.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ0 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:16:17.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: get_osds ecpool MOBJ0 2026-02-23T08:16:17.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:16:17.963 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ0 2026-02-23T08:16:17.964 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ0 2026-02-23T08:16:17.964 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: osds0=('2' '1' '0') 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: local -a osds0 2026-02-23T08:16:18.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:994: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ1 2026-02-23T08:16:18.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:16:18.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:16:18.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ1 2026-02-23T08:16:18.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:16:18.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:16:18.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:16:18.338 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:16:18.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:16:18.543 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:16:18.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:16:18.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:16:18.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:16:18.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: get_osds ecpool MOBJ1 2026-02-23T08:16:18.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:16:18.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ1 2026-02-23T08:16:18.573 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ1 2026-02-23T08:16:18.573 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:16:18.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-23T08:16:18.742 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:18.742 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:16:18.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-23T08:16:18.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: osds1=('2' '1' '0') 2026-02-23T08:16:18.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: local -a osds1 2026-02-23T08:16:18.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: seq 0 2 2026-02-23T08:16:18.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:18.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:16:18.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:18.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:18.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:18.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:19.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:16:19.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:19.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:19.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:19.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:19.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:19.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:16:19.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:19.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:19.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:19.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:19.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:19.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:19.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1002: list_missing_erasure_coded: id=2 2026-02-23T08:16:19.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1003: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 MOBJ0 remove 2026-02-23T08:16:19.800 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#2:a9030505:::MOBJ0:head# 2026-02-23T08:16:19.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1005: list_missing_erasure_coded: id=1 2026-02-23T08:16:19.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1006: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ0 remove 2026-02-23T08:16:19.979 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:a9030505:::MOBJ0:head# 2026-02-23T08:16:20.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1009: list_missing_erasure_coded: id=1 2026-02-23T08:16:20.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1010: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ1 remove 2026-02-23T08:16:20.149 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:8dd16d55:::MOBJ1:head# 2026-02-23T08:16:20.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1012: list_missing_erasure_coded: id=0 2026-02-23T08:16:20.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1013: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 MOBJ1 remove 2026-02-23T08:16:20.321 INFO:tasks.workunit.client.0.trial129.stdout:remove 2#2:8dd16d55:::MOBJ1:head# 2026-02-23T08:16:20.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: seq 0 2 2026-02-23T08:16:20.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:20.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 0 2026-02-23T08:16:20.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:20.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:16:20.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:16:20.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:16:20.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:16:20.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:20.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:20.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:20.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:20.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:16:20.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:16:20.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:20.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:16:20.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:20.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:16:20.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:20.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:20.395 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:20.396 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:20.396 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:20.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:20.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:20.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:16:20.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:16:20.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:16:20.399 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:20.397+0000 7f5833b52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:20.400 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:20.398+0000 7f5833b52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:20.401 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:20.399+0000 7f5833b52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:20.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:20.552 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:16:20.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:20.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:20.628 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:20.626+0000 7f5833b52780 -1 Falling back to public interface 2026-02-23T08:16:20.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:20.946 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:20.944+0000 7f5833b52780 -1 osd.0 31 log_to_monitors true 2026-02-23T08:16:21.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:21.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:21.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:21.718 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:21.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:21.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:21.889 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 38 up_thru 38 down_at 32 last_clean_interval [5,31) [v2:127.0.0.1:6800/3905725363,v1:127.0.0.1:6801/3905725363] [v2:127.0.0.1:6802/3905725363,v1:127.0.0.1:6803/3905725363] exists,up 7e607066-4fbd-4bdf-a93d-8c012e08d0d0 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 1 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:16:21.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:21.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:21.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:16:21.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:16:21.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:16:21.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:16:21.893 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:16:21.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:21.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:16:21.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:16:21.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:16:21.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:16:21.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:16:21.901 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:21.899+0000 7f63cbb4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:21.903 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:21.901+0000 7f63cbb4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:21.903 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:21.902+0000 7f63cbb4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:22.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:16:22.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:22.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:16:22.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:22.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:22.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:22.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:22.058 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:16:22.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:22.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:22.116 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:22.114+0000 7f63cbb4f780 -1 Falling back to public interface 2026-02-23T08:16:22.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:22.493 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:22.491+0000 7f63cbb4f780 -1 osd.1 33 log_to_monitors true 2026-02-23T08:16:23.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:23.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:23.223 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:23.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:23.387 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 42 up_thru 42 down_at 34 last_clean_interval [9,33) [v2:127.0.0.1:6810/3067493524,v1:127.0.0.1:6811/3067493524] [v2:127.0.0.1:6812/3067493524,v1:127.0.0.1:6813/3067493524] exists,up cf426151-8fb5-4b8d-99a8-e1cb56b0bb3c 2026-02-23T08:16:23.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:23.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:23.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 2 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:23.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:16:23.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:16:23.390 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:16:23.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:23.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:16:23.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:16:23.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:16:23.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:16:23.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:16:23.402 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:23.400+0000 7f9db0a06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:23.404 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:23.402+0000 7f9db0a06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:23.404 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:23.403+0000 7f9db0a06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:23.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:16:23.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:23.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:23.607 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:23.605+0000 7f9db0a06780 -1 Falling back to public interface 2026-02-23T08:16:23.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:23.928 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:23.925+0000 7f9db0a06780 -1 osd.2 35 log_to_monitors true 2026-02-23T08:16:24.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:24.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:24.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:24.724 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:24.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:24.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:24.889 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 47 up_thru 47 down_at 36 last_clean_interval [13,35) [v2:127.0.0.1:6818/2079110613,v1:127.0.0.1:6819/2079110613] [v2:127.0.0.1:6820/2079110613,v1:127.0.0.1:6821/2079110613] exists,up 774f4e6d-902a-482b-b5be-126092b9064b 2026-02-23T08:16:24.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:24.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:24.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:24.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1019: list_missing_erasure_coded: create_rbd_pool 2026-02-23T08:16:24.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:16:25.097 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' removed 2026-02-23T08:16:25.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:16:25.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:16:25.301 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:16:25.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:16:26.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:16:26.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1020: list_missing_erasure_coded: wait_for_clean 2026-02-23T08:16:26.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:16:26.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:16:26.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:16:26.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:16:26.595 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:16:26.596 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:16:26.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:16:26.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:16:26.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:16:26.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:16:26.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:16:26.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:16:26.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:16:26.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:16:26.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:16:26.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:16:26.841 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:26.841 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:16:26.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:16:26.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:26.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:16:26.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-23T08:16:26.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-23T08:16:26.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251' 2026-02-23T08:16:26.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:26.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:16:26.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626434 2026-02-23T08:16:26.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626434 2026-02-23T08:16:26.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251 1-180388626434' 2026-02-23T08:16:26.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:26.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:16:27.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=201863462914 2026-02-23T08:16:27.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 201863462914 2026-02-23T08:16:27.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-163208757251 1-180388626434 2-201863462914' 2026-02-23T08:16:27.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:27.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-163208757251 2026-02-23T08:16:27.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:27.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:16:27.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-163208757251 2026-02-23T08:16:27.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:27.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-23T08:16:27.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 163208757251' 2026-02-23T08:16:27.065 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 163208757251 2026-02-23T08:16:27.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:27.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757250 -lt 163208757251 2026-02-23T08:16:27.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:28.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:16:28.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:28.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-23T08:16:28.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:28.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-180388626434 2026-02-23T08:16:28.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:16:28.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-180388626434 2026-02-23T08:16:28.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:28.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626434 2026-02-23T08:16:28.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 180388626434' 2026-02-23T08:16:28.405 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 180388626434 2026-02-23T08:16:28.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:16:28.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626435 -lt 180388626434 2026-02-23T08:16:28.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:28.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-201863462914 2026-02-23T08:16:28.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:28.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:16:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-201863462914 2026-02-23T08:16:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:28.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=201863462914 2026-02-23T08:16:28.575 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 201863462914 2026-02-23T08:16:28.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 201863462914' 2026-02-23T08:16:28.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:28.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 201863462914 -lt 201863462914 2026-02-23T08:16:28.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:16:28.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:28.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:28.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:16:28.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:16:29.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:16:29.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:16:29.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:29.115 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:29.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:16:29.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:16:29.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:16:29.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: get_pg ecpool MOBJ0 2026-02-23T08:16:29.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:16:29.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=MOBJ0 2026-02-23T08:16:29.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool MOBJ0 2026-02-23T08:16:29.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:16:29.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: local pg=2.0 2026-02-23T08:16:29.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1027: list_missing_erasure_coded: repair 2.0 2026-02-23T08:16:29.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:16:29.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:16:29.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:16:29.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:16:29.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:16:29.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:16:29.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:29.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:16:29.799 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.2 to repair 2026-02-23T08:16:29.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:16:29.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:16:29.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:16:29.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:16:29.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:12.621809+0000 '>' 2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:29.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:16:30.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:16:30.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:16:30.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:16:30.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:16:30.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:16:30.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:16:30.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:16:31.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:12.621809+0000 '>' 2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:31.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:16:32.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:16:32.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:16:32.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:16:32.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:16:32.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:16:32.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:16:32.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:16:32.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:12.621809+0000 '>' 2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:32.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:16:33.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:16:33.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:16:33.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:16:33.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:16:33.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:16:33.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:16:33.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:16:33.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:12.621809+0000 '>' 2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:33.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:16:34.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:16:34.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:16:34.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:16:34.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:16:34.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:16:34.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:16:34.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:16:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:29.821770+0000 '>' 2026-02-23T08:16:12.621809+0000 2026-02-23T08:16:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:16:34.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: seq 0 120 2026-02-23T08:16:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: for i in $(seq 0 120) 2026-02-23T08:16:34.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1030: list_missing_erasure_coded: '[' 0 -lt 60 ']' 2026-02-23T08:16:34.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: ceph pg 2.0 list_unfound 2026-02-23T08:16:34.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: egrep 'MOBJ0|MOBJ1' 2026-02-23T08:16:34.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: wc -l 2026-02-23T08:16:34.652 INFO:tasks.workunit.client.0.trial129.stderr:egrep: warning: egrep is obsolescent; using grep -E 2026-02-23T08:16:34.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: matches=2 2026-02-23T08:16:34.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: '[' 2 -eq 2 ']' 2026-02-23T08:16:34.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: break 2026-02-23T08:16:34.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:16:34.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:34.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:34.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:16:34.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:16:34.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:16:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:16:34.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:16:34.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:16:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:16:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:16:34.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:16:34.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:16:34.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:16:34.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:16:34.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:16:34.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:16:34.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:34.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:34.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:34.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:34.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:34.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:16:34.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:16:34.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:16:34.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:16:34.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:16:34.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:16:34.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:16:34.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:16:34.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:16:34.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:16:34.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:16:34.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:16:34.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:16:34.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:16:34.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:34.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:34.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:16:34.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:16:34.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:16:34.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:16:34.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:16:34.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:34.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:34.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:16:34.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_list_missing_erasure_coded_overwrites td/osd-scrub-repair 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1041: TEST_list_missing_erasure_coded_overwrites: '[' true = true ']' 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1042: TEST_list_missing_erasure_coded_overwrites: list_missing_erasure_coded td/osd-scrub-repair true 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:975: list_missing_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:976: list_missing_erasure_coded: local allow_overwrites=true 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:977: list_missing_erasure_coded: local poolname=ecpool 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:979: list_missing_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-23T08:16:34.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:16:34.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:16:34.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:16:34.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:16:34.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:16:34.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:16:34.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:16:34.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:34.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:34.888 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:34.888 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:34.888 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:34.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:34.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:16:34.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:16:34.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:34.911 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:34.912 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:16:34.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:16:34.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:16:34.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:16:34.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:16:34.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:16:34.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:16:34.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:16:34.972 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:16:34.972 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:16:34.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:16:35.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:980: list_missing_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-23T08:16:35.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:16:35.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:16:35.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:16:35.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:16:35.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:16:35.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:16:35.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:16:35.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:35.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:35.126 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:35.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:35.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:35.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:35.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:16:35.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:16:35.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: seq 0 2 2026-02-23T08:16:35.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:35.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:35.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:16:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:16:35.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:16:35.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9c32e233-385e-4c66-a4b2-3655a91652f7 2026-02-23T08:16:35.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 9c32e233-385e-4c66-a4b2-3655a91652f7' 2026-02-23T08:16:35.151 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 9c32e233-385e-4c66-a4b2-3655a91652f7 2026-02-23T08:16:35.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:16:35.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDjDJxpN51BCRAANijWME4Ybbyitsq5GbBSmw== 2026-02-23T08:16:35.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDjDJxpN51BCRAANijWME4Ybbyitsq5GbBSmw=="}' 2026-02-23T08:16:35.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9c32e233-385e-4c66-a4b2-3655a91652f7 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:16:35.242 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:35.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:16:35.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDjDJxpN51BCRAANijWME4Ybbyitsq5GbBSmw== --osd-uuid 9c32e233-385e-4c66-a4b2-3655a91652f7 2026-02-23T08:16:35.266 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.264+0000 7fa07128d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:35.267 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.266+0000 7fa07128d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:35.268 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.266+0000 7fa07128d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:35.269 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.267+0000 7fa07128d780 -1 bdev(0x56207a301400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:16:35.269 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.267+0000 7fa07128d780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:16:35.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:16:35.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:16:35.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:16:35.718 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:16:35.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:16:35.814 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:16:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:16:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:16:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:16:35.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:16:35.827 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.825+0000 7f4363a96780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:35.828 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.826+0000 7f4363a96780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:35.829 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:35.827+0000 7f4363a96780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:35.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:16:35.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:35.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:16:35.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:35.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:35.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:35.911 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:35.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:35.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:35.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:36.041 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:36.039+0000 7f4363a96780 -1 Falling back to public interface 2026-02-23T08:16:36.441 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:36.439+0000 7f4363a96780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:16:37.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:37.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:37.003 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:37.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:37.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:37.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:37.097 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4088914608,v1:127.0.0.1:6801/4088914608] [v2:127.0.0.1:6802/4088914608,v1:127.0.0.1:6803/4088914608] exists,up 9c32e233-385e-4c66-a4b2-3655a91652f7 2026-02-23T08:16:37.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:37.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:37.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:16:37.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:16:37.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:16:37.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:16:37.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2 2026-02-23T08:16:37.105 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2 2026-02-23T08:16:37.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2' 2026-02-23T08:16:37.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:16:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDlDJxpSNeDBhAA6jXceM5NTa6zWqNOQRLH8A== 2026-02-23T08:16:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDlDJxpSNeDBhAA6jXceM5NTa6zWqNOQRLH8A=="}' 2026-02-23T08:16:37.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:16:37.199 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:37.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:16:37.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDlDJxpSNeDBhAA6jXceM5NTa6zWqNOQRLH8A== --osd-uuid acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2 2026-02-23T08:16:37.221 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.219+0000 7f77b8b73780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:37.223 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.221+0000 7f77b8b73780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:37.224 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.222+0000 7f77b8b73780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:37.224 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.223+0000 7f77b8b73780 -1 bdev(0x561133ec7400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:16:37.224 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.223+0000 7f77b8b73780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:16:37.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:16:37.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:16:37.665 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:16:37.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:16:37.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:16:37.873 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:16:37.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:16:37.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:16:37.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:37.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:16:37.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:16:37.886 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.883+0000 7f256e54d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:37.887 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.885+0000 7f256e54d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:37.888 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:37.886+0000 7f256e54d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:38.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:16:38.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:38.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:16:38.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:38.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:38.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:38.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:38.038 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:38.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:38.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:38.088 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:38.086+0000 7f256e54d780 -1 Falling back to public interface 2026-02-23T08:16:38.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:38.435 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:38.433+0000 7f256e54d780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:16:39.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:39.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:39.205 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:39.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:39.369 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1594624300,v1:127.0.0.1:6811/1594624300] [v2:127.0.0.1:6812/1594624300,v1:127.0.0.1:6813/1594624300] exists,up acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:981: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:982: list_missing_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:16:39.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:16:39.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:16:39.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:16:39.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:16:39.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f7d5f870-827e-47cf-ad61-defb578b05b7 2026-02-23T08:16:39.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f7d5f870-827e-47cf-ad61-defb578b05b7' 2026-02-23T08:16:39.374 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 f7d5f870-827e-47cf-ad61-defb578b05b7 2026-02-23T08:16:39.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:16:39.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnDJxpplPUFhAAbj+ZCrgGvpUGnuCv4xfOMw== 2026-02-23T08:16:39.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnDJxpplPUFhAAbj+ZCrgGvpUGnuCv4xfOMw=="}' 2026-02-23T08:16:39.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f7d5f870-827e-47cf-ad61-defb578b05b7 -i td/osd-scrub-repair/2/new.json 2026-02-23T08:16:39.544 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:16:39.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:16:39.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnDJxpplPUFhAAbj+ZCrgGvpUGnuCv4xfOMw== --osd-uuid f7d5f870-827e-47cf-ad61-defb578b05b7 2026-02-23T08:16:39.571 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:39.569+0000 7fb5b76a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:39.572 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:39.570+0000 7fb5b76a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:39.573 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:39.571+0000 7fb5b76a0780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:39.573 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:39.571+0000 7fb5b76a0780 -1 bdev(0x5613072bf400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:16:39.573 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:39.571+0000 7fb5b76a0780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:16:39.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:16:39.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:16:39.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:16:39.968 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:16:39.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:16:40.176 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:16:40.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:16:40.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:40.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:16:40.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:16:40.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:16:40.188 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:40.186+0000 7f67f2f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:40.190 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:40.188+0000 7f67f2f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:40.190 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:40.189+0000 7f67f2f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:40.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:40.347 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:16:40.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:40.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:40.364 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:40.362+0000 7f67f2f4b780 -1 Falling back to public interface 2026-02-23T08:16:40.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:40.765 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:40.763+0000 7f67f2f4b780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:16:41.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:41.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:41.509 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:16:41.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:41.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:41.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:41.675 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3022568887,v1:127.0.0.1:6819/3022568887] [v2:127.0.0.1:6820/3022568887,v1:127.0.0.1:6821/3022568887] exists,up f7d5f870-827e-47cf-ad61-defb578b05b7 2026-02-23T08:16:41.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:41.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:41.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:41.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:984: list_missing_erasure_coded: create_rbd_pool 2026-02-23T08:16:41.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:16:41.833 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:16:41.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:16:41.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:16:42.053 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:16:42.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:16:43.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:16:43.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:985: list_missing_erasure_coded: wait_for_clean 2026-02-23T08:16:43.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:16:43.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:16:43.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:16:43.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:16:43.347 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:16:43.347 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:16:43.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:16:43.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:16:43.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:16:43.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:16:43.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:16:43.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:16:43.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:16:43.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:16:43.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:16:43.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:16:43.595 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:43.595 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:16:43.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:16:43.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:43.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:16:43.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:16:43.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:16:43.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:16:43.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:43.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:16:43.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-23T08:16:43.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-23T08:16:43.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-23T08:16:43.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:43.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:16:43.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T08:16:43.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T08:16:43.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-60129542146' 2026-02-23T08:16:43.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:43.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:16:43.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:43.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:16:43.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:16:43.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:43.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:16:43.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:16:43.821 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:16:43.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:43.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:16:43.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:44.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:16:44.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:16:45.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:46.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:16:46.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:46.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:16:46.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:46.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-23T08:16:46.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:46.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:16:46.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-23T08:16:46.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:46.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-23T08:16:46.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-23T08:16:46.322 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672963 2026-02-23T08:16:46.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:16:46.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672963 2026-02-23T08:16:46.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:46.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T08:16:46.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:46.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:16:46.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T08:16:46.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:46.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T08:16:46.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T08:16:46.489 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T08:16:46.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:46.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-23T08:16:46.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:16:46.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:46.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:46.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:16:46.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:16:47.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:16:47.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:16:47.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:47.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:47.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:16:47.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:16:47.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:16:47.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:987: list_missing_erasure_coded: create_ec_pool ecpool true k=2 m=1 2026-02-23T08:16:47.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:16:47.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:16:47.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-23T08:16:47.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:16:47.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-23T08:16:47.397 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:16:47.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:16:47.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:16:47.701 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:16:47.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:16:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-23T08:16:48.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-23T08:16:48.923 INFO:tasks.workunit.client.0.trial129.stderr:set pool 2 allow_ec_overwrites to true 2026-02-23T08:16:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:16:48.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:16:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:16:48.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:16:48.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:16:48.936 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:16:48.936 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:16:48.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:16:48.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:16:48.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:16:49.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:16:49.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:16:49.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:16:49.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:16:49.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:16:49.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:16:49.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:16:49.181 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:49.181 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:16:49.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:16:49.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:49.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:16:49.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:16:49.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:16:49.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:16:49.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:49.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:16:49.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-23T08:16:49.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-23T08:16:49.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672965' 2026-02-23T08:16:49.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:16:49.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:16:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T08:16:49.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T08:16:49.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672965 2-60129542148' 2026-02-23T08:16:49.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:49.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:16:49.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:49.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:16:49.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:16:49.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:49.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:16:49.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:16:49.407 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:16:49.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:49.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:16:49.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:50.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:16:50.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:50.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:16:50.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:16:51.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:16:51.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:16:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:16:51.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:51.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-23T08:16:51.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:51.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:16:51.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-23T08:16:51.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:51.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-23T08:16:51.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-23T08:16:51.909 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672965 2026-02-23T08:16:51.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:16:52.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672965 2026-02-23T08:16:52.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:16:52.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T08:16:52.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:16:52.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:16:52.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T08:16:52.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:16:52.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T08:16:52.075 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542148 2026-02-23T08:16:52.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T08:16:52.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:16:52.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542148 2026-02-23T08:16:52.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:16:52.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:52.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:52.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:16:52.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:16:52.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:16:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:16:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:16:52.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:990: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ0 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ0 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:16:52.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:16:53.024 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:16:53.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:16:53.277 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:16:53.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:16:53.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:16:53.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ0 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:16:53.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: get_osds ecpool MOBJ0 2026-02-23T08:16:53.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:16:53.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ0 2026-02-23T08:16:53.307 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ0 2026-02-23T08:16:53.307 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:16:53.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-23T08:16:53.476 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:53.476 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:16:53.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: osds0=('2' '1' '0') 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:991: list_missing_erasure_coded: local -a osds0 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:994: list_missing_erasure_coded: add_something td/osd-scrub-repair ecpool MOBJ1 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=MOBJ1 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:16:53.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:16:53.686 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:16:53.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:16:53.890 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:16:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:16:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:16:53.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put MOBJ1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:16:53.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: get_osds ecpool MOBJ1 2026-02-23T08:16:53.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:16:53.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=MOBJ1 2026-02-23T08:16:53.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool MOBJ1 2026-02-23T08:16:53.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:16:54.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=2 2026-02-23T08:16:54.088 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:54.088 INFO:tasks.workunit.client.0.trial129.stderr:0' 2026-02-23T08:16:54.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 2 1 0 2026-02-23T08:16:54.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: osds1=('2' '1' '0') 2026-02-23T08:16:54.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:995: list_missing_erasure_coded: local -a osds1 2026-02-23T08:16:54.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: seq 0 2 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:54.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:54.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:54.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:54.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:16:54.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:54.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:54.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:54.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:54.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:54.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:54.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:998: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:54.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:999: list_missing_erasure_coded: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:16:54.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:16:54.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:16:54.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:16:54.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:16:54.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:16:55.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:16:55.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1002: list_missing_erasure_coded: id=2 2026-02-23T08:16:55.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1003: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 MOBJ0 remove 2026-02-23T08:16:55.140 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#2:a9030505:::MOBJ0:head# 2026-02-23T08:16:55.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1005: list_missing_erasure_coded: id=1 2026-02-23T08:16:55.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1006: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ0 remove 2026-02-23T08:16:55.313 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:a9030505:::MOBJ0:head# 2026-02-23T08:16:55.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1009: list_missing_erasure_coded: id=1 2026-02-23T08:16:55.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1010: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 MOBJ1 remove 2026-02-23T08:16:55.476 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#2:8dd16d55:::MOBJ1:head# 2026-02-23T08:16:55.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1012: list_missing_erasure_coded: id=0 2026-02-23T08:16:55.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1013: list_missing_erasure_coded: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 MOBJ1 remove 2026-02-23T08:16:55.647 INFO:tasks.workunit.client.0.trial129.stdout:remove 2#2:8dd16d55:::MOBJ1:head# 2026-02-23T08:16:55.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: seq 0 2 2026-02-23T08:16:55.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 0 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:55.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:55.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:16:55.719 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:16:55.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:55.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:16:55.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:16:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:16:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:16:55.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:16:55.728 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:55.726+0000 7fbb11410780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:55.730 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:55.728+0000 7fbb11410780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:55.730 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:55.729+0000 7fbb11410780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:55.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:16:55.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:55.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:55.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:55.929 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:55.927+0000 7fbb11410780 -1 Falling back to public interface 2026-02-23T08:16:56.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:56.283 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:56.281+0000 7fbb11410780 -1 osd.0 32 log_to_monitors true 2026-02-23T08:16:57.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:57.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:57.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:57.050 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:57.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:57.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:16:57.214 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 39 up_thru 39 down_at 33 last_clean_interval [5,32) [v2:127.0.0.1:6800/1976306101,v1:127.0.0.1:6801/1976306101] [v2:127.0.0.1:6802/1976306101,v1:127.0.0.1:6803/1976306101] exists,up 9c32e233-385e-4c66-a4b2-3655a91652f7 2026-02-23T08:16:57.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:57.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:57.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:57.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 1 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:57.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:16:57.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:16:57.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:16:57.217 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:16:57.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:57.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:16:57.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:16:57.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:16:57.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:16:57.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:16:57.230 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:57.228+0000 7fd05b211780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:57.231 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:57.229+0000 7fd05b211780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:57.232 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:57.230+0000 7fd05b211780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:57.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:16:57.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:57.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:57.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:57.447 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:57.444+0000 7fd05b211780 -1 Falling back to public interface 2026-02-23T08:16:57.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:57.808 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:57.806+0000 7fd05b211780 -1 osd.1 34 log_to_monitors true 2026-02-23T08:16:58.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:16:58.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:58.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:16:58.553 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:16:58.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:58.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 42 up_thru 42 down_at 35 last_clean_interval [10,34) [v2:127.0.0.1:6810/2338658090,v1:127.0.0.1:6811/2338658090] [v2:127.0.0.1:6812/2338658090,v1:127.0.0.1:6813/2338658090] exists,up acfae5b3-e4e5-4a65-bdc6-dca0bb94a2c2 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1016: list_missing_erasure_coded: for id in $(seq 0 2) 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1017: list_missing_erasure_coded: activate_osd td/osd-scrub-repair 2 2026-02-23T08:16:58.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:16:58.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:16:58.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:16:58.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:16:58.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:16:58.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:16:58.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:16:58.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:16:58.735 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:58.733+0000 7ff9ac00a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:58.736 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:58.734+0000 7ff9ac00a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:58.737 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:58.735+0000 7ff9ac00a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:16:58.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:16:58.944 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:58.942+0000 7ff9ac00a780 -1 Falling back to public interface 2026-02-23T08:16:59.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:16:59.338 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:16:59.336+0000 7ff9ac00a780 -1 osd.2 36 log_to_monitors true 2026-02-23T08:17:00.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:00.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:00.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:00.059 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:17:00.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:00.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:17:00.227 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 46 up_thru 46 down_at 37 last_clean_interval [14,36) [v2:127.0.0.1:6818/2136725688,v1:127.0.0.1:6819/2136725688] [v2:127.0.0.1:6820/2136725688,v1:127.0.0.1:6821/2136725688] exists,up f7d5f870-827e-47cf-ad61-defb578b05b7 2026-02-23T08:17:00.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:00.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:00.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:00.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1019: list_missing_erasure_coded: create_rbd_pool 2026-02-23T08:17:00.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:17:00.466 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' removed 2026-02-23T08:17:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:17:00.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:17:00.670 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:17:00.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:17:01.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:17:01.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1020: list_missing_erasure_coded: wait_for_clean 2026-02-23T08:17:01.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:17:01.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:17:01.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:17:01.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:17:01.962 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:17:01.962 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:17:01.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:17:01.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:17:01.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:17:02.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:17:02.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:17:02.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:17:02.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:17:02.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:17:02.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:17:02.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:17:02.214 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:17:02.214 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:17:02.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:17:02.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:02.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:17:02.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724547 2026-02-23T08:17:02.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724547 2026-02-23T08:17:02.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724547' 2026-02-23T08:17:02.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:02.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:17:02.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626434 2026-02-23T08:17:02.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626434 2026-02-23T08:17:02.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724547 1-180388626434' 2026-02-23T08:17:02.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:02.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:17:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=197568495618 2026-02-23T08:17:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 197568495618 2026-02-23T08:17:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-167503724547 1-180388626434 2-197568495618' 2026-02-23T08:17:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:02.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-167503724547 2026-02-23T08:17:02.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:02.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:17:02.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-167503724547 2026-02-23T08:17:02.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:02.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724547 2026-02-23T08:17:02.436 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 167503724547 2026-02-23T08:17:02.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 167503724547' 2026-02-23T08:17:02.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:02.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 167503724547 2026-02-23T08:17:02.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:17:03.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:17:03.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-23T08:17:03.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:03.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-180388626434 2026-02-23T08:17:03.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:03.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:17:03.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-180388626434 2026-02-23T08:17:03.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:03.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626434 2026-02-23T08:17:03.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 180388626434' 2026-02-23T08:17:03.773 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 180388626434 2026-02-23T08:17:03.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:17:03.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626435 -lt 180388626434 2026-02-23T08:17:03.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:03.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-197568495618 2026-02-23T08:17:03.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:03.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:17:03.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-197568495618 2026-02-23T08:17:03.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=197568495618 2026-02-23T08:17:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 197568495618' 2026-02-23T08:17:03.945 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 197568495618 2026-02-23T08:17:03.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:17:04.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 197568495618 -lt 197568495618 2026-02-23T08:17:04.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:17:04.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:04.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:04.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:17:04.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:17:04.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:17:04.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:17:04.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:17:04.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:17:04.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:17:04.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:17:04.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:17:04.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:17:04.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:04.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:04.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:17:04.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:17:04.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:17:04.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: get_pg ecpool MOBJ0 2026-02-23T08:17:04.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:17:04.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=MOBJ0 2026-02-23T08:17:04.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool MOBJ0 2026-02-23T08:17:04.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:17:04.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1023: list_missing_erasure_coded: local pg=2.0 2026-02-23T08:17:04.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1027: list_missing_erasure_coded: repair 2.0 2026-02-23T08:17:04.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=2.0 2026-02-23T08:17:04.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 2.0 2026-02-23T08:17:04.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:04.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:04.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:04.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:05.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:05.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 2.0 2026-02-23T08:17:05.166 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 2.0s0 on osd.2 to repair 2026-02-23T08:17:05.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 2.0 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:05.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=2.0 2026-02-23T08:17:05.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:05.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:17:05.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:17:05.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:05.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:17:05.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:05.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:05.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:05.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:47.698868+0000 '>' 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:05.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:06.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:06.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:06.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:17:06.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:06.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:06.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:06.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:06.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:47.698868+0000 '>' 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:06.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:07.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:07.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:07.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:17:07.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:07.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:07.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:07.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:47.698868+0000 '>' 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:07.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:08.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:08.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:08.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:17:08.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:08.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:08.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:08.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:08.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:47.698868+0000 '>' 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:08.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:09.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:09.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:09.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:17:09.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:09.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:09.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:09.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:10.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:16:47.698868+0000 '>' 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:10.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:11.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:11.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:11.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 2.0 last_scrub_stamp 2026-02-23T08:17:11.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=2.0 2026-02-23T08:17:11.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:11.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:11.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="2.0") | .last_scrub_stamp' 2026-02-23T08:17:11.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:06.258511+0000 '>' 2026-02-23T08:16:47.698868+0000 2026-02-23T08:17:11.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:17:11.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: seq 0 120 2026-02-23T08:17:11.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1029: list_missing_erasure_coded: for i in $(seq 0 120) 2026-02-23T08:17:11.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1030: list_missing_erasure_coded: '[' 0 -lt 60 ']' 2026-02-23T08:17:11.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: ceph pg 2.0 list_unfound 2026-02-23T08:17:11.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: egrep 'MOBJ0|MOBJ1' 2026-02-23T08:17:11.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: wc -l 2026-02-23T08:17:11.187 INFO:tasks.workunit.client.0.trial129.stderr:egrep: warning: egrep is obsolescent; using grep -E 2026-02-23T08:17:11.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1031: list_missing_erasure_coded: matches=2 2026-02-23T08:17:11.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: '[' 2 -eq 2 ']' 2026-02-23T08:17:11.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:1032: list_missing_erasure_coded: break 2026-02-23T08:17:11.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:11.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:11.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:11.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:17:11.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:17:11.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:17:11.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:17:11.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:17:11.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:17:11.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:17:11.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:17:11.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:17:11.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:17:11.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:17:11.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:17:11.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:17:11.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:17:11.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:17:11.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:17:11.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:11.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:11.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:11.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:17:11.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:17:11.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:17:11.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:17:11.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:17:11.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:17:11.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:17:11.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:17:11.393 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:17:11.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:17:11.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:17:11.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:17:11.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:17:11.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:17:11.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:17:11.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:17:11.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:17:11.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:17:11.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:17:11.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:17:11.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:17:11.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:17:11.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_periodic_scrub_replicated td/osd-scrub-repair 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5926: TEST_periodic_scrub_replicated: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5927: TEST_periodic_scrub_replicated: local poolname=psr_pool 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5928: TEST_periodic_scrub_replicated: local objname=POBJ 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:5929: TEST_periodic_scrub_replicated: return 0 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:11.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:11.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:11.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:11.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:17:11.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:17:11.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:17:11.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:17:11.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:17:11.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:17:11.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:17:11.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:17:11.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:17:11.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:17:11.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:17:11.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:17:11.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:17:11.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:17:11.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:17:11.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:17:11.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:17:11.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:11.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:11.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:11.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:17:11.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:17:11.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:17:11.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:17:11.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:17:11.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:17:11.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:17:11.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:17:11.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:11.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:17:11.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:17:11.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:17:11.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:17:11.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:17:11.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:17:11.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:17:11.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:17:11.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:17:11.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:17:11.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:17:11.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:17:11.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:17:11.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_repair_stats td/osd-scrub-repair 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:713: TEST_repair_stats: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:714: TEST_repair_stats: local poolname=testpool 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:715: TEST_repair_stats: local OSDS=2 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:716: TEST_repair_stats: local OBJS=30 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:718: TEST_repair_stats: local REPAIRS=20 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:721: TEST_repair_stats: run_mon td/osd-scrub-repair a 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:17:11.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:11.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:17:11.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:17:11.468 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:17:11.469 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:17:11.469 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.469 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.469 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:17:11.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:17:11.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:17:11.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:17:11.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:17:11.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:17:11.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:17:11.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.529 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:17:11.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:17:11.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:722: TEST_repair_stats: run_mgr td/osd-scrub-repair x 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:17:11.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:11.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:17:11.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:17:11.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:724: TEST_repair_stats: local 'ceph_osd_args=--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:11.699 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: expr 2 - 1 2026-02-23T08:17:11.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: seq 0 1 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:726: TEST_repair_stats: run_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:11.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:11.703 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:11.703 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:11.703 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:17:11.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=823d531e-770d-42c8-8f1c-01bf00a63133 2026-02-23T08:17:11.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 823d531e-770d-42c8-8f1c-01bf00a63133' 2026-02-23T08:17:11.705 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 823d531e-770d-42c8-8f1c-01bf00a63133 2026-02-23T08:17:11.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:17:11.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAHDZxpz0V5KhAArLpE+U9rA+OEBqIwXihZag== 2026-02-23T08:17:11.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAHDZxpz0V5KhAArLpE+U9rA+OEBqIwXihZag=="}' 2026-02-23T08:17:11.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 823d531e-770d-42c8-8f1c-01bf00a63133 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:17:11.801 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:11.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:17:11.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAHDZxpz0V5KhAArLpE+U9rA+OEBqIwXihZag== --osd-uuid 823d531e-770d-42c8-8f1c-01bf00a63133 2026-02-23T08:17:11.825 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:11.823+0000 7fc27889b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:11.826 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:11.825+0000 7fc27889b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:11.827 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:11.826+0000 7fc27889b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:11.828 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:11.826+0000 7fc27889b780 -1 bdev(0x55d1c1d9d400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:17:11.828 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:11.826+0000 7fc27889b780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:17:12.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:17:12.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:17:12.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:17:12.271 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:17:12.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:17:12.366 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:17:12.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:17:12.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:12.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:17:12.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:17:12.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:17:12.379 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:12.377+0000 7ff47e74b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:12.381 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:12.379+0000 7ff47e74b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:12.382 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:12.380+0000 7ff47e74b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:12.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:12.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:12.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:17:12.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:12.569 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:12.568+0000 7ff47e74b780 -1 Falling back to public interface 2026-02-23T08:17:12.881 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:12.879+0000 7ff47e74b780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:17:13.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:13.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:13.552 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:13.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:13.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:13.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:17:13.643 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1455654041,v1:127.0.0.1:6801/1455654041] [v2:127.0.0.1:6802/1455654041,v1:127.0.0.1:6803/1455654041] exists,up 823d531e-770d-42c8-8f1c-01bf00a63133 2026-02-23T08:17:13.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:13.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:725: TEST_repair_stats: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:726: TEST_repair_stats: run_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:13.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:13.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=766c93f8-3963-4769-8834-31acf8019307 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 766c93f8-3963-4769-8834-31acf8019307 2026-02-23T08:17:13.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 766c93f8-3963-4769-8834-31acf8019307' 2026-02-23T08:17:13.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:17:13.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAJDZxpfYAYJxAA7zeLFcxzzgLnV68EtUCxYw== 2026-02-23T08:17:13.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAJDZxpfYAYJxAA7zeLFcxzzgLnV68EtUCxYw=="}' 2026-02-23T08:17:13.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 766c93f8-3963-4769-8834-31acf8019307 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:17:13.743 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:13.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:17:13.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAJDZxpfYAYJxAA7zeLFcxzzgLnV68EtUCxYw== --osd-uuid 766c93f8-3963-4769-8834-31acf8019307 2026-02-23T08:17:13.768 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:13.767+0000 7f9883155780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:13.770 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:13.768+0000 7f9883155780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:13.771 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:13.769+0000 7f9883155780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:13.771 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:13.769+0000 7f9883155780 -1 bdev(0x55db472af400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:17:13.771 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:13.769+0000 7f9883155780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:17:14.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:17:14.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:17:14.168 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:17:14.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:17:14.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:17:14.372 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:17:14.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:17:14.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:17:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:17:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:17:14.385 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:14.383+0000 7f40ccf71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:14.386 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:14.384+0000 7f40ccf71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:14.387 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:14.385+0000 7f40ccf71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:14.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:17:14.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:14.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:17:14.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:14.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:14.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:14.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:14.539 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:14.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:14.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:14.587 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:14.585+0000 7f40ccf71780 -1 Falling back to public interface 2026-02-23T08:17:14.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:14.947 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:14.945+0000 7f40ccf71780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:17:15.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:15.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:15.704 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:15.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:15.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:15.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:15.866 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/647937398,v1:127.0.0.1:6811/647937398] [v2:127.0.0.1:6812/647937398,v1:127.0.0.1:6813/647937398] exists,up 766c93f8-3963-4769-8834-31acf8019307 2026-02-23T08:17:15.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:15.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:15.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:15.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:729: TEST_repair_stats: create_pool testpool 1 1 2026-02-23T08:17:15.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 2026-02-23T08:17:16.041 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T08:17:16.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:17:17.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:730: TEST_repair_stats: ceph osd pool set testpool size 2 2026-02-23T08:17:17.254 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 size to 2 2026-02-23T08:17:17.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:731: TEST_repair_stats: wait_for_clean 2026-02-23T08:17:17.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:17:17.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:17:17.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:17:17.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:17:17.267 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:17:17.268 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:17:17.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:17:17.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:17:17.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:17:17.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:17:17.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:17:17.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:17:17.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:17:17.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:17:17.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:17:17.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:17:17.518 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:17:17.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:17:17.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:17.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:17:17.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:17:17.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:17:17.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:17:17.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:17.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:17:17.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-23T08:17:17.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-23T08:17:17.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-23T08:17:17.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:17.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:17:17.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:17.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:17:17.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:17:17.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:17.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:17:17.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:17:17.671 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:17:17.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:17.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-23T08:17:17.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:17.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-23T08:17:17.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:17.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:17:17.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-23T08:17:17.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:17.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-23T08:17:17.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-23T08:17:17.840 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672962 2026-02-23T08:17:17.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:17:18.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-23T08:17:18.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:17:18.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:18.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:18.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:17:18.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:17:18.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:17:18.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:17:18.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:17:18.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:17:18.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:17:18.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:17:18.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:17:18.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:17:18.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:18.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:18.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:17:18.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:17:18.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:17:18.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:734: TEST_repair_stats: local payload=ABCDEF 2026-02-23T08:17:18.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:735: TEST_repair_stats: echo ABCDEF 2026-02-23T08:17:18.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: seq 1 30 2026-02-23T08:17:18.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj11 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj12 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj13 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj14 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj15 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj16 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj17 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj18 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj19 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj20 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj21 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj22 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj23 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj24 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj25 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj26 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj27 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:18.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:18.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj28 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:19.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:19.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj29 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:19.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:736: TEST_repair_stats: for i in $(seq 1 $OBJS) 2026-02-23T08:17:19.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:738: TEST_repair_stats: rados --pool testpool put obj30 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:19.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:743: TEST_repair_stats: get_not_primary testpool obj1 2026-02-23T08:17:19.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T08:17:19.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-23T08:17:19.037 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool obj1 2026-02-23T08:17:19.037 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T08:17:19.037 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:17:19.037 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T08:17:19.038 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:17:19.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:17:19.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool obj1 2026-02-23T08:17:19.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:17:19.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:743: TEST_repair_stats: local other=0 2026-02-23T08:17:19.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:744: TEST_repair_stats: get_pg testpool obj1 2026-02-23T08:17:19.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T08:17:19.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-23T08:17:19.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-23T08:17:19.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:17:19.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:744: TEST_repair_stats: local pgid=1.0 2026-02-23T08:17:19.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:745: TEST_repair_stats: get_primary testpool obj1 2026-02-23T08:17:19.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T08:17:19.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:17:19.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T08:17:19.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:17:19.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:745: TEST_repair_stats: local primary=1 2026-02-23T08:17:19.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:747: TEST_repair_stats: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:17:19.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:19.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:19.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:19.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:19.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:20.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:20.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:748: TEST_repair_stats: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:17:20.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:20.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:20.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:20.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:20.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:20.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:20.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: seq 1 20 2026-02-23T08:17:20.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 1 % 2 2026-02-23T08:17:20.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:20.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj1 remove 2026-02-23T08:17:20.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:20.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:20.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:20.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj1 remove 2026-02-23T08:17:20.438 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-23T08:17:20.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:20.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 2 % 2 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-23T08:17:20.622 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:104778fc:::obj2:head# 2026-02-23T08:17:20.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:20.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 3 % 2 2026-02-23T08:17:20.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj3 remove 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:20.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj3 remove 2026-02-23T08:17:20.778 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:8dd16f86:::obj3:head# 2026-02-23T08:17:20.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:20.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 4 % 2 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj4 remove 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:20.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj4 remove 2026-02-23T08:17:20.952 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:0ee9ae15:::obj4:head# 2026-02-23T08:17:21.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 5 % 2 2026-02-23T08:17:21.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:21.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj5 remove 2026-02-23T08:17:21.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:21.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:21.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj5 remove 2026-02-23T08:17:21.107 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:head# 2026-02-23T08:17:21.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 6 % 2 2026-02-23T08:17:21.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:21.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj6 remove 2026-02-23T08:17:21.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:21.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:21.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj6 remove 2026-02-23T08:17:21.237 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:233a42c1:::obj6:head# 2026-02-23T08:17:21.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 7 % 2 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj7 remove 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:21.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj7 remove 2026-02-23T08:17:21.397 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:9a09113a:::obj7:head# 2026-02-23T08:17:21.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 8 % 2 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj8 remove 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:21.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj8 remove 2026-02-23T08:17:21.553 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:a557efb1:::obj8:head# 2026-02-23T08:17:21.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 9 % 2 2026-02-23T08:17:21.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj9 remove 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:21.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj9 remove 2026-02-23T08:17:21.714 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:fe351e27:::obj9:head# 2026-02-23T08:17:21.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 10 % 2 2026-02-23T08:17:21.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj10 remove 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:21.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj10 remove 2026-02-23T08:17:21.902 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:d1337354:::obj10:head# 2026-02-23T08:17:21.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:21.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 11 % 2 2026-02-23T08:17:21.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:21.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj11 remove 2026-02-23T08:17:21.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:21.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:21.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:21.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:21.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj11 remove 2026-02-23T08:17:22.067 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:eeae2a94:::obj11:head# 2026-02-23T08:17:22.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:22.128 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 12 % 2 2026-02-23T08:17:22.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:22.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj12 remove 2026-02-23T08:17:22.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:22.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:22.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:22.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj12 remove 2026-02-23T08:17:22.228 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:af5f95cb:::obj12:head# 2026-02-23T08:17:22.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:22.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 13 % 2 2026-02-23T08:17:22.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:22.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj13 remove 2026-02-23T08:17:22.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:22.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:22.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:22.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj13 remove 2026-02-23T08:17:22.385 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:a61ad63e:::obj13:head# 2026-02-23T08:17:22.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:22.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 14 % 2 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj14 remove 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:22.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj14 remove 2026-02-23T08:17:22.565 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:e0a44829:::obj14:head# 2026-02-23T08:17:22.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:22.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 15 % 2 2026-02-23T08:17:22.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj15 remove 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:22.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj15 remove 2026-02-23T08:17:22.727 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ab946124:::obj15:head# 2026-02-23T08:17:22.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:22.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 16 % 2 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj16 remove 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:22.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj16 remove 2026-02-23T08:17:22.876 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:461f8b5e:::obj16:head# 2026-02-23T08:17:22.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:22.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 17 % 2 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj17 remove 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:22.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj17 remove 2026-02-23T08:17:23.052 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:24fc6e92:::obj17:head# 2026-02-23T08:17:23.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:23.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 18 % 2 2026-02-23T08:17:23.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:23.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj18 remove 2026-02-23T08:17:23.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:23.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:23.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:23.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:23.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:23.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj18 remove 2026-02-23T08:17:23.263 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:b9836a99:::obj18:head# 2026-02-23T08:17:23.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:23.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 19 % 2 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=1 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 1 obj19 remove 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:23.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj19 remove 2026-02-23T08:17:23.446 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:00b31b6c:::obj19:head# 2026-02-23T08:17:23.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:749: TEST_repair_stats: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:23.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: expr 20 % 2 2026-02-23T08:17:23.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:752: TEST_repair_stats: OSD=0 2026-02-23T08:17:23.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:753: TEST_repair_stats: _objectstore_tool_nodown td/osd-scrub-repair 0 obj20 remove 2026-02-23T08:17:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:23.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj20 remove 2026-02-23T08:17:23.626 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:24b5611b:::obj20:head# 2026-02-23T08:17:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:755: TEST_repair_stats: activate_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:17:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:17:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:17:23.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:17:23.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:17:23.676 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:17:23.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:23.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:17:23.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:17:23.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:17:23.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:17:23.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:17:23.689 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:23.688+0000 7f6f2e162780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:23.691 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:23.690+0000 7f6f2e162780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:23.692 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:23.690+0000 7f6f2e162780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:23.844 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:23.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:23.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:23.896 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:23.893+0000 7f6f2e162780 -1 Falling back to public interface 2026-02-23T08:17:24.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:24.238 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:24.236+0000 7f6f2e162780 -1 osd.1 17 log_to_monitors true 2026-02-23T08:17:25.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:25.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:25.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:25.012 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:25.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:25.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:25.175 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 20 up_thru 20 down_at 18 last_clean_interval [10,17) [v2:127.0.0.1:6800/2351389969,v1:127.0.0.1:6801/2351389969] [v2:127.0.0.1:6802/2351389969,v1:127.0.0.1:6803/2351389969] exists,up 766c93f8-3963-4769-8834-31acf8019307 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:756: TEST_repair_stats: activate_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:25.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:25.180 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:25.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:17:25.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:25.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:17:25.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:17:25.182 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:17:25.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:25.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:17:25.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:17:25.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:17:25.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:17:25.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:17:25.191 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:25.190+0000 7fa38b175780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:25.193 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:25.192+0000 7fa38b175780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:25.194 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:25.193+0000 7fa38b175780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:25.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:17:25.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:25.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:17:25.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:25.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:25.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:25.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:25.348 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:25.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:25.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:17:25.408 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:25.408+0000 7fa38b175780 -1 Falling back to public interface 2026-02-23T08:17:25.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:25.727 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:25.726+0000 7fa38b175780 -1 osd.0 15 log_to_monitors true 2026-02-23T08:17:26.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:26.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:26.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:26.513 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:26.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:26.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:17:26.675 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 16 last_clean_interval [5,15) [v2:127.0.0.1:6810/2928117150,v1:127.0.0.1:6811/2928117150] [v2:127.0.0.1:6812/2928117150,v1:127.0.0.1:6813/2928117150] exists,up 823d531e-770d-42c8-8f1c-01bf00a63133 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:757: TEST_repair_stats: wait_for_clean 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:17:26.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:17:26.678 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:17:26.678 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:17:26.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:17:26.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:17:26.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:17:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:17:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:17:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:17:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:17:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:17:26.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:17:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:17:26.926 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:17:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:17:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:26.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:17:26.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-23T08:17:26.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-23T08:17:26.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-23T08:17:26.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:26.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:17:27.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345922 2026-02-23T08:17:27.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345922 2026-02-23T08:17:27.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-85899345922' 2026-02-23T08:17:27.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:27.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-23T08:17:27.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:27.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:17:27.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-23T08:17:27.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:27.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-23T08:17:27.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-23T08:17:27.074 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215106 2026-02-23T08:17:27.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:27.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 103079215106 2026-02-23T08:17:27.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:17:28.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:17:28.240 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:28.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-23T08:17:28.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:28.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-85899345922 2026-02-23T08:17:28.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:28.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:17:28.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-85899345922 2026-02-23T08:17:28.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:28.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345922 2026-02-23T08:17:28.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 85899345922' 2026-02-23T08:17:28.408 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 85899345922 2026-02-23T08:17:28.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:17:28.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345922 -lt 85899345922 2026-02-23T08:17:28.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:17:28.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:28.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:17:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:17:28.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:17:28.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:17:28.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:28.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:29.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:17:29.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:17:29.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:17:29.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:759: TEST_repair_stats: repair 1.0 2026-02-23T08:17:29.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-23T08:17:29.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-23T08:17:29.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:29.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:29.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:29.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:29.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:29.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-23T08:17:29.462 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T08:17:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:17:29.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:29.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:29.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:16.038371+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:29.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:30.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:30.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:30.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:30.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:30.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:30.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:30.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:30.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:16.038371+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:30.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:31.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:31.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:16.038371+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:31.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:32.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:32.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:32.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:32.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:32.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:32.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:32.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:33.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:16.038371+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:33.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:34.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:34.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:34.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:34.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:34.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:34.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:34.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:34.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:16.038371+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:34.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:35.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:35.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:35.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:35.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:35.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:35.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:35.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:35.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:16.038371+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:35.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:17:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:17:36.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:17:36.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:17:36.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:17:36.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:17:36.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:17:36.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:17:36.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:30.189047+0000 '>' 2026-02-23T08:17:16.038371+0000 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:760: TEST_repair_stats: wait_for_clean 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:17:36.640 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:17:36.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:17:36.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:17:36.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:17:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:17:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:17:36.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:17:36.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:17:36.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:17:36.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:17:36.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:17:36.890 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:17:36.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:17:36.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:36.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:17:36.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215109 2026-02-23T08:17:36.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215109 2026-02-23T08:17:36.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109' 2026-02-23T08:17:36.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:36.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:17:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345925 2026-02-23T08:17:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345925 2026-02-23T08:17:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215109 1-85899345925' 2026-02-23T08:17:37.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:37.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215109 2026-02-23T08:17:37.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:37.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:17:37.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215109 2026-02-23T08:17:37.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:37.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215109 2026-02-23T08:17:37.042 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215109 2026-02-23T08:17:37.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215109' 2026-02-23T08:17:37.043 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215109 2026-02-23T08:17:37.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:17:38.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:17:38.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:38.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215109 -lt 103079215109 2026-02-23T08:17:38.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:38.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-85899345925 2026-02-23T08:17:38.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:38.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:17:38.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-85899345925 2026-02-23T08:17:38.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:38.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345925 2026-02-23T08:17:38.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 85899345925' 2026-02-23T08:17:38.379 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 85899345925 2026-02-23T08:17:38.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:17:38.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345925 -lt 85899345925 2026-02-23T08:17:38.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:17:38.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:38.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:38.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:17:38.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:17:38.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:17:38.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:17:38.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:17:38.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:17:38.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:17:38.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:17:38.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:17:38.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:17:38.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:38.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:39.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:17:39.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:17:39.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:17:39.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:761: TEST_repair_stats: ceph pg dump pgs 2026-02-23T08:17:39.272 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T08:17:39.273 INFO:tasks.workunit.client.0.trial129.stdout:1.0 30 0 0 0 0 210 0 0 30 0 30 active+clean 2026-02-23T08:17:30.200263+0000 15'30 25:132 [1,0] 1 [1,0] 1 15'30 2026-02-23T08:17:30.189047+0000 15'30 2026-02-23T08:17:30.189047+0000 0 1 periodic scrub scheduled @ 2026-02-24T08:17:30.189047+0000 20 0 2026-02-23T08:17:39.273 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:17:39.273 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T08:17:39.273 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:17:39.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:762: TEST_repair_stats: flush_pg_stats 2026-02-23T08:17:39.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:17:39.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:17:39.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:17:39.446 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:17:39.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:17:39.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:39.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:17:39.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215110 2026-02-23T08:17:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215110 2026-02-23T08:17:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110' 2026-02-23T08:17:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:39.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:17:39.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345927 2026-02-23T08:17:39.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345927 2026-02-23T08:17:39.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215110 1-85899345927' 2026-02-23T08:17:39.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:39.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215110 2026-02-23T08:17:39.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:39.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:17:39.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215110 2026-02-23T08:17:39.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:39.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215110 2026-02-23T08:17:39.596 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215110 2026-02-23T08:17:39.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215110' 2026-02-23T08:17:39.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:39.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215110 -lt 103079215110 2026-02-23T08:17:39.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:39.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-85899345927 2026-02-23T08:17:39.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:39.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:17:39.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-85899345927 2026-02-23T08:17:39.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:39.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345927 2026-02-23T08:17:39.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 85899345927' 2026-02-23T08:17:39.766 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 85899345927 2026-02-23T08:17:39.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:17:39.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345927 -lt 85899345927 2026-02-23T08:17:39.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:765: TEST_repair_stats: ceph pg 1.0 query 2026-02-23T08:17:39.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:765: TEST_repair_stats: jq .info.stats.stat_sum 2026-02-23T08:17:40.005 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:17:40.005 INFO:tasks.workunit.client.0.trial129.stdout: "num_bytes": 210, 2026-02-23T08:17:40.005 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects": 30, 2026-02-23T08:17:40.005 INFO:tasks.workunit.client.0.trial129.stdout: "num_object_clones": 0, 2026-02-23T08:17:40.005 INFO:tasks.workunit.client.0.trial129.stdout: "num_object_copies": 60, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_missing_on_primary": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_missing": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_degraded": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_misplaced": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_unfound": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_dirty": 30, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_whiteouts": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_read": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_read_kb": 0, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_write": 30, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_write_kb": 30, 2026-02-23T08:17:40.006 INFO:tasks.workunit.client.0.trial129.stdout: "num_scrub_errors": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_shallow_scrub_errors": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_deep_scrub_errors": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_recovered": 20, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_bytes_recovered": 140, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_keys_recovered": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_omap": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_hit_set_archive": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_bytes_hit_set_archive": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush_kb": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict": 0, 2026-02-23T08:17:40.007 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict_kb": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_promote": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush_mode_high": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush_mode_low": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict_mode_some": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict_mode_full": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_pinned": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_legacy_snapsets": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_large_omap_objects": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_manifest": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_omap_bytes": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_omap_keys": 0, 2026-02-23T08:17:40.008 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_repaired": 20 2026-02-23T08:17:40.009 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:17:40.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:766: TEST_repair_stats: ceph pg 1.0 query 2026-02-23T08:17:40.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:766: TEST_repair_stats: jq .info.stats.stat_sum.num_objects_repaired 2026-02-23T08:17:40.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:766: TEST_repair_stats: COUNT=20 2026-02-23T08:17:40.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:767: TEST_repair_stats: test 20 = 20 2026-02-23T08:17:40.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:769: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-23T08:17:40.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:769: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 1 )' 2026-02-23T08:17:40.233 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:17:40.244 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:17:40.244 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:17:40.244 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 20, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 85899345927, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 1, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 1, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 1, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 1, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 104857600, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 28568, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 328, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 8, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 28215, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 104829032, 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:17:40.245 INFO:tasks.workunit.client.0.trial129.stdout: "total": 107374182400, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "available": 107344928768, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 335872, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 56228, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 8303, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 28893073 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [ 2026-02-23T08:17:40.246 INFO:tasks.workunit.client.0.trial129.stdout: 0 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 10, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:17:40.247 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:17:40.248 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.248 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [] 2026-02-23T08:17:40.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:17:40.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:770: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-23T08:17:40.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:770: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 1 ).num_shards_repaired' 2026-02-23T08:17:40.401 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:17:40.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:770: TEST_repair_stats: COUNT=10 2026-02-23T08:17:40.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:771: TEST_repair_stats: expr 20 / 2 2026-02-23T08:17:40.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:771: TEST_repair_stats: test 10 = 10 2026-02-23T08:17:40.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:773: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-23T08:17:40.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:773: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 0 )' 2026-02-23T08:17:40.568 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 24, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 103079215110, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 1, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 1, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 1, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 1, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 104857600, 2026-02-23T08:17:40.579 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 28568, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 328, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 5, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 28218, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 104829032, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "total": 107374182400, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "available": 107344928768, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 335872, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 56228, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:17:40.580 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 5702, 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 28895674 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [ 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 10, 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:17:40.581 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [] 2026-02-23T08:17:40.582 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:17:40.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:774: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-23T08:17:40.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:774: TEST_repair_stats: jq '.pg_map.osd_stats[] | select(.osd == 0 ).num_shards_repaired' 2026-02-23T08:17:40.733 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:17:40.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:774: TEST_repair_stats: COUNT=10 2026-02-23T08:17:40.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:775: TEST_repair_stats: expr 20 / 2 2026-02-23T08:17:40.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:775: TEST_repair_stats: test 10 = 10 2026-02-23T08:17:40.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:777: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-23T08:17:40.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:777: TEST_repair_stats: jq .pg_map.osd_stats_sum 2026-02-23T08:17:40.899 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:17:40.910 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 2, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 2, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 2, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 2, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 209715200, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 57136, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 656, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 13, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 56434, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 209658064, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "total": 214748364800, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "available": 214689857536, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 671744, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 112456, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 14005, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 57788747 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [], 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 20, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [], 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout: "network_ping_times": [] 2026-02-23T08:17:40.911 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:17:40.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:778: TEST_repair_stats: ceph pg dump --format=json-pretty 2026-02-23T08:17:40.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:778: TEST_repair_stats: jq .pg_map.osd_stats_sum.num_shards_repaired 2026-02-23T08:17:41.064 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:778: TEST_repair_stats: COUNT=20 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:779: TEST_repair_stats: test 20 = 20 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:41.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:41.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:41.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:41.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:17:41.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:17:41.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:17:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:17:41.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:17:41.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:17:41.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:41.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:17:41.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:17:41.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:41.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:17:41.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:17:41.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:17:41.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:17:41.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:41.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:41.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:17:41.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:17:41.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:17:41.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:17:41.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:17:41.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:17:41.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:41.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:17:41.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:17:41.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:17:41.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:17:41.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:17:41.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:17:41.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:17:41.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:17:41.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:17:41.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:17:41.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:17:41.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:17:41.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:17:41.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:17:41.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:17:41.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_repair_stats_ec td/osd-scrub-repair 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:783: TEST_repair_stats_ec: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:784: TEST_repair_stats_ec: local poolname=testpool 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:785: TEST_repair_stats_ec: local OSDS=3 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:786: TEST_repair_stats_ec: local OBJS=30 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:788: TEST_repair_stats_ec: local REPAIRS=26 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:789: TEST_repair_stats_ec: local allow_overwrites=false 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:792: TEST_repair_stats_ec: run_mon td/osd-scrub-repair a 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:17:41.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:17:41.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:17:41.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:17:41.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:17:41.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:17:41.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:41.233 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:41.233 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:41.233 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.234 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:41.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:17:41.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:17:41.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:17:41.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:17:41.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:17:41.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:17:41.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:17:41.255 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:17:41.255 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:17:41.255 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:17:41.256 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:17:41.256 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.256 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.256 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:17:41.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:17:41.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:17:41.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:17:41.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:17:41.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:17:41.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.315 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.316 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:17:41.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:17:41.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:793: TEST_repair_stats_ec: run_mgr td/osd-scrub-repair x 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:17:41.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:17:41.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:17:41.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:41.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:41.467 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:41.467 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.467 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:41.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:17:41.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:17:41.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:795: TEST_repair_stats_ec: local 'ceph_osd_args=--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:41.483 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: expr 3 - 1 2026-02-23T08:17:41.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: seq 0 2 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:797: TEST_repair_stats_ec: run_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:17:41.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:41.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:41.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=91897150-3cf9-4592-a245-696478ec5868 2026-02-23T08:17:41.492 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 91897150-3cf9-4592-a245-696478ec5868 2026-02-23T08:17:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 91897150-3cf9-4592-a245-696478ec5868' 2026-02-23T08:17:41.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:17:41.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAlDZxpNUeZHRAA87XJuuX2kWZYpbrVAmrEjA== 2026-02-23T08:17:41.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAlDZxpNUeZHRAA87XJuuX2kWZYpbrVAmrEjA=="}' 2026-02-23T08:17:41.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 91897150-3cf9-4592-a245-696478ec5868 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:17:41.587 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:41.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:17:41.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAlDZxpNUeZHRAA87XJuuX2kWZYpbrVAmrEjA== --osd-uuid 91897150-3cf9-4592-a245-696478ec5868 2026-02-23T08:17:41.611 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:41.610+0000 7fbaeb757780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:41.613 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:41.612+0000 7fbaeb757780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:41.614 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:41.613+0000 7fbaeb757780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:41.614 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:41.613+0000 7fbaeb757780 -1 bdev(0x555d84167400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:17:41.614 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:41.613+0000 7fbaeb757780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:17:42.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:17:42.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:17:42.095 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:17:42.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:17:42.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:17:42.192 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:17:42.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:17:42.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:42.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:17:42.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:17:42.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:17:42.204 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:42.204+0000 7fd5b9d4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:42.206 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:42.205+0000 7fd5b9d4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:42.207 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:42.206+0000 7fd5b9d4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:42.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:17:42.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:42.419 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:42.417+0000 7fd5b9d4f780 -1 Falling back to public interface 2026-02-23T08:17:42.820 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:42.819+0000 7fd5b9d4f780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:17:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:43.380 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:17:43.474 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3148137579,v1:127.0.0.1:6801/3148137579] [v2:127.0.0.1:6802/3148137579,v1:127.0.0.1:6803/3148137579] exists,up 91897150-3cf9-4592-a245-696478ec5868 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:797: TEST_repair_stats_ec: run_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:17:43.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:43.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:43.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:17:43.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:17:43.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=57c7c6a5-8a26-402d-bc0f-897eea75415a 2026-02-23T08:17:43.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 57c7c6a5-8a26-402d-bc0f-897eea75415a' 2026-02-23T08:17:43.482 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 57c7c6a5-8a26-402d-bc0f-897eea75415a 2026-02-23T08:17:43.482 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:17:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAnDZxpKqMFHRAASXzy7XZWK3pYMyjlipOfCQ== 2026-02-23T08:17:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAnDZxpKqMFHRAASXzy7XZWK3pYMyjlipOfCQ=="}' 2026-02-23T08:17:43.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 57c7c6a5-8a26-402d-bc0f-897eea75415a -i td/osd-scrub-repair/1/new.json 2026-02-23T08:17:43.575 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:43.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:17:43.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQAnDZxpKqMFHRAASXzy7XZWK3pYMyjlipOfCQ== --osd-uuid 57c7c6a5-8a26-402d-bc0f-897eea75415a 2026-02-23T08:17:43.599 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:43.598+0000 7f37c3d71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:43.600 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:43.599+0000 7f37c3d71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:43.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:43.600+0000 7f37c3d71780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:43.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:43.600+0000 7f37c3d71780 -1 bdev(0x5613a487d400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:17:43.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:43.600+0000 7f37c3d71780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:17:44.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:17:44.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:17:44.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:17:44.055 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:17:44.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:17:44.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:17:44.262 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:17:44.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:44.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:17:44.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:17:44.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:17:44.276 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:44.275+0000 7f080f175780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:44.277 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:44.277+0000 7f080f175780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:44.278 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:44.277+0000 7f080f175780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:44.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:17:44.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:44.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:17:44.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:44.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:44.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:44.434 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:44.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:44.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:44.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:44.483 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:44.483+0000 7f080f175780 -1 Falling back to public interface 2026-02-23T08:17:44.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:44.845 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:44.844+0000 7f080f175780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:17:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:45.598 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:45.763 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1487981193,v1:127.0.0.1:6811/1487981193] [v2:127.0.0.1:6812/1487981193,v1:127.0.0.1:6813/1487981193] exists,up 57c7c6a5-8a26-402d-bc0f-897eea75415a 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:796: TEST_repair_stats_ec: for id in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:797: TEST_repair_stats_ec: run_osd td/osd-scrub-repair 2 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:17:45.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:45.768 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:17:45.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:45.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:17:45.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:17:45.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=84291ab8-d16d-4e85-90d2-4d6c74a87e81 2026-02-23T08:17:45.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 84291ab8-d16d-4e85-90d2-4d6c74a87e81' 2026-02-23T08:17:45.771 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 84291ab8-d16d-4e85-90d2-4d6c74a87e81 2026-02-23T08:17:45.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:17:45.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQApDZxp0D0/LhAAhyMlZ71PGX7wkqm5EYXchA== 2026-02-23T08:17:45.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQApDZxp0D0/LhAAhyMlZ71PGX7wkqm5EYXchA=="}' 2026-02-23T08:17:45.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 84291ab8-d16d-4e85-90d2-4d6c74a87e81 -i td/osd-scrub-repair/2/new.json 2026-02-23T08:17:45.937 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:17:45.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:17:45.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 --mkfs --key AQApDZxp0D0/LhAAhyMlZ71PGX7wkqm5EYXchA== --osd-uuid 84291ab8-d16d-4e85-90d2-4d6c74a87e81 2026-02-23T08:17:45.962 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:45.961+0000 7f6f24209780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:45.964 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:45.963+0000 7f6f24209780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:45.964 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:45.964+0000 7f6f24209780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:45.965 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:45.964+0000 7f6f24209780 -1 bdev(0x556158f7b400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:17:45.965 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:45.964+0000 7f6f24209780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:17:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:17:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:17:46.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:17:46.355 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:17:46.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:17:46.563 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:17:46.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:17:46.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:46.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:17:46.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:17:46.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:17:46.577 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:46.576+0000 7f4a64e7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:46.578 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:46.577+0000 7f4a64e7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:46.579 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:46.578+0000 7f4a64e7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:46.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:17:46.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:46.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:17:46.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:46.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:46.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:46.729 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:46.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:46.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:46.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:17:46.799 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:46.798+0000 7f4a64e7e780 -1 Falling back to public interface 2026-02-23T08:17:46.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:47.127 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:47.126+0000 7f4a64e7e780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:17:47.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:17:47.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:47.894 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:17:47.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:17:47.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:47.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:17:48.059 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1593778177,v1:127.0.0.1:6819/1593778177] [v2:127.0.0.1:6820/1593778177,v1:127.0.0.1:6821/1593778177] exists,up 84291ab8-d16d-4e85-90d2-4d6c74a87e81 2026-02-23T08:17:48.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:17:48.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:17:48.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:17:48.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:801: TEST_repair_stats_ec: create_ec_pool testpool false k=2 m=1 2026-02-23T08:17:48.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=testpool 2026-02-23T08:17:48.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:17:48.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T08:17:48.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:17:48.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-23T08:17:48.302 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:17:48.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool testpool 1 1 erasure myprofile 2026-02-23T08:17:48.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create testpool 1 1 erasure myprofile 2026-02-23T08:17:48.606 INFO:tasks.workunit.client.0.trial129.stderr:pool 'testpool' created 2026-02-23T08:17:48.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:17:49.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T08:17:49.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:17:49.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:17:49.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:17:49.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:17:49.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:17:49.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:17:49.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:17:49.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:17:49.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:17:49.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:17:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:17:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:17:49.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:17:49.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:17:49.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:17:49.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:17:49.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:17:49.872 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:17:49.872 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:17:49.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:17:49.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:49.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:17:49.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:17:49.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:17:49.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:17:49.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:49.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:17:50.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-23T08:17:50.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-23T08:17:50.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-23T08:17:50.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:17:50.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:17:50.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T08:17:50.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T08:17:50.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-60129542146' 2026-02-23T08:17:50.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:50.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:17:50.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:50.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:17:50.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:17:50.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:50.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:17:50.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:17:50.097 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:17:50.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:50.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:17:50.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:17:51.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:17:51.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:51.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:17:51.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:17:52.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:17:52.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:17:52.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:17:52.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:52.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-23T08:17:52.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:52.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:17:52.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-23T08:17:52.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:52.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-23T08:17:52.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-23T08:17:52.601 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672963 2026-02-23T08:17:52.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:17:52.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672963 2026-02-23T08:17:52.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:17:52.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T08:17:52.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:17:52.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:17:52.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T08:17:52.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:17:52.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T08:17:52.771 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T08:17:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T08:17:52.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:17:52.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542146 -lt 60129542146 2026-02-23T08:17:52.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:17:52.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:52.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:17:53.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:17:53.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:17:53.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:17:53.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:17:53.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:17:53.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:804: TEST_repair_stats_ec: local payload=ABCDEF 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:805: TEST_repair_stats_ec: echo ABCDEF 2026-02-23T08:17:53.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: seq 1 30 2026-02-23T08:17:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj1 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj2 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj3 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj4 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj5 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj6 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj7 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj8 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj9 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj10 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj11 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj12 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj13 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj14 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj15 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj16 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj17 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj18 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj19 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj20 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj21 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj22 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj23 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj24 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj25 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj26 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj27 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj28 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj29 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:806: TEST_repair_stats_ec: for i in $(seq 1 $OBJS) 2026-02-23T08:17:53.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:808: TEST_repair_stats_ec: rados --pool testpool put obj30 td/osd-scrub-repair/ORIGINAL 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:813: TEST_repair_stats_ec: get_not_primary testpool obj1 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=testpool 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary testpool obj1 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:17:53.953 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T08:17:53.954 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:17:54.118 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:17:54.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map testpool obj1 2026-02-23T08:17:54.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:17:54.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:813: TEST_repair_stats_ec: local other=0 2026-02-23T08:17:54.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:814: TEST_repair_stats_ec: get_pg testpool obj1 2026-02-23T08:17:54.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=testpool 2026-02-23T08:17:54.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=obj1 2026-02-23T08:17:54.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map testpool obj1 2026-02-23T08:17:54.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:17:54.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:814: TEST_repair_stats_ec: local pgid=1.0 2026-02-23T08:17:54.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:815: TEST_repair_stats_ec: get_primary testpool obj1 2026-02-23T08:17:54.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=testpool 2026-02-23T08:17:54.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:17:54.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map testpool obj1 2026-02-23T08:17:54.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:17:54.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:815: TEST_repair_stats_ec: local primary=1 2026-02-23T08:17:54.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:817: TEST_repair_stats_ec: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:17:54.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:54.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:54.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:54.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:54.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:818: TEST_repair_stats_ec: kill_daemons td/osd-scrub-repair TERM osd.1 2026-02-23T08:17:54.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:17:54.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:17:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:17:54.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:17:54.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:17:55.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:17:55.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: seq 1 26 2026-02-23T08:17:55.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 1 % 2 2026-02-23T08:17:55.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:55.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj1 remove 2026-02-23T08:17:55.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:55.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:55.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj1 remove 2026-02-23T08:17:55.153 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:ff7b1f36:::obj1:head# 2026-02-23T08:17:55.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 2 % 2 2026-02-23T08:17:55.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj2 remove 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:55.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj2 remove 2026-02-23T08:17:55.319 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:104778fc:::obj2:head# 2026-02-23T08:17:55.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 3 % 2 2026-02-23T08:17:55.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj3 remove 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:55.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj3 remove 2026-02-23T08:17:55.501 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:8dd16f86:::obj3:head# 2026-02-23T08:17:55.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 4 % 2 2026-02-23T08:17:55.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:55.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj4 remove 2026-02-23T08:17:55.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:55.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:55.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj4 remove 2026-02-23T08:17:55.654 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:0ee9ae15:::obj4:head# 2026-02-23T08:17:55.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 5 % 2 2026-02-23T08:17:55.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj5 remove 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj5 remove 2026-02-23T08:17:55.786 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:c52c9666:::obj5:head# 2026-02-23T08:17:55.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.833 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 6 % 2 2026-02-23T08:17:55.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj6 remove 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:55.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj6 remove 2026-02-23T08:17:55.942 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:233a42c1:::obj6:head# 2026-02-23T08:17:55.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:55.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 7 % 2 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj7 remove 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:55.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj7 remove 2026-02-23T08:17:56.113 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:9a09113a:::obj7:head# 2026-02-23T08:17:56.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:56.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 8 % 2 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj8 remove 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:56.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj8 remove 2026-02-23T08:17:56.272 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:a557efb1:::obj8:head# 2026-02-23T08:17:56.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:56.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 9 % 2 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj9 remove 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:56.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj9 remove 2026-02-23T08:17:56.433 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:fe351e27:::obj9:head# 2026-02-23T08:17:56.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:56.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 10 % 2 2026-02-23T08:17:56.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:56.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj10 remove 2026-02-23T08:17:56.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:56.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:56.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:56.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj10 remove 2026-02-23T08:17:56.597 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:d1337354:::obj10:head# 2026-02-23T08:17:56.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:56.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 11 % 2 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj11 remove 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:56.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj11 remove 2026-02-23T08:17:56.783 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:eeae2a94:::obj11:head# 2026-02-23T08:17:56.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:56.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 12 % 2 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj12 remove 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:56.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj12 remove 2026-02-23T08:17:56.947 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:af5f95cb:::obj12:head# 2026-02-23T08:17:56.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:56.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 13 % 2 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj13 remove 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:56.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:56.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj13 remove 2026-02-23T08:17:57.108 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:a61ad63e:::obj13:head# 2026-02-23T08:17:57.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:57.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 14 % 2 2026-02-23T08:17:57.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:57.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj14 remove 2026-02-23T08:17:57.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:57.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:57.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:57.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj14 remove 2026-02-23T08:17:57.292 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:e0a44829:::obj14:head# 2026-02-23T08:17:57.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:57.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 15 % 2 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj15 remove 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:57.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj15 remove 2026-02-23T08:17:57.467 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:ab946124:::obj15:head# 2026-02-23T08:17:57.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:57.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 16 % 2 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj16 remove 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:57.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj16 remove 2026-02-23T08:17:57.644 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:461f8b5e:::obj16:head# 2026-02-23T08:17:57.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:57.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 17 % 2 2026-02-23T08:17:57.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:57.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj17 remove 2026-02-23T08:17:57.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:57.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:57.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:57.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj17 remove 2026-02-23T08:17:57.809 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:24fc6e92:::obj17:head# 2026-02-23T08:17:57.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:57.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 18 % 2 2026-02-23T08:17:57.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj18 remove 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:57.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj18 remove 2026-02-23T08:17:57.988 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:b9836a99:::obj18:head# 2026-02-23T08:17:58.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:58.057 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 19 % 2 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj19 remove 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:58.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj19 remove 2026-02-23T08:17:58.166 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:00b31b6c:::obj19:head# 2026-02-23T08:17:58.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:58.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 20 % 2 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj20 remove 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:58.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj20 remove 2026-02-23T08:17:58.324 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:24b5611b:::obj20:head# 2026-02-23T08:17:58.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:58.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 21 % 2 2026-02-23T08:17:58.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj21 remove 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:58.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj21 remove 2026-02-23T08:17:58.496 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:1243fe1a:::obj21:head# 2026-02-23T08:17:58.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:58.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 22 % 2 2026-02-23T08:17:58.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:58.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj22 remove 2026-02-23T08:17:58.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:58.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:58.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:58.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj22 remove 2026-02-23T08:17:58.691 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:c0c49def:::obj22:head# 2026-02-23T08:17:58.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:58.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 23 % 2 2026-02-23T08:17:58.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:58.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj23 remove 2026-02-23T08:17:58.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:58.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:58.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:58.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj23 remove 2026-02-23T08:17:58.847 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:242c40e0:::obj23:head# 2026-02-23T08:17:58.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:58.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 24 % 2 2026-02-23T08:17:58.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj24 remove 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:58.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj24 remove 2026-02-23T08:17:59.007 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:7eacede5:::obj24:head# 2026-02-23T08:17:59.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:59.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 25 % 2 2026-02-23T08:17:59.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=1 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 1 obj25 remove 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:59.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/1 obj25 remove 2026-02-23T08:17:59.168 INFO:tasks.workunit.client.0.trial129.stdout:remove 0#1:7109478f:::obj25:head# 2026-02-23T08:17:59.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:819: TEST_repair_stats_ec: for i in $(seq 1 $REPAIRS) 2026-02-23T08:17:59.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: expr 26 % 2 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:822: TEST_repair_stats_ec: OSD=0 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:823: TEST_repair_stats_ec: _objectstore_tool_nodown td/osd-scrub-repair 0 obj26 remove 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:17:59.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 obj26 remove 2026-02-23T08:17:59.330 INFO:tasks.workunit.client.0.trial129.stdout:remove 1#1:f3c2593a:::obj26:head# 2026-02-23T08:17:59.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:825: TEST_repair_stats_ec: activate_osd td/osd-scrub-repair 1 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:59.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:17:59.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:17:59.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:17:59.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:59.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:17:59.369 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/1/whoami 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:17:59.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:17:59.380 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:59.380+0000 7f0ca8b46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:59.382 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:59.381+0000 7f0ca8b46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:59.382 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:59.382+0000 7f0ca8b46780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:17:59.520 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:59.518+0000 7f0ca8b46780 -1 Falling back to public interface 2026-02-23T08:17:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:17:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:17:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:17:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:17:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:17:59.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:17:59.540 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:17:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:17:59.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:17:59.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:17:59.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:17:59.873 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:17:59.872+0000 7f0ca8b46780 -1 osd.1 22 log_to_monitors true 2026-02-23T08:18:00.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:18:00.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:18:00.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:18:00.704 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:18:00.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:18:00.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:18:00.872 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 25 up_thru 25 down_at 22 last_clean_interval [10,22) [v2:127.0.0.1:6800/621355867,v1:127.0.0.1:6801/621355867] [v2:127.0.0.1:6802/621355867,v1:127.0.0.1:6803/621355867] exists,up 57c7c6a5-8a26-402d-bc0f-897eea75415a 2026-02-23T08:18:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:18:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:18:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:18:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:826: TEST_repair_stats_ec: activate_osd td/osd-scrub-repair 0 --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:18:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:18:00.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:18:00.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:18:00.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0' 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:18:00.879 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:18:00.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:18:00.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd-scrub-interval-randomize-ratio=0 2026-02-23T08:18:00.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:18:00.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:18:00.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:18:00.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:18:00.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:18:00.887 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:00.887+0000 7f71dff4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:00.889 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:00.888+0000 7f71dff4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:00.889 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:00.889+0000 7f71dff4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:01.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:18:01.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:18:01.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:18:01.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:18:01.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:18:01.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:18:01.049 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:18:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:18:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:18:01.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:18:01.069 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:01.069+0000 7f71dff4f780 -1 Falling back to public interface 2026-02-23T08:18:01.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:18:01.393 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:01.392+0000 7f71dff4f780 -1 osd.0 20 log_to_monitors true 2026-02-23T08:18:02.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:18:02.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:18:02.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:18:02.211 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:18:02.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:18:02.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:18:02.378 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 29 up_thru 0 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6810/3885519577,v1:127.0.0.1:6811/3885519577] [v2:127.0.0.1:6812/3885519577,v1:127.0.0.1:6813/3885519577] exists,up 91897150-3cf9-4592-a245-696478ec5868 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:827: TEST_repair_stats_ec: wait_for_clean 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:18:02.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:18:02.381 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:18:02.381 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:18:02.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:18:02.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:18:02.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:18:02.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:18:02.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:18:02.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:18:02.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:18:02.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:18:02.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:18:02.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:18:02.628 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:18:02.628 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:18:02.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:18:02.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:02.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:18:02.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051586 2026-02-23T08:18:02.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051586 2026-02-23T08:18:02.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586' 2026-02-23T08:18:02.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:02.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:18:02.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182402 2026-02-23T08:18:02.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182402 2026-02-23T08:18:02.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-107374182402' 2026-02-23T08:18:02.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:02.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:18:02.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542149 2026-02-23T08:18:02.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542149 2026-02-23T08:18:02.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051586 1-107374182402 2-60129542149' 2026-02-23T08:18:02.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:02.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051586 2026-02-23T08:18:02.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:02.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:18:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051586 2026-02-23T08:18:02.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:02.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051586 2026-02-23T08:18:02.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051586' 2026-02-23T08:18:02.857 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 124554051586 2026-02-23T08:18:02.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 124554051586 2026-02-23T08:18:03.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:18:04.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:18:04.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:04.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051586 2026-02-23T08:18:04.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:04.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-107374182402 2026-02-23T08:18:04.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:04.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:18:04.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-107374182402 2026-02-23T08:18:04.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:04.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182402 2026-02-23T08:18:04.191 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 107374182402 2026-02-23T08:18:04.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 107374182402' 2026-02-23T08:18:04.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:18:04.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182402 -lt 107374182402 2026-02-23T08:18:04.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:04.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542149 2026-02-23T08:18:04.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:04.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:18:04.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542149 2026-02-23T08:18:04.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:04.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542149 2026-02-23T08:18:04.361 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542149 2026-02-23T08:18:04.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542149' 2026-02-23T08:18:04.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:18:04.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542149 2026-02-23T08:18:04.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:18:04.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:18:04.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:18:04.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:18:04.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:18:04.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:18:04.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:18:04.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:18:04.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:18:04.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:18:04.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:18:04.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:18:04.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:18:04.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:18:04.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:18:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:18:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:18:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:18:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:829: TEST_repair_stats_ec: repair 1.0 2026-02-23T08:18:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-23T08:18:05.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-23T08:18:05.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:05.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:05.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:05.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:05.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:05.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-23T08:18:05.418 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0s0 on osd.1 to repair 2026-02-23T08:18:05.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:05.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:18:05.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:05.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:18:05.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:18:05.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:05.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:05.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:05.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:05.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:05.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:05.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:48.603991+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:05.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:06.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:06.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:06.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:06.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:06.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:06.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:06.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:06.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:48.603991+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:06.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:07.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:07.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:07.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:07.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:07.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:07.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:07.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:07.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:48.603991+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:07.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:08.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:08.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:08.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:08.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:08.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:08.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:08.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:09.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:48.603991+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:09.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:10.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:10.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:10.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:10.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:10.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:10.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:10.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:10.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:48.603991+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:10.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:11.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:11.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:11.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:11.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:11.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:11.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:11.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:11.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:17:48.603991+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:11.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:12.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:12.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:12.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:12.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:12.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:12.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:12.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:12.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:18:05.815586+0000 '>' 2026-02-23T08:17:48.603991+0000 2026-02-23T08:18:12.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:18:12.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:830: TEST_repair_stats_ec: wait_for_clean 2026-02-23T08:18:12.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:18:12.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:18:12.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:18:12.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:18:12.609 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:18:12.609 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:18:12.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:18:12.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:18:12.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:18:12.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:18:12.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:18:12.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:18:12.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:18:12.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:18:12.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:18:12.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:18:12.860 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:18:12.860 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:18:12.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:18:12.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:12.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:18:12.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051589 2026-02-23T08:18:12.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051589 2026-02-23T08:18:12.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589' 2026-02-23T08:18:12.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:12.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:18:13.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182405 2026-02-23T08:18:13.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182405 2026-02-23T08:18:13.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589 1-107374182405' 2026-02-23T08:18:13.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:13.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:18:13.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542152 2026-02-23T08:18:13.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542152 2026-02-23T08:18:13.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589 1-107374182405 2-60129542152' 2026-02-23T08:18:13.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:13.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051589 2026-02-23T08:18:13.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:13.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:18:13.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051589 2026-02-23T08:18:13.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:13.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051589 2026-02-23T08:18:13.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051589' 2026-02-23T08:18:13.089 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 124554051589 2026-02-23T08:18:13.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:13.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051588 -lt 124554051589 2026-02-23T08:18:13.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:18:14.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:18:14.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:14.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051589 -lt 124554051589 2026-02-23T08:18:14.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:14.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-107374182405 2026-02-23T08:18:14.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:14.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:18:14.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-107374182405 2026-02-23T08:18:14.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:14.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182405 2026-02-23T08:18:14.431 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 107374182405 2026-02-23T08:18:14.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 107374182405' 2026-02-23T08:18:14.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:18:14.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182405 -lt 107374182405 2026-02-23T08:18:14.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:14.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542152 2026-02-23T08:18:14.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:14.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:18:14.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542152 2026-02-23T08:18:14.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:14.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542152 2026-02-23T08:18:14.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542152' 2026-02-23T08:18:14.603 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542152 2026-02-23T08:18:14.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:18:14.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542152 2026-02-23T08:18:14.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:18:14.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:18:14.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:18:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:18:15.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:18:15.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:18:15.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:18:15.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:18:15.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:18:15.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:18:15.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:18:15.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:831: TEST_repair_stats_ec: ceph pg dump pgs 2026-02-23T08:18:15.501 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T08:18:15.501 INFO:tasks.workunit.client.0.trial129.stdout:1.0 30 0 0 0 0 210 0 0 30 0 30 active+clean 2026-02-23T08:18:05.838694+0000 20'30 30:135 [1,0,2] 1 [1,0,2] 1 20'30 2026-02-23T08:18:05.815586+0000 20'30 2026-02-23T08:18:05.815586+0000 0 1 periodic scrub scheduled @ 2026-02-24T08:18:05.815586+0000 17 0 2026-02-23T08:18:15.501 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:18:15.501 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T08:18:15.501 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:18:15.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:832: TEST_repair_stats_ec: flush_pg_stats 2026-02-23T08:18:15.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:18:15.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:18:15.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:18:15.680 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:18:15.680 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:18:15.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:18:15.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:15.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:18:15.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051590 2026-02-23T08:18:15.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051590 2026-02-23T08:18:15.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051590' 2026-02-23T08:18:15.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:15.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:18:15.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=107374182407 2026-02-23T08:18:15.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 107374182407 2026-02-23T08:18:15.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051590 1-107374182407' 2026-02-23T08:18:15.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:15.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:18:15.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542154 2026-02-23T08:18:15.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542154 2026-02-23T08:18:15.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051590 1-107374182407 2-60129542154' 2026-02-23T08:18:15.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:15.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051590 2026-02-23T08:18:15.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:15.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:18:15.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051590 2026-02-23T08:18:15.907 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:15.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051590 2026-02-23T08:18:15.909 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 124554051590 2026-02-23T08:18:15.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051590' 2026-02-23T08:18:15.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:16.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051589 -lt 124554051590 2026-02-23T08:18:16.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:18:17.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:18:17.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:17.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051589 -lt 124554051590 2026-02-23T08:18:17.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:18:18.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:18:18.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:18.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051591 -lt 124554051590 2026-02-23T08:18:18.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:18.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-107374182407 2026-02-23T08:18:18.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:18.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:18:18.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-107374182407 2026-02-23T08:18:18.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:18.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=107374182407 2026-02-23T08:18:18.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 107374182407' 2026-02-23T08:18:18.411 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 107374182407 2026-02-23T08:18:18.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:18:18.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 107374182407 -lt 107374182407 2026-02-23T08:18:18.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:18.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542154 2026-02-23T08:18:18.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:18.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:18:18.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542154 2026-02-23T08:18:18.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:18.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542154 2026-02-23T08:18:18.580 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542154 2026-02-23T08:18:18.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542154' 2026-02-23T08:18:18.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:18:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542154 2026-02-23T08:18:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:835: TEST_repair_stats_ec: ceph pg 1.0 query 2026-02-23T08:18:18.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:835: TEST_repair_stats_ec: jq .info.stats.stat_sum 2026-02-23T08:18:18.819 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_bytes": 210, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects": 30, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_object_clones": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_object_copies": 90, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_missing_on_primary": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_missing": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_degraded": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_misplaced": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_unfound": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_dirty": 30, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_whiteouts": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_read": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_read_kb": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_write": 30, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_write_kb": 30, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_scrub_errors": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_shallow_scrub_errors": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_deep_scrub_errors": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_recovered": 26, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_bytes_recovered": 182, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_keys_recovered": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_omap": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_hit_set_archive": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_bytes_hit_set_archive": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush_kb": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict": 0, 2026-02-23T08:18:18.820 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict_kb": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_promote": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush_mode_high": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_flush_mode_low": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict_mode_some": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_evict_mode_full": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_pinned": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_legacy_snapsets": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_large_omap_objects": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_manifest": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_omap_bytes": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_omap_keys": 0, 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout: "num_objects_repaired": 26 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:836: TEST_repair_stats_ec: ceph pg 1.0 query 2026-02-23T08:18:18.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:836: TEST_repair_stats_ec: jq .info.stats.stat_sum.num_objects_repaired 2026-02-23T08:18:18.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:836: TEST_repair_stats_ec: COUNT=26 2026-02-23T08:18:18.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:837: TEST_repair_stats_ec: test 26 = 26 2026-02-23T08:18:18.895 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: expr 3 - 1 2026-02-23T08:18:18.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: seq 0 2 2026-02-23T08:18:18.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:18:18.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:840: TEST_repair_stats_ec: '[' 0 = 0 -o 0 = 1 ']' 2026-02-23T08:18:18.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: expr 26 / 2 2026-02-23T08:18:18.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: repair=13 2026-02-23T08:18:18.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:18.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 0 )' 2026-02-23T08:18:19.051 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:19.062 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:19.062 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:18:19.062 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 29, 2026-02-23T08:18:19.062 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 124554051591, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 1, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 1, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 1, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 1, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 104857600, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 28480, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 368, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 5, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 28090, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 104829120, 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:18:19.063 INFO:tasks.workunit.client.0.trial129.stdout: "total": 107374182400, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "available": 107345018880, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 376832, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 203179, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 5703, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 28764601 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [ 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: 1, 2026-02-23T08:18:19.064 INFO:tasks.workunit.client.0.trial129.stdout: 2 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 13, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:18:19.065 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:18:19.066 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.066 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [] 2026-02-23T08:18:19.066 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:19.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:19.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 0 ).num_shards_repaired' 2026-02-23T08:18:19.218 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:19.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: COUNT=13 2026-02-23T08:18:19.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:848: TEST_repair_stats_ec: test 13 = 13 2026-02-23T08:18:19.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:18:19.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:840: TEST_repair_stats_ec: '[' 1 = 0 -o 1 = 1 ']' 2026-02-23T08:18:19.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: expr 26 / 2 2026-02-23T08:18:19.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:841: TEST_repair_stats_ec: repair=13 2026-02-23T08:18:19.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:19.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 1 )' 2026-02-23T08:18:19.382 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:19.392 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:19.392 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:18:19.392 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 25, 2026-02-23T08:18:19.392 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 107374182407, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 1, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 1, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 1, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 1, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 104857600, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 28480, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 368, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 8, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 28087, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 104829120, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "total": 107374182400, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "available": 107345018880, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 376832, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 203179, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 8307, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 28761997 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [ 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: 2 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:18:19.393 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 13, 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [] 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:19.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 1 ).num_shards_repaired' 2026-02-23T08:18:19.547 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:19.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: COUNT=13 2026-02-23T08:18:19.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:848: TEST_repair_stats_ec: test 13 = 13 2026-02-23T08:18:19.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:839: TEST_repair_stats_ec: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:18:19.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:840: TEST_repair_stats_ec: '[' 2 = 0 -o 2 = 1 ']' 2026-02-23T08:18:19.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:843: TEST_repair_stats_ec: repair=0 2026-02-23T08:18:19.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:19.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:846: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 2 )' 2026-02-23T08:18:19.711 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:19.722 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:19.722 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 2, 2026-02-23T08:18:19.722 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 14, 2026-02-23T08:18:19.722 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 60129542155, 2026-02-23T08:18:19.722 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 1, 2026-02-23T08:18:19.722 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 1, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 1, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 1, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 104857600, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 27328, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 368, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 11, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 26932, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 104830272, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "total": 107374182400, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "available": 107346198528, 2026-02-23T08:18:19.723 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 376832, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 203179, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 12041, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 27578615 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [ 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: 0, 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:18:19.724 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 0, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:19.725 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [] 2026-02-23T08:18:19.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:19.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:19.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: jq '.pg_map.osd_stats[] | select(.osd == 2 ).num_shards_repaired' 2026-02-23T08:18:19.875 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:19.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:847: TEST_repair_stats_ec: COUNT=0 2026-02-23T08:18:19.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:848: TEST_repair_stats_ec: test 0 = 0 2026-02-23T08:18:19.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:851: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:19.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:851: TEST_repair_stats_ec: jq .pg_map.osd_stats_sum 2026-02-23T08:18:20.039 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "up_from": 0, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "num_pgs": 3, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "num_osds": 3, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_osds": 3, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "num_per_pool_omap_osds": 3, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "kb": 314572800, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used": 84288, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_data": 1104, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_omap": 25, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "kb_used_meta": 83110, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "kb_avail": 314488512, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "statfs": { 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "total": 322122547200, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "available": 322036236288, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "internally_reserved": 0, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "allocated": 1130496, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "data_stored": 609537, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed": 0, 2026-02-23T08:18:20.050 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_allocated": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "data_compressed_original": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "omap_allocated": 26051, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "internal_metadata": 85105213 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "hb_peers": [], 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "snap_trim_queue_len": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "num_snap_trimming": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "num_shards_repaired": 26, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "op_queue_age_hist": { 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "histogram": [], 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "upper_bound": 1 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "perf_stat": { 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ms": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ms": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "commit_latency_ns": 0, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "apply_latency_ns": 0 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "alerts": [], 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout: "network_ping_times": [] 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:852: TEST_repair_stats_ec: ceph pg dump --format=json-pretty 2026-02-23T08:18:20.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:852: TEST_repair_stats_ec: jq .pg_map.osd_stats_sum.num_shards_repaired 2026-02-23T08:18:20.202 INFO:tasks.workunit.client.0.trial129.stderr:dumped all 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:852: TEST_repair_stats_ec: COUNT=26 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:853: TEST_repair_stats_ec: test 26 = 26 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:18:20.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:18:20.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:18:20.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:18:20.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:18:20.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:18:20.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:18:20.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:18:20.322 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:18:20.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:18:20.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:18:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:18:20.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:18:20.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:18:20.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:18:20.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:18:20.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:18:20.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:18:20.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:18:20.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:18:20.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:18:20.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:18:20.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:18:20.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:18:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:18:20.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:18:20.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:18:20.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:18:20.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:18:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:18:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:18:20.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:18:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:18:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:18:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:18:20.346 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:18:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:18:20.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:18:20.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:18:20.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:18:20.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:18:20.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:18:20.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:18:20.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:18:20.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:18:20.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:18:20.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_request_scrub_priority td/osd-scrub-repair 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6369: TEST_request_scrub_priority: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6370: TEST_request_scrub_priority: local poolname=psr_pool 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6371: TEST_request_scrub_priority: local objname=POBJ 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6372: TEST_request_scrub_priority: local OBJECTS=64 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6373: TEST_request_scrub_priority: local PGS=8 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6375: TEST_request_scrub_priority: run_mon td/osd-scrub-repair a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:18:20.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T08:18:20.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:18:20.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T08:18:20.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:18:20.394 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:18:20.395 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:18:20.395 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:18:20.395 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.395 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.395 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:18:20.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:18:20.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:18:20.453 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.454 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.454 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:18:20.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:18:20.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:18:20.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6376: TEST_request_scrub_priority: run_mgr td/osd-scrub-repair x 2026-02-23T08:18:20.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:18:20.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:18:20.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:18:20.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:18:20.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:18:20.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:18:20.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:18:20.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:18:20.605 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:18:20.605 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.605 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:18:20.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:18:20.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6377: TEST_request_scrub_priority: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 ' 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6378: TEST_request_scrub_priority: ceph_osd_args+=--osd_scrub_backoff_ratio=0 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6379: TEST_request_scrub_priority: run_osd td/osd-scrub-repair 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:18:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:18:20.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:18:20.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0' 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:18:20.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2b1ad2f2-ec23-4097-a0a7-011db18f66f8 2026-02-23T08:18:20.629 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 2b1ad2f2-ec23-4097-a0a7-011db18f66f8 2026-02-23T08:18:20.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2b1ad2f2-ec23-4097-a0a7-011db18f66f8' 2026-02-23T08:18:20.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:18:20.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMDZxp4Im3JRAASWpcXkjfQHEhj3wcVzKYDw== 2026-02-23T08:18:20.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMDZxp4Im3JRAASWpcXkjfQHEhj3wcVzKYDw=="}' 2026-02-23T08:18:20.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2b1ad2f2-ec23-4097-a0a7-011db18f66f8 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:18:20.722 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:18:20.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:18:20.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --mkfs --key AQBMDZxp4Im3JRAASWpcXkjfQHEhj3wcVzKYDw== --osd-uuid 2b1ad2f2-ec23-4097-a0a7-011db18f66f8 2026-02-23T08:18:20.748 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:20.747+0000 7f2390a7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:20.749 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:20.748+0000 7f2390a7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:20.750 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:20.749+0000 7f2390a7e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:20.750 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:20.749+0000 7f2390a7e780 -1 bdev(0x55aa79523400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:18:20.750 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:20.749+0000 7f2390a7e780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:18:21.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:18:21.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:18:21.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:18:21.195 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:18:21.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:18:21.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:18:21.292 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:18:21.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 2026-02-23T08:18:21.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:18:21.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:18:21.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:18:21.305 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:21.304+0000 7fc05dd4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:21.306 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:21.305+0000 7fc05dd4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:21.307 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:21.306+0000 7fc05dd4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:18:21.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:18:21.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:18:21.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:18:21.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:18:21.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:18:21.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:18:21.386 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:18:21.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:18:21.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:18:21.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:18:21.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:18:21.511 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:21.510+0000 7fc05dd4d780 -1 Falling back to public interface 2026-02-23T08:18:21.851 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:18:21.850+0000 7fc05dd4d780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:18:22.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:18:22.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:18:22.478 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:18:22.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:18:22.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:18:22.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:18:22.570 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2435870466,v1:127.0.0.1:6801/2435870466] [v2:127.0.0.1:6802/2435870466,v1:127.0.0.1:6803/2435870466] exists,up 2b1ad2f2-ec23-4097-a0a7-011db18f66f8 2026-02-23T08:18:22.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:18:22.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:18:22.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:18:22.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6381: TEST_request_scrub_priority: create_pool psr_pool 8 8 2026-02-23T08:18:22.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool 8 8 2026-02-23T08:18:22.744 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool' created 2026-02-23T08:18:22.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:18:23.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6382: TEST_request_scrub_priority: wait_for_clean 2026-02-23T08:18:23.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:18:23.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:18:23.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:18:23.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:18:23.762 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:18:23.762 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:18:23.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:18:23.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:18:23.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:18:23.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:18:23.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:18:23.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:18:23.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:18:23.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:18:23.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:18:24.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:18:24.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:18:24.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:24.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:18:24.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:18:24.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:18:24.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:18:24.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:24.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:18:24.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:24.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:18:24.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:18:24.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:24.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:18:24.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:18:24.092 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:18:24.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:24.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:18:24.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:18:25.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:18:25.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-23T08:18:25.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:18:25.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:18:25.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:18:25.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T08:18:25.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:18:25.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:18:25.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:18:25.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:18:25.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:18:25.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:18:25.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:18:25.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T08:18:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:18:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:18:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:18:25.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T08:18:25.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6384: TEST_request_scrub_priority: local osd=0 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6385: TEST_request_scrub_priority: add_something td/osd-scrub-repair psr_pool POBJ noscrub 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=psr_pool 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=POBJ 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:18:25.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:18:26.196 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:18:26.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:18:26.400 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:18:26.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:18:26.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:18:26.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool psr_pool put POBJ td/osd-scrub-repair/ORIGINAL 2026-02-23T08:18:26.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6386: TEST_request_scrub_priority: get_primary psr_pool POBJ 2026-02-23T08:18:26.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=psr_pool 2026-02-23T08:18:26.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=POBJ 2026-02-23T08:18:26.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map psr_pool POBJ 2026-02-23T08:18:26.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:18:26.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6386: TEST_request_scrub_priority: local primary=0 2026-02-23T08:18:26.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6387: TEST_request_scrub_priority: get_pg psr_pool POBJ 2026-02-23T08:18:26.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=psr_pool 2026-02-23T08:18:26.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=POBJ 2026-02-23T08:18:26.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map psr_pool POBJ 2026-02-23T08:18:26.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:18:26.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6387: TEST_request_scrub_priority: local pg=1.1 2026-02-23T08:18:26.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: ceph osd dump 2026-02-23T08:18:26.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: grep '^pool.*['\'']psr_pool['\'']' 2026-02-23T08:18:26.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: awk '{ print $2 }' 2026-02-23T08:18:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6388: TEST_request_scrub_priority: poolid=1 2026-02-23T08:18:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6390: TEST_request_scrub_priority: local otherpgs 2026-02-23T08:18:26.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: expr 8 - 1 2026-02-23T08:18:26.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: seq 0 7 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.0 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.0 = 1.1 ']' 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 ' 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:26.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:27.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:27.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.0 schedule-scrub 1.0 2026-02-23T08:18:27.156 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:27.156 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:27.156 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:27.156 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:27.155522+0000" 2026-02-23T08:18:27.156 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:27.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:27.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.1 2026-02-23T08:18:27.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.1 = 1.1 ']' 2026-02-23T08:18:27.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6395: TEST_request_scrub_priority: continue 2026-02-23T08:18:27.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:27.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.2 2026-02-23T08:18:27.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.2 = 1.1 ']' 2026-02-23T08:18:27.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 ' 2026-02-23T08:18:27.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:27.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:27.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:27.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:27.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:27.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:27.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.2 schedule-scrub 1.2 2026-02-23T08:18:27.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:27.399 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:27.399 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:27.399 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:27.398551+0000" 2026-02-23T08:18:27.399 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:27.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:27.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.3 2026-02-23T08:18:27.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.3 = 1.1 ']' 2026-02-23T08:18:27.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 ' 2026-02-23T08:18:27.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:27.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:27.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:27.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:27.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:27.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:27.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.3 schedule-scrub 1.3 2026-02-23T08:18:27.638 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:27.638 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:27.638 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:27.639 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:27.638208+0000" 2026-02-23T08:18:27.639 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:27.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:27.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.4 2026-02-23T08:18:27.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.4 = 1.1 ']' 2026-02-23T08:18:27.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 ' 2026-02-23T08:18:27.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:27.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:27.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:27.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:27.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:27.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:27.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.4 schedule-scrub 1.4 2026-02-23T08:18:27.877 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:27.877 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:27.877 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:27.877 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:27.876539+0000" 2026-02-23T08:18:27.877 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:27.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:27.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.5 2026-02-23T08:18:27.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.5 = 1.1 ']' 2026-02-23T08:18:27.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 1.5 ' 2026-02-23T08:18:27.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:27.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:27.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:27.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:27.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:28.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:28.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.5 schedule-scrub 1.5 2026-02-23T08:18:28.120 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:28.120 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:28.120 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:28.120 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:28.119677+0000" 2026-02-23T08:18:28.120 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.6 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.6 = 1.1 ']' 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 1.5 1.6 ' 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:28.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:28.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:28.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:28.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:28.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.6 schedule-scrub 1.6 2026-02-23T08:18:28.362 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:28.363 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:28.363 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:28.363 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:28.362210+0000" 2026-02-23T08:18:28.363 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:28.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6391: TEST_request_scrub_priority: for i in $(seq 0 $(expr $PGS - 1)) 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6393: TEST_request_scrub_priority: opg=1.7 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6394: TEST_request_scrub_priority: '[' 1.7 = 1.1 ']' 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6397: TEST_request_scrub_priority: otherpgs='1.0 1.2 1.3 1.4 1.5 1.6 1.7 ' 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:28.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:28.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6398: TEST_request_scrub_priority: local other_last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:28.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6400: TEST_request_scrub_priority: ceph tell 1.7 schedule-scrub 1.7 2026-02-23T08:18:28.605 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:28.606 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:28.606 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:18:28.606 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:18:28.604893+0000" 2026-02-23T08:18:28.606 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:28.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6403: TEST_request_scrub_priority: sleep 15 2026-02-23T08:18:43.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6404: TEST_request_scrub_priority: flush_pg_stats 2026-02-23T08:18:43.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:18:43.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:18:43.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:18:43.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:18:43.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:18:43.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:18:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:18:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:18:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:18:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:18:43.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:18:43.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:18:43.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:18:43.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:18:43.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:18:43.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:18:43.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:18:43.859 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:18:43.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:44.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-23T08:18:44.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:18:45.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:18:45.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:18:45.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:18:45.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6407: TEST_request_scrub_priority: get_last_scrub_stamp 1.1 2026-02-23T08:18:45.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:45.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:45.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:45.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:45.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6407: TEST_request_scrub_priority: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:45.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6408: TEST_request_scrub_priority: ceph tell 1.1 scrub 2026-02-23T08:18:45.427 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:18:45.427 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:18:45.427 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:18:45.428 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:18:45.428 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:18:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6410: TEST_request_scrub_priority: ceph osd unset noscrub 2026-02-23T08:18:45.645 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is unset 2026-02-23T08:18:45.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6411: TEST_request_scrub_priority: ceph osd unset nodeep-scrub 2026-02-23T08:18:45.849 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is unset 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6413: TEST_request_scrub_priority: wait_for_scrub 1.1 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.1 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-23T08:18:45.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:45.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:45.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:45.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:18:22.742913+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:46.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:47.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:47.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:47.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-23T08:18:47.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:47.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:47.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:47.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:47.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:18:22.742913+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:47.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:48.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:48.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:48.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-23T08:18:48.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:48.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:48.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:48.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:18:22.742913+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:48.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:49.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:49.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:49.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-23T08:18:49.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:18:49.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:49.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:49.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:18:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:18:46.005876+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:18:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:18:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.0 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:49.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:18:49.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:49.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:18:49.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:18:49.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:49.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:49.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:49.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:49.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:49.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:49.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:49.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:50.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:50.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:50.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:50.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:50.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:50.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:50.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:50.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:50.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:51.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:51.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:51.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:51.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:51.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:51.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:51.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:52.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:52.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:53.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:53.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:53.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:53.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:53.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:53.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:53.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:53.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:54.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:54.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:54.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:54.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:54.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:54.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:54.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:54.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:54.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:55.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:55.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:55.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:55.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:55.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:55.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:55.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:55.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:55.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:56.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:56.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:56.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:56.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:56.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:56.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:56.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:56.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:56.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:57.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:57.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:57.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:57.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:57.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:57.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:57.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:57.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:57.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:18:58.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:18:58.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:18:58.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:18:58.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:18:58.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:18:58.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:18:58.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:18:59.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:18:59.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:00.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:00.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:00.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:00.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:00.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:00.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:00.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:00.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:00.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:01.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:01.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:01.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:01.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:01.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:01.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:01.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:01.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:01.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:02.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:02.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:02.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:02.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:02.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:02.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:02.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:02.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:02.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:03.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:03.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:03.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:03.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:03.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:03.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:03.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:03.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:03.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:04.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:04.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:04.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:04.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:04.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:04.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:04.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:04.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:04.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:05.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:05.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:05.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:05.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:05.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:05.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:05.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:06.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:06.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:07.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:07.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:07.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:07.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:07.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:07.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:07.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:07.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:08.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:08.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:08.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:08.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:08.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:08.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:08.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:08.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:08.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:09.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:09.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:09.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:09.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:09.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:09.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:09.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:09.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:09.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:10.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:10.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:10.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:10.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:10.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:10.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:10.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:10.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:10.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:11.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:11.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:11.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:11.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:11.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:11.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:11.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:11.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:11.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:12.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:12.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:12.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:12.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:12.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:12.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:12.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:13.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:13.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:14.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:14.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:14.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:14.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:14.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:14.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:14.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:14.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:14.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:15.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:15.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:15.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:15.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:15.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:15.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:15.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:15.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:15.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:16.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:16.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:16.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:16.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:16.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:16.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:16.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:16.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:16.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:17.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:17.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:17.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:17.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:17.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:17.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:17.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:17.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:18.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:18.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:18.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:18.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:18.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:18.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:18.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:18.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:18.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:19.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:19.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:19.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:19.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:19.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:19.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:19.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:20.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:20.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:21.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:21.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:21.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:21.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:21.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:21.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:21.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:21.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:21.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:22.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:22.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:22.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:22.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:22.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:22.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:22.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:22.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:23.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:23.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:23.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:23.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:23.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:23.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:23.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:23.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:23.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:24.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:24.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:24.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:24.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:24.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:24.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:24.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:24.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:24.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:25.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:25.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:25.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:25.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:25.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:25.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:25.727 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:25.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:25.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:26.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:26.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:26.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:26.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:26.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:26.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:26.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:27.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:27.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:28.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:28.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:28.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:28.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:28.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:28.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:28.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:28.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:28.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:29.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:29.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:29.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:29.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:29.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:29.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:29.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:29.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:29.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:30.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:30.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:30.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:30.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:30.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:30.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:30.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:30.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:30.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:31.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:31.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:31.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:31.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:31.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:31.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:31.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:31.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:32.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:32.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:32.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:32.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:32.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:32.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:32.740 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:32.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:32.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:33.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:33.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:33.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:33.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:33.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:33.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:33.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:34.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:27.155522+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:34.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:35.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:35.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:35.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:19:35.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:19:35.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:35.083 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:35.083 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:28.106303+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.2 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.2 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.2 last_scrub_stamp 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.2 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:35.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.2") | .last_scrub_stamp' 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:29.104213+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.3 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.3 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.3 last_scrub_stamp 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:35.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:19:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:30.128768+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.4 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.4 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.4 last_scrub_stamp 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.4 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:35.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.4") | .last_scrub_stamp' 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:31.149832+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.5 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.5 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:35.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:35.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.5 last_scrub_stamp 2026-02-23T08:19:35.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.5 2026-02-23T08:19:35.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:35.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:35.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.5") | .last_scrub_stamp' 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:32.127776+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.6 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.6 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:35.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-23T08:19:36.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:28.362210+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:36.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:37.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:37.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:37.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-23T08:19:37.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-23T08:19:37.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:37.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:37.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-23T08:19:37.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:28.362210+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:37.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:38.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:38.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:38.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-23T08:19:38.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-23T08:19:38.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:38.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:38.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-23T08:19:38.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:18:28.362210+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:38.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:19:39.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:19:39.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:39.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.6 last_scrub_stamp 2026-02-23T08:19:39.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.6 2026-02-23T08:19:39.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:39.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:39.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.6") | .last_scrub_stamp' 2026-02-23T08:19:39.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:33.148159+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:39.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:39.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.7 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.7 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.7 last_scrub_stamp 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.7 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:39.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.7") | .last_scrub_stamp' 2026-02-23T08:19:39.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:19:34.158955+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6415: TEST_request_scrub_priority: for opg in $otherpgs $pg 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6417: TEST_request_scrub_priority: wait_for_scrub 1.1 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.1 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.1 last_scrub_stamp 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.1 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:19:39.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.1") | .last_scrub_stamp' 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:18:46.005876+0000 '>' 2026-02-23T08:18:22.742913+0000 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: grep 'log_channel.*scrub ok' td/osd-scrub-repair/osd.0.log 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: grep -v purged_snaps 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: head -1 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: sed 's/.*[[]DBG[]]//' 2026-02-23T08:19:39.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6421: TEST_request_scrub_priority: grep -q 1.1 2026-02-23T08:19:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:19:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:19:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:19:39.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:19:39.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:19:39.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:19:39.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:19:39.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:19:39.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:19:40.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:19:40.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:19:40.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:19:40.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:19:40.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:19:40.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:19:40.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:19:40.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:19:40.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:19:40.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:19:40.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:19:40.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:19:40.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:19:40.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:19:40.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:19:40.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:19:40.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:19:40.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:19:40.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:19:40.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:19:40.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:19:40.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:19:40.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:19:40.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:19:40.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:19:40.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:19:40.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:19:40.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:19:40.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:19:40.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:19:40.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:19:40.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:19:40.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:19:40.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:19:40.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:19:40.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:19:40.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:19:40.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:19:40.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:19:40.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:19:40.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:19:40.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:19:40.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:19:40.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_scrub_warning td/osd-scrub-repair 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6011: TEST_scrub_warning: local dir=td/osd-scrub-repair 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6012: TEST_scrub_warning: local poolname=psr_pool 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6013: TEST_scrub_warning: local objname=POBJ 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6014: TEST_scrub_warning: local scrubs=5 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6015: TEST_scrub_warning: local deep_scrubs=5 2026-02-23T08:19:40.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6016: TEST_scrub_warning: local i1_day=86400 2026-02-23T08:19:40.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6017: TEST_scrub_warning: calc 86400 '*' 7 2026-02-23T08:19:40.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 86400 * 7}' 2026-02-23T08:19:40.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6017: TEST_scrub_warning: local i7_days=604800 2026-02-23T08:19:40.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6018: TEST_scrub_warning: calc 86400 '*' 14 2026-02-23T08:19:40.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 86400 * 14}' 2026-02-23T08:19:40.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6018: TEST_scrub_warning: local i14_days=1209600 2026-02-23T08:19:40.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6019: TEST_scrub_warning: local overdue=0.5 2026-02-23T08:19:40.056 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6020: TEST_scrub_warning: calc 604800 + 86400 + '(' 604800 '*' 0.5 ')' 2026-02-23T08:19:40.056 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 604800 + 86400 + ( 604800 * 0.5 )}' 2026-02-23T08:19:40.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6020: TEST_scrub_warning: local conf_overdue_seconds=993600 2026-02-23T08:19:40.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6021: TEST_scrub_warning: calc 1209600 + 86400 + '(' 1209600 '*' 0.5 ')' 2026-02-23T08:19:40.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1580: calc: awk 'BEGIN{print 1209600 + 86400 + ( 1209600 * 0.5 )}' 2026-02-23T08:19:40.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6021: TEST_scrub_warning: local pool_overdue_seconds=1900800 2026-02-23T08:19:40.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6023: TEST_scrub_warning: run_mon td/osd-scrub-repair a --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T08:19:40.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:19:40.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:19:40.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:19:40.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:19:40.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:19:40.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:19:40.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 --mon_allow_pool_size_one=true 2026-02-23T08:19:40.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:19:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:19:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:19:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:19:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:19:40.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.102 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:19:40.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:19:40.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:19:40.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:19:40.161 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:19:40.162 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:19:40.162 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.162 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.162 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:19:40.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:19:40.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6024: TEST_scrub_warning: run_mgr td/osd-scrub-repair x --mon_warn_pg_not_scrubbed_ratio=0.5 --mon_warn_pg_not_deep_scrubbed_ratio=0.5 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:19:40.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:19:40.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:19:40.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mon_warn_pg_not_scrubbed_ratio=0.5 --mon_warn_pg_not_deep_scrubbed_ratio=0.5 2026-02-23T08:19:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6025: TEST_scrub_warning: run_osd td/osd-scrub-repair 0 --osd_scrub_backoff_ratio=0 2026-02-23T08:19:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:19:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:19:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:19:40.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:19:40.329 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:19:40.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=--osd_scrub_backoff_ratio=0 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7f3d5dd3-3e62-4138-9354-11618bcaac44 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 7f3d5dd3-3e62-4138-9354-11618bcaac44 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 7f3d5dd3-3e62-4138-9354-11618bcaac44' 2026-02-23T08:19:40.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:19:40.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCcDZxpsQY1FBAAvlOCN6M1X7IeBmiY17fsww== 2026-02-23T08:19:40.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCcDZxpsQY1FBAAvlOCN6M1X7IeBmiY17fsww=="}' 2026-02-23T08:19:40.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7f3d5dd3-3e62-4138-9354-11618bcaac44 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:19:40.428 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:19:40.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:19:40.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_backoff_ratio=0 --mkfs --key AQCcDZxpsQY1FBAAvlOCN6M1X7IeBmiY17fsww== --osd-uuid 7f3d5dd3-3e62-4138-9354-11618bcaac44 2026-02-23T08:19:40.452 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.450+0000 7f6b9b77f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:19:40.453 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.452+0000 7f6b9b77f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:19:40.454 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.452+0000 7f6b9b77f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:19:40.454 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.453+0000 7f6b9b77f780 -1 bdev(0x5607b0c0b400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:19:40.454 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.453+0000 7f6b9b77f780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:19:40.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:19:40.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:19:40.842 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:19:40.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:19:40.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:19:40.940 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:19:40.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:19:40.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_backoff_ratio=0 2026-02-23T08:19:40.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:19:40.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:19:40.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:19:40.953 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.951+0000 7f737367e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:19:40.955 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.953+0000 7f737367e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:19:40.956 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:40.954+0000 7f737367e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:19:41.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:19:41.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:19:41.218 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:41.216+0000 7f737367e780 -1 Falling back to public interface 2026-02-23T08:19:41.581 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:19:41.579+0000 7f737367e780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:19:42.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:19:42.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:19:42.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:19:42.123 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:19:42.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:19:42.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:19:42.213 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1507734817,v1:127.0.0.1:6801/1507734817] [v2:127.0.0.1:6802/1507734817,v1:127.0.0.1:6803/1507734817] exists,up 7f3d5dd3-3e62-4138-9354-11618bcaac44 2026-02-23T08:19:42.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:19:42.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:19:42.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:19:42.214 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: expr 5 + 5 2026-02-23T08:19:42.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: seq 1 10 2026-02-23T08:19:42.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:19:42.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-1 1 1 2026-02-23T08:19:42.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-1 1 1 2026-02-23T08:19:42.402 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-1' created 2026-02-23T08:19:42.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:19:43.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:19:43.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:19:43.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:19:43.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:19:43.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:19:43.415 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:19:43.415 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:19:43.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:19:43.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:19:43.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:19:43.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:19:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:19:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:19:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:19:43.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:19:43.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:19:43.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:19:43.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:19:43.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:19:43.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:19:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:19:43.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:19:43.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:19:43.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:19:43.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:19:43.739 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:19:43.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:19:43.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:19:43.741 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:19:43.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:19:43.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:19:43.742 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:19:43.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:43.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:19:43.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:19:44.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:19:44.906 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:45.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-23T08:19:45.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:19:45.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:45.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:45.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:19:45.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:19:45.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:19:45.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:19:45.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:19:45.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:19:45.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:19:45.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:19:45.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:19:45.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:19:45.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:45.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:19:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:19:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:19:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 1 = 1 ']' 2026-02-23T08:19:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6033: TEST_scrub_warning: ceph osd pool set psr_pool-1 scrub_max_interval 1209600 2026-02-23T08:19:45.844 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 scrub_max_interval to 1209600 2026-02-23T08:19:45.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:19:45.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 1 = 6 ']' 2026-02-23T08:19:45.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:19:45.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-2 1 1 2026-02-23T08:19:45.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-2 1 1 2026-02-23T08:19:46.049 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-2' created 2026-02-23T08:19:46.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:19:47.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:19:47.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:19:47.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:19:47.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:19:47.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:19:47.063 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:19:47.063 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:19:47.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:19:47.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:19:47.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:19:47.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:19:47.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:19:47.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:19:47.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:19:47.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:19:47.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:19:47.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:19:47.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:19:47.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:19:47.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:19:47.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:19:47.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:19:47.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:19:47.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:19:47.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:19:47.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:19:47.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:19:47.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:19:47.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:19:47.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:19:47.390 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:19:47.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:19:47.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:47.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:19:47.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:19:48.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:19:48.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:48.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836483 2026-02-23T08:19:48.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:19:48.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:48.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:48.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 2 == 0 2026-02-23T08:19:48.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:19:48.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:19:48.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:19:48.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:19:48.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:19:48.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:19:48.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:19:49.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=2 2026-02-23T08:19:49.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:19:49.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:49.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:49.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 2 = 2 2026-02-23T08:19:49.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:19:49.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:19:49.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 2 = 1 ']' 2026-02-23T08:19:49.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:19:49.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 2 = 6 ']' 2026-02-23T08:19:49.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:19:49.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-3 1 1 2026-02-23T08:19:49.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-3 1 1 2026-02-23T08:19:49.500 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-3' created 2026-02-23T08:19:49.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:19:50.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:19:50.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:19:50.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:19:50.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:19:50.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:19:50.517 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:19:50.517 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:19:50.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:19:50.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:19:50.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:19:50.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:19:50.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:19:50.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:19:50.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:19:50.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:19:50.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:19:50.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:19:50.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:19:50.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:19:50.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:19:50.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:19:50.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:19:50.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:19:50.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:19:50.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:19:50.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:19:50.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:19:50.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:19:50.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:19:50.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:19:50.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:19:50.846 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:19:50.846 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:51.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:19:51.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:19:52.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:19:52.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:52.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836485 2026-02-23T08:19:52.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:19:53.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:19:53.179 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:53.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:19:53.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:19:53.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:53.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:53.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 3 == 0 2026-02-23T08:19:53.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:19:53.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:19:53.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:19:53.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:19:53.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:19:53.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:19:53.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:19:53.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=3 2026-02-23T08:19:53.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:19:53.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:53.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:53.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 3 = 3 2026-02-23T08:19:53.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:19:53.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:19:53.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 3 = 1 ']' 2026-02-23T08:19:53.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:19:53.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 3 = 6 ']' 2026-02-23T08:19:53.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:19:53.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-4 1 1 2026-02-23T08:19:53.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-4 1 1 2026-02-23T08:19:54.128 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-4' created 2026-02-23T08:19:54.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:19:55.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:19:55.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:19:55.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:19:55.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:19:55.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:19:55.142 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:19:55.142 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:19:55.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:19:55.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:19:55.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:19:55.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:19:55.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:19:55.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:19:55.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:19:55.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:19:55.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:19:55.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:19:55.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:19:55.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:19:55.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:19:55.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:19:55.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:19:55.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:19:55.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:19:55.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:19:55.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:19:55.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:19:55.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:19:55.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:19:55.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:19:55.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:19:55.467 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:19:55.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:55.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:19:55.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:19:56.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:19:56.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:56.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:19:56.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:19:56.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:56.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:57.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:19:57.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:19:57.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:19:57.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:19:57.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:19:57.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:19:57.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:19:57.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:19:57.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:19:57.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:19:57.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:19:57.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:19:57.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:19:57.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:19:57.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:19:57.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 4 = 1 ']' 2026-02-23T08:19:57.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:19:57.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 4 = 6 ']' 2026-02-23T08:19:57.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:19:57.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-5 1 1 2026-02-23T08:19:57.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-5 1 1 2026-02-23T08:19:57.584 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-5' created 2026-02-23T08:19:57.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:19:58.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:19:58.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:19:58.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:19:58.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:19:58.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:19:58.598 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:19:58.598 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:19:58.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:19:58.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:19:58.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:19:58.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:19:58.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:19:58.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:19:58.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:19:58.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:19:58.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:19:58.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:19:58.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:19:58.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:19:58.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:19:58.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836489 2026-02-23T08:19:58.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836489 2026-02-23T08:19:58.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836489' 2026-02-23T08:19:58.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:19:58.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836489 2026-02-23T08:19:58.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:19:58.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:19:58.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836489 2026-02-23T08:19:58.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:19:58.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836489 2026-02-23T08:19:58.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-23T08:19:58.929 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836489 2026-02-23T08:19:58.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:19:59.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836489 2026-02-23T08:19:59.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:00.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:00.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:00.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836489 2026-02-23T08:20:00.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:01.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:20:01.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:01.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-23T08:20:01.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:01.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:01.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:01.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 5 == 0 2026-02-23T08:20:01.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:01.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:01.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:01.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:01.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:01.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:01.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:01.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=5 2026-02-23T08:20:01.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:01.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:01.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:02.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 5 = 5 2026-02-23T08:20:02.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:02.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:02.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 5 = 1 ']' 2026-02-23T08:20:02.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:02.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 5 = 6 ']' 2026-02-23T08:20:02.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:02.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-6 1 1 2026-02-23T08:20:02.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-6 1 1 2026-02-23T08:20:02.209 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-6' created 2026-02-23T08:20:02.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:03.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:20:03.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:03.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:03.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:03.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:03.227 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:03.227 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:03.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:03.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:03.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:03.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:03.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:03.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:03.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:03.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:03.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:03.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:20:03.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:03.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:03.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:03.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-23T08:20:03.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-23T08:20:03.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-23T08:20:03.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:03.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-23T08:20:03.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:03.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:03.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-23T08:20:03.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:03.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-23T08:20:03.554 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836491 2026-02-23T08:20:03.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-23T08:20:03.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:03.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836491 2026-02-23T08:20:03.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:04.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:04.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:04.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-23T08:20:04.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:04.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:04.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:05.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 6 == 0 2026-02-23T08:20:05.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:05.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=6 2026-02-23T08:20:05.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:05.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:05.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:05.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 6 = 6 2026-02-23T08:20:05.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:05.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:05.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 6 = 1 ']' 2026-02-23T08:20:05.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:05.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 6 = 6 ']' 2026-02-23T08:20:05.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6037: TEST_scrub_warning: ceph osd pool set psr_pool-6 deep_scrub_interval 1209600 2026-02-23T08:20:05.666 INFO:tasks.workunit.client.0.trial129.stderr:set pool 6 deep_scrub_interval to 1209600 2026-02-23T08:20:05.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:05.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-7 1 1 2026-02-23T08:20:05.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-7 1 1 2026-02-23T08:20:05.871 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-7' created 2026-02-23T08:20:05.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:06.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:20:06.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:06.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:06.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:06.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:06.884 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:06.884 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:06.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:06.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:06.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:06.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:06.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:06.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:06.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:06.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:06.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:07.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:20:07.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:07.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:07.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:07.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-23T08:20:07.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-23T08:20:07.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836492' 2026-02-23T08:20:07.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:07.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836492 2026-02-23T08:20:07.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:07.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:07.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-23T08:20:07.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:07.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836492 2026-02-23T08:20:07.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-23T08:20:07.214 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836492 2026-02-23T08:20:07.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:07.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836492 2026-02-23T08:20:07.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:08.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:08.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:08.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836492 2026-02-23T08:20:08.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:08.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:08.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:08.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 7 == 0 2026-02-23T08:20:08.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:08.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:08.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:08.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:08.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:08.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:08.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:08.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=7 2026-02-23T08:20:08.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:08.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:08.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:09.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 7 = 7 2026-02-23T08:20:09.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:09.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:09.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 7 = 1 ']' 2026-02-23T08:20:09.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:09.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 7 = 6 ']' 2026-02-23T08:20:09.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:09.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-8 1 1 2026-02-23T08:20:09.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-8 1 1 2026-02-23T08:20:09.327 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-8' created 2026-02-23T08:20:09.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:10.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:20:10.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:10.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:10.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:10.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:10.341 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:10.341 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:10.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:10.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:10.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:10.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:10.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:10.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:10.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:10.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:10.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:10.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:20:10.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:10.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:10.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:10.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836494 2026-02-23T08:20:10.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836494 2026-02-23T08:20:10.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836494' 2026-02-23T08:20:10.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:10.666 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836494 2026-02-23T08:20:10.667 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:10.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:10.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836494 2026-02-23T08:20:10.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:10.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836494 2026-02-23T08:20:10.670 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836494 2026-02-23T08:20:10.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836494' 2026-02-23T08:20:10.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:10.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-23T08:20:10.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:11.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:11.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:12.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836494 2026-02-23T08:20:12.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:13.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:20:13.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:13.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836494 2026-02-23T08:20:13.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:13.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:13.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:13.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 8 == 0 2026-02-23T08:20:13.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:13.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:13.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:13.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:13.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:13.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:13.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:13.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=8 2026-02-23T08:20:13.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:13.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:13.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:13.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 8 = 8 2026-02-23T08:20:13.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:13.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:13.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 8 = 1 ']' 2026-02-23T08:20:13.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:13.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 8 = 6 ']' 2026-02-23T08:20:13.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:13.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-9 1 1 2026-02-23T08:20:13.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-9 1 1 2026-02-23T08:20:13.959 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-9' created 2026-02-23T08:20:13.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:14.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:20:14.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:14.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:14.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:14.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:14.977 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:14.977 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:14.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:15.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:15.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:15.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:15.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:15.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:15.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:15.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:20:15.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:15.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:15.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:15.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836496 2026-02-23T08:20:15.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836496 2026-02-23T08:20:15.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836496' 2026-02-23T08:20:15.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:15.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836496 2026-02-23T08:20:15.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:15.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836496 2026-02-23T08:20:15.304 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:15.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836496 2026-02-23T08:20:15.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-23T08:20:15.306 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836496 2026-02-23T08:20:15.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836495 -lt 21474836496 2026-02-23T08:20:15.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:16.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:16.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:16.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836496 2026-02-23T08:20:16.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:16.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:16.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 9 == 0 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:16.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:16.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:17.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=9 2026-02-23T08:20:17.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:17.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:17.008 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:17.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 9 = 9 2026-02-23T08:20:17.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:17.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:17.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 9 = 1 ']' 2026-02-23T08:20:17.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:17.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 9 = 6 ']' 2026-02-23T08:20:17.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6027: TEST_scrub_warning: for i in $(seq 1 $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:17.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6029: TEST_scrub_warning: create_pool psr_pool-10 1 1 2026-02-23T08:20:17.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create psr_pool-10 1 1 2026-02-23T08:20:17.451 INFO:tasks.workunit.client.0.trial129.stderr:pool 'psr_pool-10' created 2026-02-23T08:20:17.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:18.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6030: TEST_scrub_warning: wait_for_clean 2026-02-23T08:20:18.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:18.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:18.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:18.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:18.467 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:18.467 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:18.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:18.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:18.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:18.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:18.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:18.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:18.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:18.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:18.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:18.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:20:18.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:18.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:18.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:18.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836498 2026-02-23T08:20:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836498 2026-02-23T08:20:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836498' 2026-02-23T08:20:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:18.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836498 2026-02-23T08:20:18.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:18.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:18.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836498 2026-02-23T08:20:18.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:18.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836498 2026-02-23T08:20:18.798 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836498 2026-02-23T08:20:18.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836498' 2026-02-23T08:20:18.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:18.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836498 2026-02-23T08:20:18.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:19.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:19.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:20.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 21474836498 2026-02-23T08:20:20.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:21.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:20:21.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:21.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836498 2026-02-23T08:20:21.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:21.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:21.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:21.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 10 == 0 2026-02-23T08:20:21.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:21.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:21.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:21.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:21.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:21.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:21.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:21.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=10 2026-02-23T08:20:21.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:21.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:21.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:21.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 10 = 10 2026-02-23T08:20:21.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:21.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:21.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6031: TEST_scrub_warning: '[' 10 = 1 ']' 2026-02-23T08:20:21.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:21.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6035: TEST_scrub_warning: '[' 10 = 6 ']' 2026-02-23T08:20:21.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6042: TEST_scrub_warning: local primary=0 2026-02-23T08:20:21.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6044: TEST_scrub_warning: ceph osd set noscrub 2026-02-23T08:20:22.083 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:20:22.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6045: TEST_scrub_warning: ceph osd set nodeep-scrub 2026-02-23T08:20:22.287 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:20:22.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6046: TEST_scrub_warning: ceph config set global osd_scrub_interval_randomize_ratio 0 2026-02-23T08:20:22.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6047: TEST_scrub_warning: ceph config set global osd_deep_scrub_randomize_ratio 0 2026-02-23T08:20:22.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6048: TEST_scrub_warning: ceph config set global osd_scrub_max_interval 604800 2026-02-23T08:20:22.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6049: TEST_scrub_warning: ceph config set global osd_deep_scrub_interval 604800 2026-02-23T08:20:22.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: seq 1 5 2026-02-23T08:20:22.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-23T08:20:22.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 1 = 1 ']' 2026-02-23T08:20:22.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6056: TEST_scrub_warning: overdue_seconds=1900800 2026-02-23T08:20:22.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 1900800 + 100 2026-02-23T08:20:22.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 1.0 schedule-scrub 1900900 2026-02-23T08:20:23.028 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.028 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:20:23.028 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.029 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-01T08:18:43.028298+0000" 2026-02-23T08:20:23.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-23T08:20:23.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 2 = 1 ']' 2026-02-23T08:20:23.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 200 2026-02-23T08:20:23.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 2.0 schedule-scrub 993800 2026-02-23T08:20:23.103 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.103 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:20:23.103 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.103 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:17:03.103159+0000" 2026-02-23T08:20:23.103 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-23T08:20:23.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 3 = 1 ']' 2026-02-23T08:20:23.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 300 2026-02-23T08:20:23.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 3.0 schedule-scrub 993900 2026-02-23T08:20:23.178 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.179 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:20:23.179 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.179 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:15:23.178023+0000" 2026-02-23T08:20:23.179 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-23T08:20:23.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 4 = 1 ']' 2026-02-23T08:20:23.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 400 2026-02-23T08:20:23.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 4.0 schedule-scrub 994000 2026-02-23T08:20:23.254 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.255 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:20:23.255 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.255 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:13:43.254457+0000" 2026-02-23T08:20:23.255 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6052: TEST_scrub_warning: for i in $(seq 1 $scrubs) 2026-02-23T08:20:23.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6054: TEST_scrub_warning: '[' 5 = 1 ']' 2026-02-23T08:20:23.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6058: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: expr 993600 + 500 2026-02-23T08:20:23.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6060: TEST_scrub_warning: ceph tell 5.0 schedule-scrub 994100 2026-02-23T08:20:23.331 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.332 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:20:23.332 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.332 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:12:03.331180+0000" 2026-02-23T08:20:23.332 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.340 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:23.341 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: expr 5 + 5 2026-02-23T08:20:23.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: seq 6 10 2026-02-23T08:20:23.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:23.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:23.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 6 = 6 ']' 2026-02-23T08:20:23.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6067: TEST_scrub_warning: overdue_seconds=1900800 2026-02-23T08:20:23.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 1900800 + 600 2026-02-23T08:20:23.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 6.0 schedule-deep-scrub 1901400 2026-02-23T08:20:23.412 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.412 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:20:23.412 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.412 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-01T08:10:23.412036+0000" 2026-02-23T08:20:23.412 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:23.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:23.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 7 = 6 ']' 2026-02-23T08:20:23.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 700 2026-02-23T08:20:23.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 7.0 schedule-deep-scrub 994300 2026-02-23T08:20:23.490 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.490 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:20:23.490 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.490 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:08:43.489263+0000" 2026-02-23T08:20:23.490 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:23.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:23.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 8 = 6 ']' 2026-02-23T08:20:23.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 800 2026-02-23T08:20:23.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 8.0 schedule-deep-scrub 994400 2026-02-23T08:20:23.566 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.566 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:20:23.566 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.566 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:07:03.565809+0000" 2026-02-23T08:20:23.566 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:23.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:23.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 9 = 6 ']' 2026-02-23T08:20:23.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 900 2026-02-23T08:20:23.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 9.0 schedule-deep-scrub 994500 2026-02-23T08:20:23.643 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.644 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:20:23.644 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.644 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:05:23.642540+0000" 2026-02-23T08:20:23.644 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6063: TEST_scrub_warning: for i in $(seq $(expr $scrubs + 1) $(expr $scrubs + $deep_scrubs)) 2026-02-23T08:20:23.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: expr 5 + 1 2026-02-23T08:20:23.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6065: TEST_scrub_warning: '[' 10 = 6 ']' 2026-02-23T08:20:23.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6069: TEST_scrub_warning: overdue_seconds=993600 2026-02-23T08:20:23.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: expr 993600 + 1000 2026-02-23T08:20:23.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6071: TEST_scrub_warning: ceph tell 10.0 schedule-deep-scrub 994600 2026-02-23T08:20:23.720 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:23.720 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:20:23.720 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:23.721 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-11T20:03:43.719871+0000" 2026-02-23T08:20:23.721 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:23.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6073: TEST_scrub_warning: flush_pg_stats 2026-02-23T08:20:23.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:23.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:23.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:20:23.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:23.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:23.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:23.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836500 2026-02-23T08:20:23.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836500 2026-02-23T08:20:23.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836500' 2026-02-23T08:20:23.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836500 2026-02-23T08:20:23.964 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:23.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:23.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836500 2026-02-23T08:20:23.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:23.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836500 2026-02-23T08:20:23.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836500' 2026-02-23T08:20:23.967 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836500 2026-02-23T08:20:23.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:24.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836498 -lt 21474836500 2026-02-23T08:20:24.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:25.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:25.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:25.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836500 -lt 21474836500 2026-02-23T08:20:25.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6075: TEST_scrub_warning: ceph health 2026-02-23T08:20:25.477 INFO:tasks.workunit.client.0.trial129.stdout:HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 5 pgs not deep-scrubbed in time; 5 pgs not scrubbed in time; 10 pool(s) have no replicas configured; OSD count 1 < osd_pool_default_size 3 2026-02-23T08:20:25.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6076: TEST_scrub_warning: ceph health detail 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout:HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 5 pgs not deep-scrubbed in time; 5 pgs not scrubbed in time; 10 pool(s) have no replicas configured; OSD count 1 < osd_pool_default_size 3 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout:[WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout:[WRN] PG_NOT_DEEP_SCRUBBED: 5 pgs not deep-scrubbed in time 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout: pg 10.0 not deep-scrubbed since 2026-02-11T20:03:43.719871+0000 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout: pg 9.0 not deep-scrubbed since 2026-02-11T20:05:23.642540+0000 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout: pg 8.0 not deep-scrubbed since 2026-02-11T20:07:03.565809+0000 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout: pg 7.0 not deep-scrubbed since 2026-02-11T20:08:43.489263+0000 2026-02-23T08:20:25.682 INFO:tasks.workunit.client.0.trial129.stdout: pg 6.0 not deep-scrubbed since 2026-02-01T08:10:23.412036+0000 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout:[WRN] PG_NOT_SCRUBBED: 5 pgs not scrubbed in time 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pg 5.0 not scrubbed since 2026-02-11T20:12:03.331180+0000 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pg 4.0 not scrubbed since 2026-02-11T20:13:43.254457+0000 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pg 3.0 not scrubbed since 2026-02-11T20:15:23.178023+0000 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pg 2.0 not scrubbed since 2026-02-11T20:17:03.103159+0000 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pg 1.0 not scrubbed since 2026-02-01T08:18:43.028298+0000 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout:[WRN] POOL_NO_REDUNDANCY: 10 pool(s) have no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-1' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-2' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-3' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-4' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-5' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-6' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-7' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-8' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-9' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout: pool 'psr_pool-10' has no replicas configured 2026-02-23T08:20:25.683 INFO:tasks.workunit.client.0.trial129.stdout:[WRN] TOO_FEW_OSDS: OSD count 1 < osd_pool_default_size 3 2026-02-23T08:20:25.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6077: TEST_scrub_warning: ceph health 2026-02-23T08:20:25.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6077: TEST_scrub_warning: grep -q ' pgs not deep-scrubbed in time' 2026-02-23T08:20:25.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6078: TEST_scrub_warning: ceph health 2026-02-23T08:20:25.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6078: TEST_scrub_warning: grep -q ' pgs not scrubbed in time' 2026-02-23T08:20:26.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: ceph health detail 2026-02-23T08:20:26.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: grep 'not scrubbed since' 2026-02-23T08:20:26.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: wc -l 2026-02-23T08:20:26.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6083: TEST_scrub_warning: COUNT=5 2026-02-23T08:20:26.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6085: TEST_scrub_warning: expr 5+5 2026-02-23T08:20:26.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6085: TEST_scrub_warning: (( 5 != 5 && 5 != 5+5 )) 2026-02-23T08:20:26.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: ceph health detail 2026-02-23T08:20:26.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: grep 'not deep-scrubbed since' 2026-02-23T08:20:26.277 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: wc -l 2026-02-23T08:20:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6089: TEST_scrub_warning: COUNT=5 2026-02-23T08:20:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:6090: TEST_scrub_warning: '[' 5 '!=' 5 ']' 2026-02-23T08:20:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:20:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:20:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:20:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:20:26.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:20:26.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:20:26.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:20:26.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:20:26.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:20:26.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:20:26.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:20:26.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:20:26.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:20:26.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:20:26.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:20:26.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:20:26.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:26.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:20:26.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:20:26.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:26.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:20:26.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:20:26.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:20:26.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:20:26.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:26.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:26.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:20:26.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:20:26.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:20:26.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:20:26.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:20:26.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:20:26.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:20:26.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:20:26.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:20:26.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:20:26.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:20:26.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:20:26.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:20:26.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:20:26.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:26.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:20:26.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:20:26.612 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:26.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:20:26.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:20:26.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:20:26.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:20:26.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:26.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:26.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:20:26.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:20:26.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:20:26.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:20:26.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:20:26.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:26.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:26.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:20:26.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_skip_non_repair_during_recovery td/osd-scrub-repair 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:160: TEST_skip_non_repair_during_recovery: local dir=td/osd-scrub-repair 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:161: TEST_skip_non_repair_during_recovery: cluster_conf=(['osds_num']='2' ['pgs_in_pool']='4' ['pool_name']='nopool' ['pool_default_size']='2' ['extras']='--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true') 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:161: TEST_skip_non_repair_during_recovery: local -A cluster_conf 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:169: TEST_skip_non_repair_during_recovery: standard_scrub_cluster td/osd-scrub-repair cluster_conf 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-repair 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-23T08:20:26.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=2 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=nopool 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=nopool 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=2 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=2 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars=--osd_scrub_during_recovery=false --osd_debug_pretend_recovery_active=true' 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T08:20:26.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T08:20:26.899 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 0993cc11-e3a1-40a4-8dc3-995349e59e7f 2026-02-23T08:20:26.996 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:27.026 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.023+0000 7f8e01a10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:27.027 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.025+0000 7f8e01a10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:27.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.026+0000 7f8e01a10780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:27.029 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.026+0000 7f8e01a10780 -1 bdev(0x561c29c55400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:20:27.029 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.026+0000 7f8e01a10780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:20:27.465 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:20:27.563 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:20:27.580 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.578+0000 7fa979c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:27.582 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.581+0000 7fa979c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:27.583 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.581+0000 7fa979c13780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:27.654 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:27.804 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:27.802+0000 7fa979c13780 -1 Falling back to public interface 2026-02-23T08:20:28.107 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:28.105+0000 7fa979c13780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:20:28.746 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:28.836 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/249539632,v1:127.0.0.1:6801/249539632] [v2:127.0.0.1:6802/249539632,v1:127.0.0.1:6803/249539632] exists,up 0993cc11-e3a1-40a4-8dc3-995349e59e7f 2026-02-23T08:20:28.840 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 2b7b1860-e22b-496b-9ab0-75528c19199d 2026-02-23T08:20:28.938 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:28.964 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:28.962+0000 7f2bfed49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:28.965 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:28.963+0000 7f2bfed49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:28.966 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:28.964+0000 7f2bfed49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:28.966 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:28.964+0000 7f2bfed49780 -1 bdev(0x555e88ed1400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:20:28.967 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:28.964+0000 7f2bfed49780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:20:29.385 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:20:29.588 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:20:29.604 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:29.602+0000 7f2b64f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:29.605 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:29.603+0000 7f2b64f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:29.606 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:29.604+0000 7f2b64f4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:29.757 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:29.768 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:29.766+0000 7f2b64f4b780 -1 Falling back to public interface 2026-02-23T08:20:30.121 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:30.119+0000 7f2b64f4b780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:20:30.923 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:31.085 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3699645727,v1:127.0.0.1:6811/3699645727] [v2:127.0.0.1:6812/3699645727,v1:127.0.0.1:6813/3699645727] exists,up 2b7b1860-e22b-496b-9ab0-75528c19199d 2026-02-23T08:20:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:170: TEST_skip_non_repair_during_recovery: local poolname=rbd 2026-02-23T08:20:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:171: TEST_skip_non_repair_during_recovery: create_rbd_pool 2026-02-23T08:20:32.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:526: create_rbd_pool: ceph osd pool delete rbd rbd --yes-i-really-really-mean-it 2026-02-23T08:20:32.245 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' does not exist 2026-02-23T08:20:32.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:527: create_rbd_pool: create_pool rbd 4 2026-02-23T08:20:32.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create rbd 4 2026-02-23T08:20:32.465 INFO:tasks.workunit.client.0.trial129.stderr:pool 'rbd' created 2026-02-23T08:20:32.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:33.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:528: create_rbd_pool: rbd pool init rbd 2026-02-23T08:20:33.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:172: TEST_skip_non_repair_during_recovery: wait_for_clean 2026-02-23T08:20:33.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:33.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:33.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:33.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:33.760 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:33.760 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:33.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:33.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:33.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:33.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:33.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:33.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:33.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:33.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:33.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:34.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:20:34.014 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:20:34.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:34.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:34.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:34.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:20:34.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:20:34.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:20:34.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:34.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:20:34.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T08:20:34.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T08:20:34.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672964' 2026-02-23T08:20:34.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:34.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:20:34.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:34.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:34.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:20:34.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:34.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:20:34.165 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:20:34.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:20:34.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:34.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-23T08:20:34.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:35.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:35.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:35.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:20:35.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:35.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T08:20:35.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:35.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:20:35.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T08:20:35.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:35.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T08:20:35.499 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T08:20:35.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T08:20:35.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:20:35.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672965 -lt 42949672964 2026-02-23T08:20:35.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:35.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:35.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:35.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:20:35.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:35.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:35.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:35.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:35.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:35.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:35.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:36.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:20:36.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:36.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:36.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:36.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:20:36.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:174: TEST_skip_non_repair_during_recovery: add_something td/osd-scrub-repair rbd 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=rbd 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:20:36.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:20:36.438 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:20:36.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:20:36.643 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:20:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:20:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:20:36.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool rbd put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:20:36.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:175: TEST_skip_non_repair_during_recovery: get_not_primary rbd SOMETHING 2026-02-23T08:20:36.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=rbd 2026-02-23T08:20:36.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=SOMETHING 2026-02-23T08:20:36.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary rbd SOMETHING 2026-02-23T08:20:36.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=rbd 2026-02-23T08:20:36.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:20:36.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T08:20:36.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:20:36.840 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:20:36.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map rbd SOMETHING 2026-02-23T08:20:36.841 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:20:37.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:175: TEST_skip_non_repair_during_recovery: scrub_and_not_schedule td/osd-scrub-repair rbd 0 2026-02-23T08:20:37.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:214: scrub_and_not_schedule: local dir=td/osd-scrub-repair 2026-02-23T08:20:37.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:215: scrub_and_not_schedule: local poolname=rbd 2026-02-23T08:20:37.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:216: scrub_and_not_schedule: local osd=0 2026-02-23T08:20:37.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:221: scrub_and_not_schedule: get_pg rbd SOMETHING 2026-02-23T08:20:37.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=rbd 2026-02-23T08:20:37.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:20:37.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map rbd SOMETHING 2026-02-23T08:20:37.007 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:20:37.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:221: scrub_and_not_schedule: local pg=1.3 2026-02-23T08:20:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:222: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-23T08:20:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:20:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:20:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:20:37.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:20:37.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:222: scrub_and_not_schedule: local last_scrub=2026-02-23T08:20:32.464172+0000 2026-02-23T08:20:37.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:223: scrub_and_not_schedule: ceph tell 1.3 schedule-scrub 2026-02-23T08:20:37.400 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:20:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:20:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:20:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:20:37.399724+0000" 2026-02-23T08:20:37.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:20:37.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:228: scrub_and_not_schedule: sleep 3 2026-02-23T08:20:40.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i=0 )) 2026-02-23T08:20:40.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-23T08:20:40.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-23T08:20:40.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:20:40.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:20:40.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:20:40.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:20:40.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: test 2026-02-21T08:20:37.399724+0000 '>' 2026-02-23T08:20:32.464172+0000 2026-02-23T08:20:40.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: scrub_and_not_schedule: sleep 1 2026-02-23T08:20:41.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i++ )) 2026-02-23T08:20:41.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-23T08:20:41.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-23T08:20:41.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:20:41.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:20:41.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:20:41.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:20:41.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: test 2026-02-21T08:20:37.399724+0000 '>' 2026-02-23T08:20:32.464172+0000 2026-02-23T08:20:41.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: scrub_and_not_schedule: sleep 1 2026-02-23T08:20:42.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i++ )) 2026-02-23T08:20:42.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-23T08:20:42.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: get_last_scrub_stamp 1.3 2026-02-23T08:20:42.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.3 2026-02-23T08:20:42.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:20:42.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:20:42.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.3") | .last_scrub_stamp' 2026-02-23T08:20:42.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:230: scrub_and_not_schedule: test 2026-02-21T08:20:37.399724+0000 '>' 2026-02-23T08:20:32.464172+0000 2026-02-23T08:20:42.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:233: scrub_and_not_schedule: sleep 1 2026-02-23T08:20:43.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i++ )) 2026-02-23T08:20:43.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:229: scrub_and_not_schedule: (( i < 3 )) 2026-02-23T08:20:43.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:239: scrub_and_not_schedule: objectstore_tool td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T08:20:43.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:20:43.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:20:43.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:20:43.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:20:43.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:20:44.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:20:44.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING list-attrs 2026-02-23T08:20:44.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:20:44.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:20:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:20:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:20:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:20:44.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING list-attrs 2026-02-23T08:20:44.292 INFO:tasks.workunit.client.0.trial129.stdout:_ 2026-02-23T08:20:44.292 INFO:tasks.workunit.client.0.trial129.stdout:snapset 2026-02-23T08:20:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:20:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:20:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:20:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:20:44.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:20:44.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:20:44.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:start osd.0 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:20:44.345 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:20:44.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:20:44.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:20:44.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:20:44.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:20:44.354 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:44.352+0000 7f7fe9ca6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:44.355 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:44.353+0000 7f7fe9ca6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:44.356 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:44.354+0000 7f7fe9ca6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:44.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:20:44.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:20:44.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:44.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:20:44.575 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:44.573+0000 7f7fe9ca6780 -1 Falling back to public interface 2026-02-23T08:20:44.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:20:44.906 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:44.904+0000 7f7fe9ca6780 -1 osd.0 20 log_to_monitors true 2026-02-23T08:20:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:20:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:20:45.673 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:20:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:45.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:20:45.837 INFO:tasks.workunit.client.0.trial129.stderr:osd.0 up in weight 1 up_from 24 up_thru 24 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/4071477144,v1:127.0.0.1:6801/4071477144] [v2:127.0.0.1:6802/4071477144,v1:127.0.0.1:6803/4071477144] exists,up 0993cc11-e3a1-40a4-8dc3-995349e59e7f 2026-02-23T08:20:45.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:20:45.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:20:45.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:20:45.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:20:45.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:45.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:45.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:45.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:45.839 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:45.839 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:45.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:45.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:45.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:45.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:45.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:45.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:45.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:45.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:46.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:20:46.088 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:20:46.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:46.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:46.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:46.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215107 2026-02-23T08:20:46.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215107 2026-02-23T08:20:46.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215107' 2026-02-23T08:20:46.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:46.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:20:46.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672977 2026-02-23T08:20:46.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672977 2026-02-23T08:20:46.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215107 1-42949672977' 2026-02-23T08:20:46.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:46.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215107 2026-02-23T08:20:46.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:46.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:46.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215107 2026-02-23T08:20:46.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:46.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215107 2026-02-23T08:20:46.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215107' 2026-02-23T08:20:46.243 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 103079215107 2026-02-23T08:20:46.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:46.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836497 -lt 103079215107 2026-02-23T08:20:46.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:20:47.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:20:47.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:47.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215107 -lt 103079215107 2026-02-23T08:20:47.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:47.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672977 2026-02-23T08:20:47.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:47.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:20:47.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672977 2026-02-23T08:20:47.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:47.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672977 2026-02-23T08:20:47.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2026-02-23T08:20:47.578 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672977 2026-02-23T08:20:47.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:20:47.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672978 -lt 42949672977 2026-02-23T08:20:47.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:20:47.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:47.744 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:47.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 4 == 0 2026-02-23T08:20:47.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:20:47.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:20:47.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:20:47.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:20:47.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:20:47.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:20:47.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:20:48.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=4 2026-02-23T08:20:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:20:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:20:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:20:48.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 4 = 4 2026-02-23T08:20:48.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:20:48.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:20:48.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:240: scrub_and_not_schedule: rados --pool rbd get SOMETHING td/osd-scrub-repair/COPY 2026-02-23T08:20:48.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:241: scrub_and_not_schedule: diff td/osd-scrub-repair/ORIGINAL td/osd-scrub-repair/COPY 2026-02-23T08:20:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:20:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:20:48.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:20:48.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:20:48.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:20:48.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:20:48.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:20:48.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:20:48.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:20:48.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:20:48.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:20:48.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:20:48.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:20:48.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:20:48.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:20:48.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:48.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:20:48.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:20:48.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:48.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:20:48.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:20:48.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:20:48.463 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:20:48.463 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.464 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:20:48.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:20:48.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:20:48.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:20:48.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:20:48.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:20:48.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:20:48.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:20:48.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:20:48.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:20:48.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:20:48.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:20:48.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:48.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:20:48.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:20:48.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:20:48.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:20:48.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:20:48.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:20:48.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:20:48.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:20:48.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:20:48.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:20:48.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:20:48.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:20:48.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:20:48.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_unfound_erasure_coded_appends td/osd-scrub-repair 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:962: TEST_unfound_erasure_coded_appends: unfound_erasure_coded td/osd-scrub-repair false 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:911: unfound_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:912: unfound_erasure_coded: local allow_overwrites=false 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:913: unfound_erasure_coded: local poolname=ecpool 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:914: unfound_erasure_coded: local payload=ABCDEF 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:916: unfound_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:20:48.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:20:48.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:20:48.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:48.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:48.497 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:48.497 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.497 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.497 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:48.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:20:48.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:20:48.520 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:20:48.521 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:20:48.521 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.521 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.521 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:20:48.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:20:48.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:20:48.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:20:48.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:20:48.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:20:48.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:20:48.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:20:48.581 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:20:48.582 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:20:48.582 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:20:48.583 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:20:48.583 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.583 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.583 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:20:48.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:20:48.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:917: unfound_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:20:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.733 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:48.734 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:20:48.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:20:48.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: seq 0 3 2026-02-23T08:20:48.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:20:48.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:48.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:20:48.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=dd9bb63a-80f3-4ec9-8557-5034c13492b3 2026-02-23T08:20:48.756 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 dd9bb63a-80f3-4ec9-8557-5034c13492b3 2026-02-23T08:20:48.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 dd9bb63a-80f3-4ec9-8557-5034c13492b3' 2026-02-23T08:20:48.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:20:48.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDgDZxps+p7LRAAeI3EBNknx09ckF2Ud7ulTw== 2026-02-23T08:20:48.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDgDZxps+p7LRAAeI3EBNknx09ckF2Ud7ulTw=="}' 2026-02-23T08:20:48.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new dd9bb63a-80f3-4ec9-8557-5034c13492b3 -i td/osd-scrub-repair/0/new.json 2026-02-23T08:20:48.852 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:48.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:20:48.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDgDZxps+p7LRAAeI3EBNknx09ckF2Ud7ulTw== --osd-uuid dd9bb63a-80f3-4ec9-8557-5034c13492b3 2026-02-23T08:20:48.877 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:48.875+0000 7f256c551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:48.878 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:48.876+0000 7f256c551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:48.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:48.877+0000 7f256c551780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:48.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:48.877+0000 7f256c551780 -1 bdev(0x56412389f400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:20:48.879 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:48.877+0000 7f256c551780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:20:49.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:20:49.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:20:49.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:20:49.312 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:20:49.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:20:49.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:20:49.409 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:20:49.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:20:49.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:20:49.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:20:49.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:20:49.422 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:49.420+0000 7f907e94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:49.423 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:49.421+0000 7f907e94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:49.424 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:49.422+0000 7f907e94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:49.502 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:49.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:20:49.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:49.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:20:49.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:20:49.652 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:49.650+0000 7f907e94f780 -1 Falling back to public interface 2026-02-23T08:20:50.057 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:50.055+0000 7f907e94f780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:20:50.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:20:50.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:50.597 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:50.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:20:50.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:50.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:20:50.687 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1784377707,v1:127.0.0.1:6801/1784377707] [v2:127.0.0.1:6802/1784377707,v1:127.0.0.1:6803/1784377707] exists,up dd9bb63a-80f3-4ec9-8557-5034c13492b3 2026-02-23T08:20:50.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:20:50.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:50.693 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:20:50.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:20:50.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:20:50.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:20:50.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:20:50.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:20:50.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=36b606de-de07-4b9d-a4c7-c068d7493257 2026-02-23T08:20:50.695 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 36b606de-de07-4b9d-a4c7-c068d7493257 2026-02-23T08:20:50.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 36b606de-de07-4b9d-a4c7-c068d7493257' 2026-02-23T08:20:50.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:20:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDiDZxppEy/KRAAmL7eQIcVy29ZYGEMlbXBWw== 2026-02-23T08:20:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDiDZxppEy/KRAAmL7eQIcVy29ZYGEMlbXBWw=="}' 2026-02-23T08:20:50.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 36b606de-de07-4b9d-a4c7-c068d7493257 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:20:50.789 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:50.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:20:50.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDiDZxppEy/KRAAmL7eQIcVy29ZYGEMlbXBWw== --osd-uuid 36b606de-de07-4b9d-a4c7-c068d7493257 2026-02-23T08:20:50.812 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:50.810+0000 7fa2bac06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:50.813 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:50.812+0000 7fa2bac06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:50.814 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:50.812+0000 7fa2bac06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:50.815 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:50.813+0000 7fa2bac06780 -1 bdev(0x562b0261b400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:20:50.815 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:50.813+0000 7fa2bac06780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:20:51.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:20:51.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:20:51.264 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:20:51.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:20:51.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:20:51.472 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:20:51.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:20:51.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:20:51.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:20:51.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:20:51.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:20:51.485 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:51.484+0000 7f599340b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:51.487 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:51.485+0000 7f599340b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:51.488 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:51.486+0000 7f599340b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:51.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:51.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:20:51.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:51.653+0000 7f599340b780 -1 Falling back to public interface 2026-02-23T08:20:51.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:20:52.035 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:52.033+0000 7f599340b780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:20:52.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:20:52.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:52.804 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:52.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:20:52.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:52.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:20:52.969 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/172396165,v1:127.0.0.1:6811/172396165] [v2:127.0.0.1:6812/172396165,v1:127.0.0.1:6813/172396165] exists,up 36b606de-de07-4b9d-a4c7-c068d7493257 2026-02-23T08:20:52.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:52.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:20:52.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:20:52.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:20:52.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=88acb5fd-a671-4db1-b134-66065694ddd2 2026-02-23T08:20:52.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 88acb5fd-a671-4db1-b134-66065694ddd2' 2026-02-23T08:20:52.973 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 88acb5fd-a671-4db1-b134-66065694ddd2 2026-02-23T08:20:52.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:20:52.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDkDZxp7eR/OhAA6nSY41bS64C7o51eXg2nTQ== 2026-02-23T08:20:52.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDkDZxp7eR/OhAA6nSY41bS64C7o51eXg2nTQ=="}' 2026-02-23T08:20:52.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 88acb5fd-a671-4db1-b134-66065694ddd2 -i td/osd-scrub-repair/2/new.json 2026-02-23T08:20:53.142 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:20:53.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:20:53.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDkDZxp7eR/OhAA6nSY41bS64C7o51eXg2nTQ== --osd-uuid 88acb5fd-a671-4db1-b134-66065694ddd2 2026-02-23T08:20:53.167 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.165+0000 7f1a23aba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:53.168 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.166+0000 7f1a23aba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:53.169 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.167+0000 7f1a23aba780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:53.170 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.168+0000 7f1a23aba780 -1 bdev(0x563a48e1f400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:20:53.170 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.168+0000 7f1a23aba780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:20:53.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:20:53.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:20:53.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:20:53.589 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:20:53.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:20:53.802 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:20:53.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:20:53.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:20:53.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:20:53.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:20:53.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:20:53.815 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.813+0000 7f160274f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:53.817 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.816+0000 7f160274f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:53.818 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:53.816+0000 7f160274f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:53.966 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:53.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:20:53.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:53.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:20:54.015 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:54.015+0000 7f160274f780 -1 Falling back to public interface 2026-02-23T08:20:54.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:20:54.351 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:54.350+0000 7f160274f780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:20:55.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:20:55.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:55.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:20:55.132 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:55.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:55.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:20:55.296 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1433739605,v1:127.0.0.1:6819/1433739605] [v2:127.0.0.1:6820/1433739605,v1:127.0.0.1:6821/1433739605] exists,up 88acb5fd-a671-4db1-b134-66065694ddd2 2026-02-23T08:20:55.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 3 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:20:55.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:20:55.299 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:20:55.299 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:20:55.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:55.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f8e85dd8-c609-442d-8096-2203006a52a0 2026-02-23T08:20:55.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 f8e85dd8-c609-442d-8096-2203006a52a0' 2026-02-23T08:20:55.301 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 f8e85dd8-c609-442d-8096-2203006a52a0 2026-02-23T08:20:55.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:20:55.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDnDZxp6ypoEhAA3GTGbMypwRQooslok1Bfqg== 2026-02-23T08:20:55.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDnDZxp6ypoEhAA3GTGbMypwRQooslok1Bfqg=="}' 2026-02-23T08:20:55.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f8e85dd8-c609-442d-8096-2203006a52a0 -i td/osd-scrub-repair/3/new.json 2026-02-23T08:20:55.469 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T08:20:55.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-23T08:20:55.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDnDZxp6ypoEhAA3GTGbMypwRQooslok1Bfqg== --osd-uuid f8e85dd8-c609-442d-8096-2203006a52a0 2026-02-23T08:20:55.495 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:55.493+0000 7f1e8a767780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:55.496 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:55.495+0000 7f1e8a767780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:55.497 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:55.496+0000 7f1e8a767780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:55.497 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:55.496+0000 7f1e8a767780 -1 bdev(0x56070d8d9400 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-23T08:20:55.497 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:55.496+0000 7f1e8a767780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-23T08:20:55.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-23T08:20:55.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:20:55.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T08:20:55.925 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T08:20:55.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:20:56.130 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T08:20:56.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T08:20:56.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:20:56.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:20:56.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:20:56.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:20:56.143 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:56.142+0000 7f617fb49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:56.144 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:56.144+0000 7f617fb49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:56.145 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:56.144+0000 7f617fb49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:20:56.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T08:20:56.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:20:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:20:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:20:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:20:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:20:56.296 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:20:56.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:56.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:20:56.349 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:56.348+0000 7f617fb49780 -1 Falling back to public interface 2026-02-23T08:20:56.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:20:56.694 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:20:56.693+0000 7f617fb49780 -1 osd.3 0 log_to_monitors true 2026-02-23T08:20:57.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:20:57.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:20:57.461 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:20:57.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:20:57.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:20:57.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:20:57.628 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1447232949,v1:127.0.0.1:6827/1447232949] [v2:127.0.0.1:6828/1447232949,v1:127.0.0.1:6829/1447232949] exists,up f8e85dd8-c609-442d-8096-2203006a52a0 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:922: unfound_erasure_coded: create_ec_pool ecpool false k=2 m=2 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:20:57.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=false 2026-02-23T08:20:57.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:20:57.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-23T08:20:57.871 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:20:57.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:20:57.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:20:58.175 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:20:58.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:20:59.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' false = true ']' 2026-02-23T08:20:59.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:20:59.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:20:59.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:20:59.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:20:59.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:20:59.192 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:20:59.192 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:20:59.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:20:59.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:20:59.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:20:59.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:20:59.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:20:59.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:20:59.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:20:59.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:20:59.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:20:59.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:20:59.443 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:20:59.443 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:20:59.443 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:20:59.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:20:59.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:59.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:20:59.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:20:59.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:20:59.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:20:59.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:59.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:20:59.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T08:20:59.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T08:20:59.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T08:20:59.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:59.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:20:59.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542146 2026-02-23T08:20:59.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542146 2026-02-23T08:20:59.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146' 2026-02-23T08:20:59.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:20:59.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:20:59.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=81604378626 2026-02-23T08:20:59.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 81604378626 2026-02-23T08:20:59.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-60129542146 3-81604378626' 2026-02-23T08:20:59.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:20:59.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:20:59.742 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:20:59.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:20:59.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:20:59.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:20:59.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:20:59.745 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:20:59.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:20:59.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:20:59.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:20:59.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:00.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:00.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:01.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:21:01.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:01.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T08:21:01.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:01.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:01.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T08:21:01.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:01.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T08:21:01.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T08:21:01.078 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T08:21:01.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:01.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-23T08:21:01.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:01.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542146 2026-02-23T08:21:01.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:01.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:01.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542146 2026-02-23T08:21:01.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:01.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542146 2026-02-23T08:21:01.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542146' 2026-02-23T08:21:01.248 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542146 2026-02-23T08:21:01.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:01.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542147 -lt 60129542146 2026-02-23T08:21:01.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:01.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-81604378626 2026-02-23T08:21:01.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:01.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:01.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-81604378626 2026-02-23T08:21:01.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:01.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=81604378626 2026-02-23T08:21:01.417 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 81604378626 2026-02-23T08:21:01.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 81604378626' 2026-02-23T08:21:01.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:01.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 81604378626 -lt 81604378626 2026-02-23T08:21:01.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:01.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:01.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:01.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:01.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:01.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-23T08:21:01.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:01.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:01.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:02.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-23T08:21:02.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-23T08:21:02.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-23T08:21:02.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-23T08:21:02.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-23T08:21:02.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-23T08:21:02.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-23T08:21:02.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:02.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:02.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:02.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:02.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:02.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:02.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-23T08:21:02.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:02.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:02.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:02.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-23T08:21:02.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-23T08:21:02.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-23T08:21:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-23T08:21:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 13 )) 2026-02-23T08:21:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-23T08:21:02.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-23T08:21:03.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-23T08:21:03.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:03.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:03.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:03.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:03.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:03.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:03.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:03.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-23T08:21:03.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:03.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:03.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-23T08:21:03.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-23T08:21:03.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-23T08:21:03.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-23T08:21:03.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-23T08:21:03.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-23T08:21:03.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 13 )) 2026-02-23T08:21:03.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-23T08:21:03.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-23T08:21:04.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-23T08:21:04.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:04.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:04.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:04.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:04.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:04.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:04.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:04.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-23T08:21:04.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:04.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:04.177 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:04.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-23T08:21:04.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-23T08:21:04.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-23T08:21:04.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-23T08:21:04.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-23T08:21:04.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-23T08:21:04.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-23T08:21:04.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-23T08:21:04.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-23T08:21:04.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-23T08:21:04.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-23T08:21:04.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 13 )) 2026-02-23T08:21:04.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-23T08:21:04.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-23T08:21:05.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-23T08:21:05.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:05.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:05.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:05.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:05.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:05.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:05.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:05.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:05.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:05.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:05.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:05.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:05.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:05.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:05.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:21:05.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:924: unfound_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-23T08:21:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:21:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:21:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:21:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:21:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:21:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:21:05.965 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:21:05.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:21:06.169 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:21:06.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:21:06.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:21:06.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:21:06.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: get_primary ecpool SOMETHING 2026-02-23T08:21:06.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T08:21:06.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:21:06.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:21:06.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:21:06.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: local primary=1 2026-02-23T08:21:06.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: get_osds ecpool SOMETHING 2026-02-23T08:21:06.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: sed -e s/1// 2026-02-23T08:21:06.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:21:06.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-23T08:21:06.369 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:21:06.369 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:21:06.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:21:06.533 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:21:06.533 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:21:06.533 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:21:06.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 3 2026-02-23T08:21:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: osds=('0' '2' '3') 2026-02-23T08:21:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: local -a osds 2026-02-23T08:21:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:928: unfound_erasure_coded: local not_primary_first=0 2026-02-23T08:21:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:929: unfound_erasure_coded: local not_primary_second=2 2026-02-23T08:21:06.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:930: unfound_erasure_coded: local not_primary_third=3 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:935: unfound_erasure_coded: pids= 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:936: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 821317"' 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 821317' 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:937: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 821318"' 2026-02-23T08:21:06.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 821318' 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:938: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 821320"' 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 821320' 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:939: unfound_erasure_coded: wait_background pids 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 821317 821318 821320' 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 821317 2026-02-23T08:21:06.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/821321: /' 2026-02-23T08:21:06.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:06.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/821323: /' 2026-02-23T08:21:06.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:06.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/821326: /' 2026-02-23T08:21:07.044 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:21:07.045 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:07.046 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:07.047 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:07.047 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.047 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:21:07.047 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:21:07.047 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:21:07.047 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: remove 1#1:eb822e21:::SOMETHING:head# 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:21:07.048 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:21:07.049 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:21:07.049 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:07.049 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:07.049 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:07.049 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:07.050 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:21:07.051 INFO:tasks.workunit.client.0.trial129.stderr:821321: start osd.0 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.057 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: remove 2#1:eb822e21:::SOMETHING:head# 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: 821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.058 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: remove 3#1:eb822e21:::SOMETHING:head# 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:07.059 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:21:07.060 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821323: start osd.2 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_oactivate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:21:07.061 INFO:tasks.workunit.client.0.trial129.stderr:821326: start osd.3 2026-02-23T08:21:08.561 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:08.561 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:21:08.561 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:21:08.561 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: 2026-02-23T08:21:07.059+0000 7f2fbff55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: 2026-02-23T08:21:07.061+0000 7f2fbff55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: 2026-02-23T08:21:07.062+0000 7f2fbff55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:08.562 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: 0 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: 2026-02-23T08:21:07.234+0000 7f2fbff55780 -1 Falling back to public interface 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: 2026-02-23T08:21:07.643+0000 7f2fbff55780 -1 osd.0 27 log_to_monitors true 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: 1 2026-02-23T08:21:08.563 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: osd.0 up in weight 1 up_from 31 up_thru 0 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6826/1005147088,v1:127.0.0.1:6827/1005147088] [v2:127.0.0.1:6828/1005147088,v1:127.0.0.1:6829/1005147088] exists,up dd9bb63a-80f3-4ec9-8557-5034c13492b3 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:08.564 INFO:tasks.workunit.client.0.trial129.stderr:821321: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:08.573 INFO:tasks.workunit.client.0.trial129.stderr:821321: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593:ps 2026-02-23T08:21:08.573 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:21:08.573 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:21:08.574 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:21:08.574 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:21:08.574 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:21:08.574 INFO:tasks.workunit.client.0.trial129.stderr:821326: 2026-02-23T08:21:07.071+0000 7f883160d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.574 INFO:tasks.workunit.client.0.trial129.stderr:821326: 2026-02-23T08:21:07.073+0000 7f883160d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.574 INFO:tasks.workunit.client.0.trial129.stderr:821326: 2026-02-23T08:21:07.073+0000 7f883160d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: 2026-02-23T08:21:07.229+0000 7f883160d780 -1 Falling back to public interface 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:08.575 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: 0 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: 2026-02-23T08:21:07.656+0000 7f883160d780 -1 osd.3 27 log_to_monitors true 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: 1 2026-02-23T08:21:08.576 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: osd.3 up in weight 1 up_from 32 up_thru 0 down_at 28 last_clean_interval [19,27) [v2:127.0.0.1:6800/2470301860,v1:127.0.0.1:6801/2470301860] [v2:127.0.0.1:6802/2470301860,v1:127.0.0.1:6803/2470301860] exists,up f8e85dd8-c609-442d-8096-2203006a52a0 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:08.577 INFO:tasks.workunit.client.0.trial129.stderr:821326: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:08.583 INFO:tasks.workunit.client.0.trial129.stderr:821326: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-23T08:21:08.583 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:21:08.583 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:21:08.583 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:21:08.583 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: 2026-02-23T08:21:07.071+0000 7f522bd73780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: 2026-02-23T08:21:07.073+0000 7f522bd73780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: 2026-02-23T08:21:07.074+0000 7f522bd73780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: 2026-02-23T08:21:07.229+0000 7f522bd73780 -1 Falling back to public interface 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:08.584 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: 0 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: 2026-02-23T08:21:07.623+0000 7f522bd73780 -1 osd.2 27 log_to_monitors true 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:08.585 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:08.586 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:08.586 INFO:tasks.workunit.client.0.trial129.stderr:821323: 1 2026-02-23T08:21:08.586 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:08.586 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:21:08.586 INFO:tasks.workunit.client.0.trial129.stderr:821323: osd.2 up in weight 1 up_from 31 up_thru 0 down_at 28 last_clean_interval [14,27) [v2:127.0.0.1:6818/2809988236,v1:127.0.0.1:6819/2809988236] [v2:127.0.0.1:6820/2809988236,v1:127.0.0.1:6821/2809988236] exists,up 88acb5fd-a671-4db1-b134-66065694ddd2 2026-02-23T08:21:08.586 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:08.587 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:08.588 INFO:tasks.workunit.client.0.trial129.stderr:821323: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821323: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593 get_timeout_delays: echo true 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: 1 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: 2 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: 3' 2026-02-23T08:21:09.122 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178' 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178 1-38654705670' 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178 1-38654705670 2-133143986178' 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953474 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953474 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178 1-38654705670 2-133143986178 3-137438953474' 2026-02-23T08:21:09.123 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:09.124 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: : get_timeout_delays: echo true 2026-02-23T08:21:09.124 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:09.124 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:09.124 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:09.124 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: 1 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: 2 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: 3' 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179' 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179 1-38654705671' 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179 1-38654705671 2-133143986179' 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953475 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953475 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179 1-38654705671 2-133143986179 3-137438953475' 2026-02-23T08:21:09.125 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:: get_timeout_delays: echo true 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:09.138 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: 1 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: 2 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: 3' 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180' 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180 1-38654705672' 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180 1-38654705672 2-133143986180' 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=137438953476 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 137438953476 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180 1-38654705672 2-133143986180 3-137438953476' 2026-02-23T08:21:09.139 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.820 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:flush_pg_stats: echo 0-133143986178 2026-02-23T08:21:11.820 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.820 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:11.820 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986178 2026-02-23T08:21:11.820 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 133143986178' 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: waiting osd.0 seq 133143986178 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986178 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986178 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:21:11.821 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986178 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.822 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T08:21:11.823 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T08:21:11.823 INFO:tasks.workunit.client.0.trial129.stderr:821321: waiting osd.1 seq 38654705670 2026-02-23T08:21:11.823 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:11.823 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705670 2026-02-23T08:21:11.823 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.823 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-133143986178 2026-02-23T08:21:11.824 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.824 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:11.824 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-133143986178 2026-02-23T08:21:11.824 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.824 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waitin flush_pg_stats: echo 0-133143986179 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986179 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-23T08:21:11.825 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 133143986179' 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: waiting osd.0 seq 133143986179 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986179 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986179 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986179 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.826 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: waiting osd.1 seq 38654705671 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705671 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-133143986179 2026-02-23T08:21:11.827 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.828 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:11.828 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-133143986179 2026-02-23T08:21:11.828 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.828 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiti flush_pg_stats: echo 0-133143986180 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986180 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986180 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 133143986180' 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: waiting osd.0 seq 133143986180 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.832 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986180 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986180 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986180 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:11.833 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: waiting osd.1 seq 38654705672 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-133143986180 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-133143986180 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:11.834 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986180 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waitig osd.2 seq 133143986178' 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: waiting osd.2 seq 133143986178 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986178 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-137438953474 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-137438953474 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953474 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 137438953474' 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: waiting osd.3 seq 137438953474 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953476 -lt 137438953474 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:12.749 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:12.750 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:12.750 INFO:tasks.workunit.client.0.trial129.stderr:821321: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:12.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:21:12.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:21:12.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 821318 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:ng osd.2 seq 133143986179' 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: waiting osd.2 seq 133143986179 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986179 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-137438953475 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:12.757 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-137438953475 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953475 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 137438953475' 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: waiting osd.3 seq 137438953475 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953476 -lt 137438953475 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:821326: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:12.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:ng osd.2 seq 133143986180' 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: waiting osd.2 seq 133143986180 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986180 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-137438953476 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-137438953476 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=137438953476 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 137438953476' 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: waiting osd.3 seq 137438953476 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 137438953476 -lt 137438953476 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:12.761 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:821323: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 821320 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:21:12.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:940: unfound_erasure_coded: return_code=0 2026-02-23T08:21:12.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:941: unfound_erasure_coded: '[' 0 -ne 0 ']' 2026-02-23T08:21:12.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: get_pg ecpool SOMETHING 2026-02-23T08:21:12.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:21:12.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:21:12.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:21:12.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:21:12.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: local pg=1.0 2026-02-23T08:21:12.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:947: unfound_erasure_coded: repair 1.0 2026-02-23T08:21:12.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-23T08:21:12.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-23T08:21:12.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:12.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:12.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:12.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:13.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:13.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-23T08:21:13.250 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0s0 on osd.1 to repair 2026-02-23T08:21:13.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:13.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:21:13.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:13.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:21:13.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:21:13.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:13.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:13.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:13.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:13.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:13.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:13.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:20:58.173153+0000 '>' 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:13.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:14.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:14.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:14.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:14.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:14.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:14.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:14.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:14.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:20:58.173153+0000 '>' 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:14.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:15.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:15.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:15.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:15.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:15.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:15.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:15.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:15.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:20:58.173153+0000 '>' 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:15.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:16.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:16.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:16.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:16.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:16.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:16.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:16.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:16.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:20:58.173153+0000 '>' 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:16.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:17.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:17.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:17.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:17.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:17.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:17.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:17.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:18.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:20:58.173153+0000 '>' 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:18.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:19.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:19.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:19.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:19.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:19.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:19.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:19.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:19.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:14.064174+0000 '>' 2026-02-23T08:20:58.173153+0000 2026-02-23T08:21:19.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:21:19.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: seq 1 60 2026-02-23T08:21:19.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: for f in `seq 1 60` 2026-02-23T08:21:19.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: ceph -s 2026-02-23T08:21:19.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-23T08:21:19.472 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:19.472 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:19.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: break 2026-02-23T08:21:19.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: ceph -s 2026-02-23T08:21:19.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: grep '4 up' 2026-02-23T08:21:19.673 INFO:tasks.workunit.client.0.trial129.stdout: osd: 4 osds: 4 up (since 11s), 4 in (since 24s) 2026-02-23T08:21:19.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: ceph -s 2026-02-23T08:21:19.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: grep '4 in' 2026-02-23T08:21:19.874 INFO:tasks.workunit.client.0.trial129.stdout: osd: 4 osds: 4 up (since 11s), 4 in (since 24s) 2026-02-23T08:21:19.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: ceph -s 2026-02-23T08:21:19.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-23T08:21:20.080 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:20.080 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:20.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:21:20.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:21:20.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:21:20.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:20.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:20.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:20.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:20.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:20.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:20.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:21:20.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:21:20.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:21:20.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:21:20.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:21:20.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:21:20.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:20.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:21:20.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:21:20.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:20.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:21:20.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:21:20.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:21:20.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:21:20.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:21:20.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:21:20.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:21:20.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:63: run: for func in $funcs 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:64: run: setup td/osd-scrub-repair 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-repair 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:20.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:20.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:20.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:20.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:20.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:20.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:21:20.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:21:20.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:21:20.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:21:20.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:21:20.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:21:20.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:20.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:21:20.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:21:20.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:20.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:21:20.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:21:20.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:21:20.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:21:20.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:21:20.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:21:20.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:21:20.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-repair 2026-02-23T08:21:20.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:21:20.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.424317 2026-02-23T08:21:20.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:21:20.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:21:20.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-repair 1' TERM HUP INT 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:65: run: TEST_unfound_erasure_coded_overwrites td/osd-scrub-repair 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:966: TEST_unfound_erasure_coded_overwrites: '[' true = true ']' 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:967: TEST_unfound_erasure_coded_overwrites: unfound_erasure_coded td/osd-scrub-repair true 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:911: unfound_erasure_coded: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:912: unfound_erasure_coded: local allow_overwrites=true 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:913: unfound_erasure_coded: local poolname=ecpool 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:914: unfound_erasure_coded: local payload=ABCDEF 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:916: unfound_erasure_coded: run_mon td/osd-scrub-repair a 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:21:20.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:21:20.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:21:20.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-repair/a 2026-02-23T08:21:20.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-repair/a --run-dir=td/osd-scrub-repair 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:20.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-repair/a '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-repair/log --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:21:20.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:21:20.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:21:20.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:21:20.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:21:20.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:21:20.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:21:20.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:21:20.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get fsid 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:21:20.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:21:20.325 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:21:20.326 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:21:20.326 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.326 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.326 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.424317/ceph-mon.a.asok 2026-02-23T08:21:20.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:21:20.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.424317/ceph-mon.a.asok config get mon_host 2026-02-23T08:21:20.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:917: unfound_erasure_coded: run_mgr td/osd-scrub-repair x 2026-02-23T08:21:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:21:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:21:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:21:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-repair/x 2026-02-23T08:21:20.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:21:20.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:21:20.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:20.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:20.475 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:20.475 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.475 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:20.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:21:20.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-repair/x '--log-file=td/osd-scrub-repair/$name.log' '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --run-dir=td/osd-scrub-repair '--pid-file=td/osd-scrub-repair/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:21:20.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: seq 0 3 2026-02-23T08:21:20.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 0 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:21:20.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:21:20.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:20.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:20.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8898f828-e811-4802-8a03-02ce75be675f 2026-02-23T08:21:20.502 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8898f828-e811-4802-8a03-02ce75be675f' 2026-02-23T08:21:20.503 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 8898f828-e811-4802-8a03-02ce75be675f 2026-02-23T08:21:20.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:21:20.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAADpxp9loAHhAAyb0jcYsMeA9/2iEjKh+VBg== 2026-02-23T08:21:20.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAADpxp9loAHhAAyb0jcYsMeA9/2iEjKh+VBg=="}' 2026-02-23T08:21:20.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8898f828-e811-4802-8a03-02ce75be675f -i td/osd-scrub-repair/0/new.json 2026-02-23T08:21:20.592 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:20.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/0/new.json 2026-02-23T08:21:20.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAADpxp9loAHhAAyb0jcYsMeA9/2iEjKh+VBg== --osd-uuid 8898f828-e811-4802-8a03-02ce75be675f 2026-02-23T08:21:20.617 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:20.616+0000 7f4da1350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:20.618 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:20.617+0000 7f4da1350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:20.619 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:20.618+0000 7f4da1350780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:20.619 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:20.618+0000 7f4da1350780 -1 bdev(0x558c5931b400 td/osd-scrub-repair/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:21:20.619 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:20.618+0000 7f4da1350780 -1 bluestore(td/osd-scrub-repair/0) _read_fsid unparsable uuid 2026-02-23T08:21:21.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/0/keyring 2026-02-23T08:21:21.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:21:21.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:21:21.052 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:21:21.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:21:21.149 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:21:21.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:21:21.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:21.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:21:21.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:21:21.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:21:21.162 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:21.161+0000 7f94aa413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:21.163 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:21.162+0000 7f94aa413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:21.164 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:21.163+0000 7f94aa413780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:21.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:21.245 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:21.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:21.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:21.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:21.351 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:21.350+0000 7f94aa413780 -1 Falling back to public interface 2026-02-23T08:21:21.774 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:21.773+0000 7f94aa413780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:21:22.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:22.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:22.336 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:21:22.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:22.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:22.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:22.427 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1533132850,v1:127.0.0.1:6801/1533132850] [v2:127.0.0.1:6802/1533132850,v1:127.0.0.1:6803/1533132850] exists,up 8898f828-e811-4802-8a03-02ce75be675f 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 1 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:21:22.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/1 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/1' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/1/journal' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:22.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:22.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:22.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:22.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:21:22.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:21:22.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/1 2026-02-23T08:21:22.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:21:22.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9f95341a-e986-4f5e-a0f4-878f2e720a47 2026-02-23T08:21:22.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9f95341a-e986-4f5e-a0f4-878f2e720a47' 2026-02-23T08:21:22.435 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 9f95341a-e986-4f5e-a0f4-878f2e720a47 2026-02-23T08:21:22.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:21:22.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQACDpxpPJZAGhAA4/IKFB1oq9RkHsKOBuqV3w== 2026-02-23T08:21:22.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQACDpxpPJZAGhAA4/IKFB1oq9RkHsKOBuqV3w=="}' 2026-02-23T08:21:22.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9f95341a-e986-4f5e-a0f4-878f2e720a47 -i td/osd-scrub-repair/1/new.json 2026-02-23T08:21:22.530 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:21:22.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/1/new.json 2026-02-23T08:21:22.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQACDpxpPJZAGhAA4/IKFB1oq9RkHsKOBuqV3w== --osd-uuid 9f95341a-e986-4f5e-a0f4-878f2e720a47 2026-02-23T08:21:22.552 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:22.551+0000 7f5990b49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:22.554 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:22.553+0000 7f5990b49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:22.555 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:22.554+0000 7f5990b49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:22.555 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:22.554+0000 7f5990b49780 -1 bdev(0x55a890ddb400 td/osd-scrub-repair/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:21:22.555 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:22.554+0000 7f5990b49780 -1 bluestore(td/osd-scrub-repair/1) _read_fsid unparsable uuid 2026-02-23T08:21:22.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/1/keyring 2026-02-23T08:21:22.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:21:22.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:21:22.959 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:21:22.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:21:23.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:21:23.171 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:21:23.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/1 --osd-journal=td/osd-scrub-repair/1/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:23.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:21:23.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:21:23.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:21:23.183 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:23.182+0000 7ff9c1c09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:23.184 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:23.183+0000 7ff9c1c09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:23.185 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:23.184+0000 7ff9c1c09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:23.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:21:23.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:23.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:21:23.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:23.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:23.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:23.336 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:23.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:23.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:23.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:21:23.405 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:23.404+0000 7ff9c1c09780 -1 Falling back to public interface 2026-02-23T08:21:23.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:23.756 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:23.755+0000 7ff9c1c09780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:21:24.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:24.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:24.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:24.500 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:21:24.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:24.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:21:24.664 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3765453005,v1:127.0.0.1:6811/3765453005] [v2:127.0.0.1:6812/3765453005,v1:127.0.0.1:6813/3765453005] exists,up 9f95341a-e986-4f5e-a0f4-878f2e720a47 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 2 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:24.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:21:24.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:24.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6da7504e-c73d-4a45-aadb-c4549cdbc6bb 2026-02-23T08:21:24.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 6da7504e-c73d-4a45-aadb-c4549cdbc6bb' 2026-02-23T08:21:24.673 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 6da7504e-c73d-4a45-aadb-c4549cdbc6bb 2026-02-23T08:21:24.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:21:24.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAEDpxpystiKBAAVt/cBnko4Zrak/5auQKsHA== 2026-02-23T08:21:24.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAEDpxpystiKBAAVt/cBnko4Zrak/5auQKsHA=="}' 2026-02-23T08:21:24.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6da7504e-c73d-4a45-aadb-c4549cdbc6bb -i td/osd-scrub-repair/2/new.json 2026-02-23T08:21:24.837 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:21:24.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/2/new.json 2026-02-23T08:21:24.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAEDpxpystiKBAAVt/cBnko4Zrak/5auQKsHA== --osd-uuid 6da7504e-c73d-4a45-aadb-c4549cdbc6bb 2026-02-23T08:21:24.863 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:24.862+0000 7f5d45569780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:24.864 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:24.863+0000 7f5d45569780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:24.865 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:24.864+0000 7f5d45569780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:24.865 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:24.864+0000 7f5d45569780 -1 bdev(0x55aa43713400 td/osd-scrub-repair/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:21:24.866 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:24.864+0000 7f5d45569780 -1 bluestore(td/osd-scrub-repair/2) _read_fsid unparsable uuid 2026-02-23T08:21:25.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/2/keyring 2026-02-23T08:21:25.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:21:25.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:21:25.283 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:21:25.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:21:25.487 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:21:25.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:21:25.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:25.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:21:25.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:21:25.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:21:25.500 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:25.499+0000 7f62afe7c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:25.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:25.500+0000 7f62afe7c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:25.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:25.501+0000 7f62afe7c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:25.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:25.652 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:25.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:25.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:21:25.691 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:25.691+0000 7f62afe7c780 -1 Falling back to public interface 2026-02-23T08:21:25.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:26.039 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:26.038+0000 7f62afe7c780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:21:26.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:26.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:26.817 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:21:26.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:26.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:26.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:21:26.985 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3793363713,v1:127.0.0.1:6819/3793363713] [v2:127.0.0.1:6820/3793363713,v1:127.0.0.1:6821/3793363713] exists,up 6da7504e-c73d-4a45-aadb-c4549cdbc6bb 2026-02-23T08:21:26.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:918: unfound_erasure_coded: for id in $(seq 0 3) 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:919: unfound_erasure_coded: run_osd td/osd-scrub-repair 3 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:21:26.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:26.989 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:21:26.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:21:26.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:21:26.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=47340d6d-35dd-436c-a352-70f0c3703ac2 2026-02-23T08:21:26.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 47340d6d-35dd-436c-a352-70f0c3703ac2' 2026-02-23T08:21:26.992 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 47340d6d-35dd-436c-a352-70f0c3703ac2 2026-02-23T08:21:26.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:21:26.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGDpxpkeN1OxAAOJJ86HdW/LOX7ZEcaykCfw== 2026-02-23T08:21:26.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGDpxpkeN1OxAAOJJ86HdW/LOX7ZEcaykCfw=="}' 2026-02-23T08:21:26.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 47340d6d-35dd-436c-a352-70f0c3703ac2 -i td/osd-scrub-repair/3/new.json 2026-02-23T08:21:27.158 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T08:21:27.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-repair/3/new.json 2026-02-23T08:21:27.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGDpxpkeN1OxAAOJJ86HdW/LOX7ZEcaykCfw== --osd-uuid 47340d6d-35dd-436c-a352-70f0c3703ac2 2026-02-23T08:21:27.184 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.183+0000 7fef8500a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:27.185 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.184+0000 7fef8500a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:27.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.185+0000 7fef8500a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:27.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.185+0000 7fef8500a780 -1 bdev(0x55d06dedd400 td/osd-scrub-repair/3/block) open stat got: (1) Operation not permitted 2026-02-23T08:21:27.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.185+0000 7fef8500a780 -1 bluestore(td/osd-scrub-repair/3) _read_fsid unparsable uuid 2026-02-23T08:21:27.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-repair/3/keyring 2026-02-23T08:21:27.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:21:27.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-23T08:21:27.586 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T08:21:27.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-repair/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:21:27.792 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T08:21:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-23T08:21:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:21:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:21:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:21:27.804 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.803+0000 7fb32134b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:27.806 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.805+0000 7fb32134b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:27.806 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.806+0000 7fb32134b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:27.954 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:27.952+0000 7fb32134b780 -1 Falling back to public interface 2026-02-23T08:21:27.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-23T08:21:27.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:27.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:21:27.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:27.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:27.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:27.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:27.956 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:27.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:27.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:21:28.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:28.259 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:28.258+0000 7fb32134b780 -1 osd.3 0 log_to_monitors true 2026-02-23T08:21:29.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:29.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:29.119 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:21:29.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:29.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:29.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:21:29.283 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2216417799,v1:127.0.0.1:6827/2216417799] [v2:127.0.0.1:6828/2216417799,v1:127.0.0.1:6829/2216417799] exists,up 47340d6d-35dd-436c-a352-70f0c3703ac2 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:922: unfound_erasure_coded: create_ec_pool ecpool true k=2 m=2 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=ecpool 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-23T08:21:29.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=2 2026-02-23T08:21:29.528 INFO:tasks.workunit.client.0.trial129.stderr:load: isa 2026-02-23T08:21:29.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool ecpool 1 1 erasure myprofile 2026-02-23T08:21:29.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create ecpool 1 1 erasure myprofile 2026-02-23T08:21:29.832 INFO:tasks.workunit.client.0.trial129.stderr:pool 'ecpool' created 2026-02-23T08:21:29.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:21:30.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-23T08:21:30.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set ecpool allow_ec_overwrites true 2026-02-23T08:21:31.052 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 allow_ec_overwrites to true 2026-02-23T08:21:31.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-23T08:21:31.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:31.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:31.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:31.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:31.065 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:31.065 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:21:31.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:31.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:31.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:31.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:31.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:31.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:31.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:31.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:31.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:31.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:31.312 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:21:31.312 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:21:31.312 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:21:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:31.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:31.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:31.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:21:31.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:21:31.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:21:31.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:31.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:31.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705667 2026-02-23T08:21:31.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705667 2026-02-23T08:21:31.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667' 2026-02-23T08:21:31.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:31.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:31.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574850 2026-02-23T08:21:31.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574850 2026-02-23T08:21:31.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-55834574850' 2026-02-23T08:21:31.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:31.531 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:31.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=77309411330 2026-02-23T08:21:31.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 77309411330 2026-02-23T08:21:31.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-38654705667 2-55834574850 3-77309411330' 2026-02-23T08:21:31.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:31.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:21:31.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:31.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:31.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:21:31.609 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:31.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:21:31.610 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:21:31.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:21:31.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:31.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:21:31.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:32.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:32.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:32.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:21:32.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705667 2026-02-23T08:21:32.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:32.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:32.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705667 2026-02-23T08:21:32.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:32.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705667 2026-02-23T08:21:32.943 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705667 2026-02-23T08:21:32.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705667' 2026-02-23T08:21:32.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705667 -lt 38654705667 2026-02-23T08:21:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:33.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574850 2026-02-23T08:21:33.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:33.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:33.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574850 2026-02-23T08:21:33.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:33.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574850 2026-02-23T08:21:33.111 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574850 2026-02-23T08:21:33.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574850' 2026-02-23T08:21:33.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:33.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574850 2026-02-23T08:21:33.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:33.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-77309411330 2026-02-23T08:21:33.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:33.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:33.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-77309411330 2026-02-23T08:21:33.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:33.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=77309411330 2026-02-23T08:21:33.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 77309411330' 2026-02-23T08:21:33.278 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 77309411330 2026-02-23T08:21:33.278 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:33.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 77309411330 -lt 77309411330 2026-02-23T08:21:33.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:33.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:33.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:33.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:33.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:33.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:33.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:33.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:33.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:34.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:924: unfound_erasure_coded: add_something td/osd-scrub-repair ecpool 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:71: add_something: local dir=td/osd-scrub-repair 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:72: add_something: local poolname=ecpool 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:73: add_something: local obj=SOMETHING 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:74: add_something: local scrub=noscrub 2026-02-23T08:21:34.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:76: add_something: '[' noscrub = noscrub ']' 2026-02-23T08:21:34.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:78: add_something: ceph osd set noscrub 2026-02-23T08:21:34.240 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:21:34.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:79: add_something: ceph osd set nodeep-scrub 2026-02-23T08:21:34.444 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:21:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:85: add_something: local payload=ABCDEF 2026-02-23T08:21:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:86: add_something: echo ABCDEF 2026-02-23T08:21:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:87: add_something: rados --pool ecpool put SOMETHING td/osd-scrub-repair/ORIGINAL 2026-02-23T08:21:34.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: get_primary ecpool SOMETHING 2026-02-23T08:21:34.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=ecpool 2026-02-23T08:21:34.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:21:34.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:21:34.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:21:34.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:926: unfound_erasure_coded: local primary=1 2026-02-23T08:21:34.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: get_osds ecpool SOMETHING 2026-02-23T08:21:34.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=ecpool 2026-02-23T08:21:34.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=SOMETHING 2026-02-23T08:21:34.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: sed -e s/1// 2026-02-23T08:21:34.642 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:21:34.642 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-23T08:21:34.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-23T08:21:34.807 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:21:34.807 INFO:tasks.workunit.client.0.trial129.stderr:2 2026-02-23T08:21:34.807 INFO:tasks.workunit.client.0.trial129.stderr:3' 2026-02-23T08:21:34.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 3 2026-02-23T08:21:34.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: osds=('0' '2' '3') 2026-02-23T08:21:34.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:927: unfound_erasure_coded: local -a osds 2026-02-23T08:21:34.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:928: unfound_erasure_coded: local not_primary_first=0 2026-02-23T08:21:34.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:929: unfound_erasure_coded: local not_primary_second=2 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:930: unfound_erasure_coded: local not_primary_third=3 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:935: unfound_erasure_coded: pids= 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:936: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 832033"' 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 832033' 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:937: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 832034"' 2026-02-23T08:21:34.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 832034' 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:938: unfound_erasure_coded: run_in_background pids objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2183: run_in_background: local pid_variable=pids 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2184: run_in_background: shift 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/832036: /' 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: eval 'pids+=" 832037"' 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2188: run_in_background: pids+=' 832037' 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:939: unfound_erasure_coded: wait_background pids 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2219: wait_background: pids=' 832033 832034 832037' 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2221: wait_background: return_code=0 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 832033 2026-02-23T08:21:34.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:34.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/832039: /' 2026-02-23T08:21:34.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: objectstore_tool td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:34.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: sed 's/^/832042: /' 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=3 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=3 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.3 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 3 SOMETHING remove 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=3 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:21:35.307 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/3 SOMETHING remove 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: remove 3#1:eb822e21:::SOMETHING:head# 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 3 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/3 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:35.308 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/3' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/3/journal' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/3 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-23T08:21:35.310 INFO:tasks.workunit.client.0.trial129.stderr:832042: start osd.3 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/3 --osd-journal=td/osd-scrub-repair/3/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 0 SOMETHING remove 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/0 SOMETHING remove 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: remove 1#1:eb822e21:::SOMETHING:head# 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:21:35.317 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:21:35.318 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/0 2026-02-23T08:21:35.318 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:35.318 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:35.319 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/0' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/0/journal' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/0 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:21:35.320 INFO:tasks.workunit.client.0.trial129.stderr:832036: start osd.0 2026-02-23T08:21:35.332 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/0 --osd-journal=td/osd-scrub-repair/0/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_o832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.332 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:21:35.332 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:21:35.332 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-repair TERM osd.2 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:35.333 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-repair 2 SOMETHING remove 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-repair/2 SOMETHING remove 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: remove 2#1:eb822e21:::SOMETHING:head# 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-repair 2 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-repair 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:21:35.334 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-repair/2 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false ' 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-repair/2' 2026-02-23T08:21:35.335 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-repair/2/journal' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-repair' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' 2026-02-23T08:21:35.336 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-repair/$name.log' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-repair/$name.pid' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-repair/2 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:21:35.337 INFO:tasks.workunit.client.0.trial129.stderr:832039: start osd.2 2026-02-23T08:21:36.827 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=d4691fa3-f2a2-4923-a32f-e984c81605f8 --auth-supported=none --mon-host=127.0.0.1:7107 --osd-skip-data-digest=false --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-repair/2 --osd-journal=td/osd-scrub-repair/2/journal --chdir= --run-dir=td/osd-scrub-repair '--admin-socket=/tmp/ceph-asok.424317/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-repair/$name.log' '--pid-file=td/osd-scrub-repair/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/3/whoami 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: 2026-02-23T08:21:35.322+0000 7f728af4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.828 INFO:tasks.workunit.client.0.trial129.stderr:832042: 2026-02-23T08:21:35.323+0000 7f728af4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: 2026-02-23T08:21:35.324+0000 7f728af4d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: 0 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:21:36.829 INFO:tasks.workunit.client.0.trial129.stderr:832042: 2026-02-23T08:21:35.570+0000 7f728af4d780 -1 Falling back to public interface 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: 2026-02-23T08:21:36.011+0000 7f728af4d780 -1 osd.3 27 log_to_monitors true 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: 1 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: osd.3 up in weight 1 up_from 31 up_thru 0 down_at 28 last_clean_interval [18,27) [v2:127.0.0.1:6818/1297332431,v1:127.0.0.1:6819/1297332431] [v2:127.0.0.1:6820/1297332431,v1:127.0.0.1:6821/1297332431] exists,up 47340d6d-35dd-436c-a352-70f0c3703ac2 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:36.830 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:36.831 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:21:36.831 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:36.831 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:36.831 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:36.831 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:36.831 INFO:tasks.workunit.client.0.trial129.stderr:832042: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:36.839 INFO:tasks.workunit.client.0.trial129.stderr:832042: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593ps 2026-02-23T08:21:36.839 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/0/whoami 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: 2026-02-23T08:21:35.332+0000 7f4f8a54d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: 2026-02-23T08:21:35.333+0000 7f4f8a54d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: 2026-02-23T08:21:35.334+0000 7f4f8a54d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:36.840 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: 0 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: 2026-02-23T08:21:35.560+0000 7f4f8a54d780 -1 Falling back to public interface 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:36.841 INFO:tasks.workunit.client.0.trial129.stderr:832036: 2026-02-23T08:21:36.011+0000 7f4f8a54d780 -1 osd.0 27 log_to_monitors true 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: 1 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: osd.0 up in weight 1 up_from 31 up_thru 0 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/993559351,v1:127.0.0.1:6801/993559351] [v2:127.0.0.1:6802/993559351,v1:127.0.0.1:6803/993559351] exists,up 8898f828-e811-4802-8a03-02ce75be675f 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:36.842 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:36.843 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:21:36.843 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:36.843 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:36.843 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:36.843 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:36.843 INFO:tasks.workunit.client.0.trial129.stderr:832036: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832036: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: getps 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-repair/2/whoami 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: 2026-02-23T08:21:35.348+0000 7f9f31b55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: 2026-02-23T08:21:35.349+0000 7f9f31b55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.848 INFO:tasks.workunit.client.0.trial129.stderr:832039: 2026-02-23T08:21:35.350+0000 7f9f31b55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: 0 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:36.849 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: 2026-02-23T08:21:35.596+0000 7f9f31b55780 -1 Falling back to public interface 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: 2026-02-23T08:21:36.047+0000 7f9f31b55780 -1 osd.2 27 log_to_monitors true 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: 1 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: osd.2 up in weight 1 up_from 31 up_thru 0 down_at 28 last_clean_interval [13,27) [v2:127.0.0.1:6826/867093082,v1:127.0.0.1:6827/867093082] [v2:127.0.0.1:6828/867093082,v1:127.0.0.1:6829/867093082] exists,up 6da7504e-c73d-4a45-aadb-c4549cdbc6bb 2026-02-23T08:21:36.850 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:36.851 INFO:tasks.workunit.client.0.trial129.stderr:832039: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832039: ///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: ge_timeout_delays: echo true 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: 1 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: 2 2026-02-23T08:21:37.393 INFO:tasks.workunit.client.0.trial129.stderr:832036: 3' 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179' 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179 1-38654705670' 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179 1-38654705670 2-133143986179' 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.394 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986179 1-38654705670 2-133143986179 3-133143986179' 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flus: get_timeout_delays: echo true 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: 1 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: 2 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: 3' 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:37.395 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178' 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178 1-38654705669' 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178 1-38654705669 2-133143986178' 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986178 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986178 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986178 1-38654705669 2-133143986178 3-133143986178' 2026-02-23T08:21:37.396 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266:t_timeout_delays: echo true 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:37.410 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: 1 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: 2 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: 3' 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180' 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180 1-38654705671' 2026-02-23T08:21:37.411 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180 1-38654705671 2-133143986180' 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-133143986180 1-38654705671 2-133143986180 3-133143986180' 2026-02-23T08:21:37.412 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.083 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flu flush_pg_stats: echo 0-133143986178 2026-02-23T08:21:39.083 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.083 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986178 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 133143986178' 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: waiting osd.0 seq 133143986178 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986178 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986178 2026-02-23T08:21:39.084 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: waiting osd.1 seq 38654705669 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705669 2026-02-23T08:21:39.085 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-133143986178 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-133143986178 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 133143986178' 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: waiting osd.2 seq 133143986178 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986178 2026-02-23T08:21:39.086 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/ch_pg_stats: echo 0-133143986179 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986179 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-23T08:21:39.087 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 133143986179' 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: waiting osd.0 seq 133143986179 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986179 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986179 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-23T08:21:39.088 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: waiting osd.1 seq 38654705670 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-133143986179 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.089 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-133143986179 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 133143986179' 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: waiting osd.2 seq 133143986179 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986179 2026-02-23T08:21:39.090 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.sh_pg_stats: echo 0-133143986180 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986180 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986180 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 133143986180' 2026-02-23T08:21:39.102 INFO:tasks.workunit.client.0.trial129.stderr:832039: waiting osd.0 seq 133143986180 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 133143986180 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986180 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705671 2026-02-23T08:21:39.103 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705671 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: waiting osd.1 seq 38654705671 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-133143986180 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:21:39.104 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-133143986180 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986180 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 133143986180' 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: waiting osd.2 seq 133143986180 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986180 2026-02-23T08:21:39.105 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:39.844 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/cloneclient.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-133143986179 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-133143986179 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 133143986179' 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: waiting osd.3 seq 133143986179 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986179 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:39.845 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:39.846 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:832036: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:832036: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:21:39.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 832034 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:lone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-133143986178 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-133143986178 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986178 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 133143986178' 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: waiting osd.3 seq 133143986178 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:39.848 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986178 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:39.849 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:39.850 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:39.850 INFO:tasks.workunit.client.0.trial129.stderr:832042: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:39.850 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:39.850 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:39.850 INFO:tasks.workunit.client.0.trial129.stderr:832042: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:39.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-133143986180 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-133143986180 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986180 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 133143986180' 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: waiting osd.3 seq 133143986180 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-23T08:21:39.863 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986180 -lt 133143986180 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:39.864 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:832039: //home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:832039: /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2187: run_in_background: return 0 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2222: wait_background: for pid in $pids 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2223: wait_background: wait 832037 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: eval 'pids='\'''\''' 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2230: wait_background: pids= 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2232: wait_background: return 0 2026-02-23T08:21:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:940: unfound_erasure_coded: return_code=0 2026-02-23T08:21:39.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:941: unfound_erasure_coded: '[' 0 -ne 0 ']' 2026-02-23T08:21:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: get_pg ecpool SOMETHING 2026-02-23T08:21:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=ecpool 2026-02-23T08:21:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:21:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map ecpool SOMETHING 2026-02-23T08:21:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:21:40.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:946: unfound_erasure_coded: local pg=1.0 2026-02-23T08:21:40.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:947: unfound_erasure_coded: repair 1.0 2026-02-23T08:21:40.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-23T08:21:40.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-23T08:21:40.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:40.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:40.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:40.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:40.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:40.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-23T08:21:40.346 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0s0 on osd.1 to repair 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:40.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:40.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:40.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:40.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:40.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:29.830090+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:40.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:41.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:41.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:41.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:41.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:41.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:41.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:41.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:41.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:29.830090+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:41.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:42.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:42.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:42.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:42.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:42.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:42.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:42.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:42.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:29.830090+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:42.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:43.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:43.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:43.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:43.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:43.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:43.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:43.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:44.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:29.830090+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:44.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:45.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:45.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:45.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:45.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:45.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:45.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:45.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:45.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:29.830090+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:45.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:46.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:46.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:46.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:46.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:46.205 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:29.830090+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:46.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:21:47.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:21:47.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:21:47.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:21:47.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:21:47.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:21:47.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:21:47.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:21:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:41.001596+0000 '>' 2026-02-23T08:21:29.830090+0000 2026-02-23T08:21:47.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:21:47.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: seq 1 60 2026-02-23T08:21:47.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:952: unfound_erasure_coded: for f in `seq 1 60` 2026-02-23T08:21:47.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: ceph -s 2026-02-23T08:21:47.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-23T08:21:47.746 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:47.746 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:47.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:953: unfound_erasure_coded: break 2026-02-23T08:21:47.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: ceph -s 2026-02-23T08:21:47.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:956: unfound_erasure_coded: grep '4 up' 2026-02-23T08:21:47.949 INFO:tasks.workunit.client.0.trial129.stdout: osd: 4 osds: 4 up (since 11s), 4 in (since 20s) 2026-02-23T08:21:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: ceph -s 2026-02-23T08:21:47.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:957: unfound_erasure_coded: grep '4 in' 2026-02-23T08:21:48.154 INFO:tasks.workunit.client.0.trial129.stdout: osd: 4 osds: 4 up (since 11s), 4 in (since 20s) 2026-02-23T08:21:48.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: ceph -s 2026-02-23T08:21:48.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:958: unfound_erasure_coded: grep '1/1 objects unfound' 2026-02-23T08:21:48.358 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:48.358 INFO:tasks.workunit.client.0.trial129.stdout: 1/1 objects unfound (100.000%) 2026-02-23T08:21:48.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:66: run: teardown td/osd-scrub-repair 2026-02-23T08:21:48.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:21:48.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:21:48.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:21:48.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:48.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:48.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:48.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:48.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:48.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:48.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:21:48.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:21:48.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:21:48.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:21:48.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:21:48.470 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:21:48.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:48.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:21:48.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:21:48.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:48.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:21:48.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:21:48.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:21:48.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:21:48.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:48.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:21:48.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:21:48.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-scrub-repair 0 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-repair 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-repair KILL 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:48.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:48.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:48.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:21:48.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:21:48.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:21:48.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:21:48.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:21:48.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:21:48.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:48.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:21:48.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:21:48.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:48.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:21:48.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-23T08:21:48.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-repair 2026-02-23T08:21:48.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:21:48.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.424317 2026-02-23T08:21:48.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.424317 2026-02-23T08:21:48.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:21:48.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:21:48.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-23T08:21:48.497 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T08:21:48.497 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T08:21:48.567 INFO:tasks.workunit:Running workunit scrub/osd-scrub-snaps.sh... 2026-02-23T08:21:48.567 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-scrub-snaps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh 2026-02-23T08:21:48.631 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T08:21:48.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-snaps 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:27: run: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:28: run: shift 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:30: run: export CEPH_MON=127.0.0.1:7121 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:30: run: CEPH_MON=127.0.0.1:7121 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:31: run: export CEPH_ARGS 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:32: run: uuidgen 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:32: run: CEPH_ARGS+='--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none ' 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:33: run: CEPH_ARGS+='--mon-host=127.0.0.1:7121 ' 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:35: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T08:21:48.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:36: run: set 2026-02-23T08:21:48.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:36: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T08:21:48.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:36: run: local 'funcs=TEST_scrub_snaps 2026-02-23T08:21:48.638 INFO:tasks.workunit.client.0.trial129.stderr:TEST_scrub_snaps_primary 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:TEST_scrub_snaps_replica' 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:37: run: for func in $funcs 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:38: run: setup td/osd-scrub-snaps 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-snaps 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:48.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:48.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:48.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:21:48.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:21:48.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:21:48.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:21:48.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:21:48.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:21:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:21:48.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:21:48.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:21:48.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:21:48.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:21:48.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:21:48.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:21:48.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:21:48.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:21:48.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:21:48.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-snaps 2026-02-23T08:21:48.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:21:48.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.836428 2026-02-23T08:21:48.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-snaps 1' TERM HUP INT 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:39: run: TEST_scrub_snaps td/osd-scrub-snaps 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:169: TEST_scrub_snaps: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:170: TEST_scrub_snaps: local poolname=test 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:171: TEST_scrub_snaps: local OBJS=16 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:172: TEST_scrub_snaps: local OSDS=1 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:174: TEST_scrub_snaps: TESTDATA=testdata.836428 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:176: TEST_scrub_snaps: run_mon td/osd-scrub-snaps a --osd_pool_default_size=1 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-snaps/a 2026-02-23T08:21:48.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-snaps/a --run-dir=td/osd-scrub-snaps --osd_pool_default_size=1 2026-02-23T08:21:48.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:21:48.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-snaps/a '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-snaps/log --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=1 2026-02-23T08:21:48.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:21:48.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:21:48.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:21:48.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:21:48.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:21:48.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.836428/ceph-mon.a.asok 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:21:48.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.836428/ceph-mon.a.asok config get fsid 2026-02-23T08:21:48.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:21:48.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:21:48.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:21:48.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:21:48.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:21:48.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:21:48.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:21:48.752 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:21:48.752 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:21:48.752 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.752 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.753 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.836428/ceph-mon.a.asok 2026-02-23T08:21:48.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:21:48.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.836428/ceph-mon.a.asok config get mon_host 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:177: TEST_scrub_snaps: run_mgr td/osd-scrub-snaps x 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-snaps/x 2026-02-23T08:21:48.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:21:48.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:21:48.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:21:48.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-snaps/x '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:21:48.919 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:178: TEST_scrub_snaps: expr 1 - 1 2026-02-23T08:21:48.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:178: TEST_scrub_snaps: seq 0 0 2026-02-23T08:21:48.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:178: TEST_scrub_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:21:48.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:180: TEST_scrub_snaps: run_osd td/osd-scrub-snaps 0 2026-02-23T08:21:48.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:21:48.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:21:48.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:21:48.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5eb83a20-ef02-4f23-986c-85b8935b705c 2026-02-23T08:21:48.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5eb83a20-ef02-4f23-986c-85b8935b705c' 2026-02-23T08:21:48.928 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 5eb83a20-ef02-4f23-986c-85b8935b705c 2026-02-23T08:21:48.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:21:48.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAcDpxp2h6DNxAAayolQhvVLYy3QIOpQE6ySQ== 2026-02-23T08:21:48.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAcDpxp2h6DNxAAayolQhvVLYy3QIOpQE6ySQ=="}' 2026-02-23T08:21:48.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5eb83a20-ef02-4f23-986c-85b8935b705c -i td/osd-scrub-snaps/0/new.json 2026-02-23T08:21:49.019 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:49.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/0/new.json 2026-02-23T08:21:49.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAcDpxp2h6DNxAAayolQhvVLYy3QIOpQE6ySQ== --osd-uuid 5eb83a20-ef02-4f23-986c-85b8935b705c 2026-02-23T08:21:49.043 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.042+0000 7f3ec6f49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:49.044 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.043+0000 7f3ec6f49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:49.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.044+0000 7f3ec6f49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:49.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.045+0000 7f3ec6f49780 -1 bdev(0x55d2183e7400 td/osd-scrub-snaps/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:21:49.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.045+0000 7f3ec6f49780 -1 bluestore(td/osd-scrub-snaps/0) _read_fsid unparsable uuid 2026-02-23T08:21:49.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/0/keyring 2026-02-23T08:21:49.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:21:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:21:49.399 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:21:49.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:21:49.493 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:21:49.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:21:49.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:21:49.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:21:49.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:21:49.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:21:49.505 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.504+0000 7f20c2d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:49.506 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.506+0000 7f20c2d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:49.507 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.507+0000 7f20c2d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:49.587 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:21:49.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:21:49.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:49.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:49.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:21:49.712 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:49.711+0000 7f20c2d4b780 -1 Falling back to public interface 2026-02-23T08:21:50.095 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:21:50.094+0000 7f20c2d4b780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:21:50.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:21:50.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:21:50.679 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:21:50.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:21:50.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:21:50.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:21:50.770 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2596546568,v1:127.0.0.1:6801/2596546568] [v2:127.0.0.1:6802/2596546568,v1:127.0.0.1:6803/2596546568] exists,up 5eb83a20-ef02-4f23-986c-85b8935b705c 2026-02-23T08:21:50.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:21:50.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:21:50.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:21:50.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:184: TEST_scrub_snaps: ceph osd set noscrub 2026-02-23T08:21:50.893 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:21:50.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:185: TEST_scrub_snaps: ceph osd set nodeep-scrub 2026-02-23T08:21:51.010 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:21:51.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:188: TEST_scrub_snaps: create_pool test 1 1 2026-02-23T08:21:51.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:21:51.196 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:21:51.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:21:52.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:189: TEST_scrub_snaps: wait_for_clean 2026-02-23T08:21:52.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:21:52.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:21:52.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:21:52.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:21:52.210 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:21:52.210 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:21:52.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:21:52.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:21:52.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:21:52.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:21:52.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:21:52.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:21:52.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:21:52.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:21:52.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:21:52.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:21:52.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:21:52.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:21:52.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:21:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:21:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:21:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:21:52.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:21:52.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:21:52.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:21:52.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:21:52.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:21:52.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:21:52.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:21:52.531 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:21:52.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:21:52.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:52.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:21:52.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:21:53.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:21:53.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:21:53.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836482 2026-02-23T08:21:53.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:21:53.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:53.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:54.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:21:54.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:21:54.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:21:54.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:21:54.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:21:54.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:21:54.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:21:54.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:21:54.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:21:54.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:21:54.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:21:54.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:21:54.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:21:54.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:21:54.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:21:54.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: ceph osd dump 2026-02-23T08:21:54.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: grep '^pool.*['\'']test['\'']' 2026-02-23T08:21:54.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: awk '{ print $2 }' 2026-02-23T08:21:54.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:190: TEST_scrub_snaps: poolid=1 2026-02-23T08:21:54.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:192: TEST_scrub_snaps: dd if=/dev/urandom of=testdata.836428 bs=1032 count=1 2026-02-23T08:21:54.592 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:21:54.592 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:21:54.593 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 1.9857e-05 s, 52.0 MB/s 2026-02-23T08:21:54.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: seq 1 16 2026-02-23T08:21:54.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj1 testdata.836428 2026-02-23T08:21:54.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj2 testdata.836428 2026-02-23T08:21:54.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj3 testdata.836428 2026-02-23T08:21:54.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj4 testdata.836428 2026-02-23T08:21:54.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj5 testdata.836428 2026-02-23T08:21:54.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj6 testdata.836428 2026-02-23T08:21:54.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj7 testdata.836428 2026-02-23T08:21:54.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj8 testdata.836428 2026-02-23T08:21:54.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj9 testdata.836428 2026-02-23T08:21:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj10 testdata.836428 2026-02-23T08:21:54.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj11 testdata.836428 2026-02-23T08:21:54.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj12 testdata.836428 2026-02-23T08:21:54.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj13 testdata.836428 2026-02-23T08:21:54.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj14 testdata.836428 2026-02-23T08:21:54.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj15 testdata.836428 2026-02-23T08:21:54.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:193: TEST_scrub_snaps: for i in `seq 1 $OBJS` 2026-02-23T08:21:54.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:195: TEST_scrub_snaps: rados -p test put obj16 testdata.836428 2026-02-23T08:21:54.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:198: TEST_scrub_snaps: get_primary test obj1 2026-02-23T08:21:54.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:21:54.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:21:54.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:21:54.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:21:54.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:198: TEST_scrub_snaps: local primary=0 2026-02-23T08:21:54.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:200: TEST_scrub_snaps: create_scenario td/osd-scrub-snaps test testdata.836428 0 2026-02-23T08:21:54.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:45: create_scenario: local dir=td/osd-scrub-snaps 2026-02-23T08:21:54.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:46: create_scenario: local poolname=test 2026-02-23T08:21:54.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:47: create_scenario: local TESTDATA=testdata.836428 2026-02-23T08:21:54.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:48: create_scenario: local osd=0 2026-02-23T08:21:54.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:50: create_scenario: SNAP=1 2026-02-23T08:21:54.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:51: create_scenario: rados -p test mksnap snap1 2026-02-23T08:21:55.073 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap1 2026-02-23T08:21:55.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:52: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=1 2026-02-23T08:21:55.078 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:21:55.078 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:21:55.078 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 4.2409e-05 s, 6.0 MB/s 2026-02-23T08:21:55.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:53: create_scenario: rados -p test put obj1 testdata.836428 2026-02-23T08:21:55.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:54: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:21:55.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:55: create_scenario: rados -p test put obj3 testdata.836428 2026-02-23T08:21:55.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: seq 6 14 2026-02-23T08:21:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj6 testdata.836428 2026-02-23T08:21:55.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj7 testdata.836428 2026-02-23T08:21:55.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj8 testdata.836428 2026-02-23T08:21:55.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj9 testdata.836428 2026-02-23T08:21:55.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj10 testdata.836428 2026-02-23T08:21:55.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj11 testdata.836428 2026-02-23T08:21:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj12 testdata.836428 2026-02-23T08:21:55.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj13 testdata.836428 2026-02-23T08:21:55.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:21:55.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj14 testdata.836428 2026-02-23T08:21:55.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:60: create_scenario: SNAP=2 2026-02-23T08:21:55.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:61: create_scenario: rados -p test mksnap snap2 2026-02-23T08:21:55.275 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap2 2026-02-23T08:21:55.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:62: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=2 2026-02-23T08:21:55.277 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records in 2026-02-23T08:21:55.277 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records out 2026-02-23T08:21:55.277 INFO:tasks.workunit.client.0.trial129.stderr:512 bytes copied, 3.4064e-05 s, 15.0 MB/s 2026-02-23T08:21:55.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:63: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:21:55.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:65: create_scenario: SNAP=3 2026-02-23T08:21:55.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:66: create_scenario: rados -p test mksnap snap3 2026-02-23T08:21:55.377 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap3 2026-02-23T08:21:55.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:67: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=3 2026-02-23T08:21:55.380 INFO:tasks.workunit.client.0.trial129.stderr:3+0 records in 2026-02-23T08:21:55.380 INFO:tasks.workunit.client.0.trial129.stderr:3+0 records out 2026-02-23T08:21:55.380 INFO:tasks.workunit.client.0.trial129.stderr:768 bytes copied, 3.5286e-05 s, 21.8 MB/s 2026-02-23T08:21:55.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:68: create_scenario: rados -p test put obj3 testdata.836428 2026-02-23T08:21:55.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:70: create_scenario: SNAP=4 2026-02-23T08:21:55.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:71: create_scenario: rados -p test mksnap snap4 2026-02-23T08:21:55.478 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap4 2026-02-23T08:21:55.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:72: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=4 2026-02-23T08:21:55.481 INFO:tasks.workunit.client.0.trial129.stderr:4+0 records in 2026-02-23T08:21:55.481 INFO:tasks.workunit.client.0.trial129.stderr:4+0 records out 2026-02-23T08:21:55.481 INFO:tasks.workunit.client.0.trial129.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.8532e-05 s, 26.6 MB/s 2026-02-23T08:21:55.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:73: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:21:55.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:74: create_scenario: rados -p test put obj2 testdata.836428 2026-02-23T08:21:55.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:76: create_scenario: SNAP=5 2026-02-23T08:21:55.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:77: create_scenario: rados -p test mksnap snap5 2026-02-23T08:21:55.580 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap5 2026-02-23T08:21:55.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:78: create_scenario: SNAP=6 2026-02-23T08:21:55.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:79: create_scenario: rados -p test mksnap snap6 2026-02-23T08:21:55.682 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap6 2026-02-23T08:21:55.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:80: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=6 2026-02-23T08:21:55.685 INFO:tasks.workunit.client.0.trial129.stderr:6+0 records in 2026-02-23T08:21:55.685 INFO:tasks.workunit.client.0.trial129.stderr:6+0 records out 2026-02-23T08:21:55.685 INFO:tasks.workunit.client.0.trial129.stderr:1536 bytes (1.5 kB, 1.5 KiB) copied, 3.8652e-05 s, 39.7 MB/s 2026-02-23T08:21:55.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:81: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:21:55.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:83: create_scenario: SNAP=7 2026-02-23T08:21:55.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:84: create_scenario: rados -p test mksnap snap7 2026-02-23T08:21:55.785 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap7 2026-02-23T08:21:55.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:86: create_scenario: rados -p test rm obj4 2026-02-23T08:21:55.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:87: create_scenario: rados -p test rm obj16 2026-02-23T08:21:55.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:88: create_scenario: rados -p test rm obj2 2026-02-23T08:21:55.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:90: create_scenario: kill_daemons td/osd-scrub-snaps TERM osd 2026-02-23T08:21:55.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:21:55.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:21:55.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:21:55.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:21:55.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:21:56.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:21:56.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj1 2026-02-23T08:21:56.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: JSON='["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:56.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:95: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' --force remove 2026-02-23T08:21:56.362 INFO:tasks.workunit.client.0.trial129.stdout:WARNING: only removing head with clones present 2026-02-23T08:21:56.362 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-23T08:21:56.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-23T08:21:56.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: grep '"snapid":2' 2026-02-23T08:21:56.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:56.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:98: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:21:56.627 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:2# 2026-02-23T08:21:56.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-23T08:21:56.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: grep '"snapid":1' 2026-02-23T08:21:56.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:56.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:101: create_scenario: OBJ5SAVE='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:56.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:103: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:21:56.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:104: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:21:56.939 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:56.940 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.941 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:56.942 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:56.942 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:56.942 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:56.942 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:56.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:105: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:21:56.943 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:21:56.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:106: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype nosnapmap '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:21:57.052 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:1# 2026-02-23T08:21:57.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:108: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:21:57.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:109: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:21:57.246 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:57.247 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:110: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:21:57.248 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:21:57.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:111: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-23T08:21:57.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-23T08:21:57.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: grep '"snapid":4' 2026-02-23T08:21:57.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:57.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:114: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=18 2026-02-23T08:21:57.362 INFO:tasks.workunit.client.0.trial129.stderr:18+0 records in 2026-02-23T08:21:57.362 INFO:tasks.workunit.client.0.trial129.stderr:18+0 records out 2026-02-23T08:21:57.362 INFO:tasks.workunit.client.0.trial129.stderr:4608 bytes (4.6 kB, 4.5 KiB) copied, 6.6244e-05 s, 69.6 MB/s 2026-02-23T08:21:57.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:115: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:21:57.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj3 2026-02-23T08:21:57.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: JSON='["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:57.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:118: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=15 2026-02-23T08:21:57.616 INFO:tasks.workunit.client.0.trial129.stderr:15+0 records in 2026-02-23T08:21:57.616 INFO:tasks.workunit.client.0.trial129.stderr:15+0 records out 2026-02-23T08:21:57.616 INFO:tasks.workunit.client.0.trial129.stderr:3840 bytes (3.8 kB, 3.8 KiB) copied, 6.5172e-05 s, 58.9 MB/s 2026-02-23T08:21:57.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:119: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:21:57.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj4 2026-02-23T08:21:57.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: grep '"snapid":7' 2026-02-23T08:21:57.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: JSON='["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:57.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:122: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:21:57.973 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:0ee9ae15:::obj4:7# 2026-02-23T08:21:58.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:125: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:21:58.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:126: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:21:58.145 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:21:58.145 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.145 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:58.146 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:58.147 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.148 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:58.148 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:58.148 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.148 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:58.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:127: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.149 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:21:58.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj16 2026-02-23T08:21:58.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: grep '"snapid":7' 2026-02-23T08:21:58.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: JSON='["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:58.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:129: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype snapmap '["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:21:58.351 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:461f8b5e:::obj16:7# 2026-02-23T08:21:58.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:131: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:21:58.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:132: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:21:58.517 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:21:58.517 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:21:58.517 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:21:58.517 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:21:58.518 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:58.519 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:21:58.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:133: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:21:58.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:134: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-23T08:21:58.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj2 2026-02-23T08:21:58.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: JSON='["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:58.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:137: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' rm-attr snapset 2026-02-23T08:21:58.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: echo '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:58.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: sed 's/snapid":1/snapid":7/' 2026-02-23T08:21:58.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:58.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:141: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=7 2026-02-23T08:21:58.792 INFO:tasks.workunit.client.0.trial129.stderr:7+0 records in 2026-02-23T08:21:58.792 INFO:tasks.workunit.client.0.trial129.stderr:7+0 records out 2026-02-23T08:21:58.792 INFO:tasks.workunit.client.0.trial129.stderr:1792 bytes (1.8 kB, 1.8 KiB) copied, 4.1508e-05 s, 43.2 MB/s 2026-02-23T08:21:58.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:142: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:21:58.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj6 2026-02-23T08:21:59.003 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:21:59.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: JSON='["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:59.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:145: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-23T08:21:59.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj7 2026-02-23T08:21:59.258 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:21:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: JSON='["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:59.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:147: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset corrupt 2026-02-23T08:21:59.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj8 2026-02-23T08:21:59.503 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:21:59.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: JSON='["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:59.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:149: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset seq 2026-02-23T08:21:59.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj9 2026-02-23T08:21:59.745 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:21:59.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: JSON='["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:21:59.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:151: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_size 2026-02-23T08:21:59.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj10 2026-02-23T08:21:59.986 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:00.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: JSON='["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:00.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:153: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_overlap 2026-02-23T08:22:00.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj11 2026-02-23T08:22:00.234 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:00.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: JSON='["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:00.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:155: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-23T08:22:00.445 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj13 2026-02-23T08:22:00.496 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:00.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: JSON='["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:00.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:157: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset snaps 2026-02-23T08:22:00.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj14 2026-02-23T08:22:00.759 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:00.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: JSON='["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:159: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset size 2026-02-23T08:22:00.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:161: create_scenario: echo garbage 2026-02-23T08:22:00.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj15 2026-02-23T08:22:01.014 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:01.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: JSON='["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:01.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:163: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' set-attr snapset td/osd-scrub-snaps/bad 2026-02-23T08:22:01.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:164: create_scenario: rm -f td/osd-scrub-snaps/bad 2026-02-23T08:22:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:165: create_scenario: return 0 2026-02-23T08:22:01.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:202: TEST_scrub_snaps: rm -f testdata.836428 2026-02-23T08:22:01.198 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:204: TEST_scrub_snaps: expr 1 - 1 2026-02-23T08:22:01.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:204: TEST_scrub_snaps: seq 0 0 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:204: TEST_scrub_snaps: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:206: TEST_scrub_snaps: activate_osd td/osd-scrub-snaps 0 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:01.201 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-23T08:22:01.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:22:01.203 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:22:01.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:22:01.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/0/whoami 2026-02-23T08:22:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:22:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:22:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:22:01.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:22:01.214 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:01.213+0000 7fb7a4148780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:01.215 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:01.215+0000 7fb7a4148780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:01.216 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:01.215+0000 7fb7a4148780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:22:01.372 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:22:01.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:01.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:22:01.406 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:01.406+0000 7fb7a4148780 -1 Falling back to public interface 2026-02-23T08:22:01.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:22:01.786 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:01.785+0000 7fb7a4148780 -1 osd.0 17 log_to_monitors true 2026-02-23T08:22:02.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:22:02.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:02.539 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:22:02.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:22:02.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:02.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:22:02.702 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 20 up_thru 20 down_at 18 last_clean_interval [5,17) [v2:127.0.0.1:6800/1650377243,v1:127.0.0.1:6801/1650377243] [v2:127.0.0.1:6802/1650377243,v1:127.0.0.1:6803/1650377243] exists,up 5eb83a20-ef02-4f23-986c-85b8935b705c 2026-02-23T08:22:02.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:22:02.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:22:02.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:22:02.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:208: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 25 2026-02-23T08:22:02.767 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:02.767 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T08:22:02.768 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:02.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:209: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_min 5 2026-02-23T08:22:02.838 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:02.838 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-23T08:22:02.838 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:02.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:210: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_seconds 1 2026-02-23T08:22:02.908 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:02.909 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-23T08:22:02.909 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:02.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:211: TEST_scrub_snaps: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_epochs 1 2026-02-23T08:22:02.980 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:02.980 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-23T08:22:02.980 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:02.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:214: TEST_scrub_snaps: wait_for_clean 2026-02-23T08:22:02.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:22:02.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:22:02.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:22:02.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:22:02.990 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:22:02.991 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:22:02.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:22:02.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:22:02.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:22:03.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:22:03.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:22:03.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:22:03.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:22:03.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:22:03.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:22:03.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:22:03.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:22:03.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:03.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:22:03.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345922 2026-02-23T08:22:03.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345922 2026-02-23T08:22:03.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-85899345922' 2026-02-23T08:22:03.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:03.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-85899345922 2026-02-23T08:22:03.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:03.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:22:03.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-85899345922 2026-02-23T08:22:03.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:03.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345922 2026-02-23T08:22:03.304 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 85899345922 2026-02-23T08:22:03.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 85899345922' 2026-02-23T08:22:03.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:03.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 85899345922 2026-02-23T08:22:03.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:04.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:22:04.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:04.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 85899345922 2026-02-23T08:22:04.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:05.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:22:05.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:05.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345922 -lt 85899345922 2026-02-23T08:22:05.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:22:05.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:22:05.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:22:06.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:22:06.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:22:06.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:22:06.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:22:06.172 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:22:06.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:22:06.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:22:06.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:22:06.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:216: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_shallow_scrub_chunk_max 2026-02-23T08:22:06.439 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:06.439 INFO:tasks.workunit.client.0.trial129.stdout: "osd_shallow_scrub_chunk_max": "25" 2026-02-23T08:22:06.440 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:06.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:217: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_shallow_scrub_chunk_min 2026-02-23T08:22:06.510 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:06.510 INFO:tasks.workunit.client.0.trial129.stdout: "osd_shallow_scrub_chunk_min": "5" 2026-02-23T08:22:06.511 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:06.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:218: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_pg_stat_report_interval_max_seconds 2026-02-23T08:22:06.581 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:06.582 INFO:tasks.workunit.client.0.trial129.stdout: "osd_pg_stat_report_interval_max_seconds": "1" 2026-02-23T08:22:06.582 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:06.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:219: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_pg_stat_report_interval_max_epochs 2026-02-23T08:22:06.652 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:06.652 INFO:tasks.workunit.client.0.trial129.stdout: "osd_pg_stat_report_interval_max_epochs": "1" 2026-02-23T08:22:06.653 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:06.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:220: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_scrub_chunk_max 2026-02-23T08:22:06.723 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:06.723 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_chunk_max": "15" 2026-02-23T08:22:06.723 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:06.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:221: TEST_scrub_snaps: ceph tell 'osd.*' config get osd_scrub_chunk_min 2026-02-23T08:22:06.793 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:06.793 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_chunk_min": "5" 2026-02-23T08:22:06.793 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:06.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:223: TEST_scrub_snaps: local pgid=1.0 2026-02-23T08:22:06.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:224: TEST_scrub_snaps: pg_scrub 1.0 2026-02-23T08:22:06.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-23T08:22:06.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-23T08:22:06.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-23T08:22:06.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:22:06.802 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:22:06.802 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:22:06.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:22:06.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:22:06.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:22:06.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:22:06.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:22:06.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:22:06.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:22:06.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:22:06.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:22:07.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-23T08:22:07.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:22:07.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:07.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:22:07.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=85899345924 2026-02-23T08:22:07.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 85899345924 2026-02-23T08:22:07.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-85899345924' 2026-02-23T08:22:07.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:07.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-85899345924 2026-02-23T08:22:07.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:07.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:22:07.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-85899345924 2026-02-23T08:22:07.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:07.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=85899345924 2026-02-23T08:22:07.224 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 85899345924 2026-02-23T08:22:07.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 85899345924' 2026-02-23T08:22:07.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:07.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345923 -lt 85899345924 2026-02-23T08:22:07.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:08.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:22:08.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:08.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345923 -lt 85899345924 2026-02-23T08:22:08.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:09.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:22:09.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 85899345924 -lt 85899345924 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 1.0 loop 0 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-23T08:22:09.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:22:09.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:09.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:09.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:09.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-23T08:22:10.110 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.0 to scrub 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:10.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:10.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:10.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:51.195514+0000 '>' 2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:10.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:11.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:11.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:11.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:11.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:11.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:11.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:11.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:11.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:51.195514+0000 '>' 2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:11.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:12.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:12.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:12.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:12.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:12.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:21:51.195514+0000 '>' 2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:12.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:13.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:13.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:13.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:13.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:13.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:13.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:13.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:13.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:22:10.732191+0000 '>' 2026-02-23T08:21:51.195514+0000 2026-02-23T08:22:13.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:22:13.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:228: TEST_scrub_snaps: grep '_scan_snaps start' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:13.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:228: TEST_scrub_snaps: wc -l 2026-02-23T08:22:13.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:228: TEST_scrub_snaps: test 2 = 2 2026-02-23T08:22:13.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:230: TEST_scrub_snaps: rados list-inconsistent-pg test 2026-02-23T08:22:13.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:232: TEST_scrub_snaps: jq '. | length' td/osd-scrub-snaps/json 2026-02-23T08:22:13.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:232: TEST_scrub_snaps: test 1 = 1 2026-02-23T08:22:13.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:234: TEST_scrub_snaps: jq -r '.[0]' td/osd-scrub-snaps/json 2026-02-23T08:22:13.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:234: TEST_scrub_snaps: test 1.0 = 1.0 2026-02-23T08:22:13.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:236: TEST_scrub_snaps: rados list-inconsistent-obj 1.0 2026-02-23T08:22:13.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:241: TEST_scrub_snaps: jq .inconsistents 2026-02-23T08:22:13.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:241: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:22:13.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:248: TEST_scrub_snaps: jq .inconsistents td/osd-scrub-snaps/json 2026-02-23T08:22:13.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:248: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:22:13.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:249: TEST_scrub_snaps: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:22:13.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:22:13.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:251: TEST_scrub_snaps: rados list-inconsistent-snapset 1.0 2026-02-23T08:22:13.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:253: TEST_scrub_snaps: jq .inconsistents 2026-02-23T08:22:13.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:253: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:22:13.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:632: TEST_scrub_snaps: jq .inconsistents td/osd-scrub-snaps/json 2026-02-23T08:22:13.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:632: TEST_scrub_snaps: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:22:13.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:633: TEST_scrub_snaps: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:22:13.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:22:13.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:634: TEST_scrub_snaps: test no = yes 2026-02-23T08:22:13.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:639: TEST_scrub_snaps: test '' = yes 2026-02-23T08:22:13.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:644: TEST_scrub_snaps: find td/osd-scrub-snaps 2026-02-23T08:22:13.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:644: TEST_scrub_snaps: grep 'osd[^/]*\.pid' 2026-02-23T08:22:13.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:644: TEST_scrub_snaps: pidfiles=td/osd-scrub-snaps/osd.0.pid 2026-02-23T08:22:13.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:645: TEST_scrub_snaps: pids= 2026-02-23T08:22:13.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:646: TEST_scrub_snaps: for pidfile in ${pidfiles} 2026-02-23T08:22:13.888 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:648: TEST_scrub_snaps: cat td/osd-scrub-snaps/osd.0.pid 2026-02-23T08:22:13.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:648: TEST_scrub_snaps: pids+='851100 ' 2026-02-23T08:22:13.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:651: TEST_scrub_snaps: ERRORS=0 2026-02-23T08:22:13.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: seq 1 7 2026-02-23T08:22:13.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:13.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap1 2026-02-23T08:22:13.955 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap1 2026-02-23T08:22:13.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:13.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap2 2026-02-23T08:22:14.054 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap2 2026-02-23T08:22:14.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:14.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap3 2026-02-23T08:22:14.155 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap3 2026-02-23T08:22:14.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:14.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap4 2026-02-23T08:22:14.256 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap4 2026-02-23T08:22:14.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:14.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap5 2026-02-23T08:22:14.358 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap5 2026-02-23T08:22:14.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:14.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap6 2026-02-23T08:22:14.460 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap6 2026-02-23T08:22:14.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:653: TEST_scrub_snaps: for i in `seq 1 7` 2026-02-23T08:22:14.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:655: TEST_scrub_snaps: rados -p test rmsnap snap7 2026-02-23T08:22:14.561 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap7 2026-02-23T08:22:14.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:657: TEST_scrub_snaps: sleep 5 2026-02-23T08:22:19.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:658: TEST_scrub_snaps: local -i loop=0 2026-02-23T08:22:19.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:659: TEST_scrub_snaps: ceph pg dump pgs 2026-02-23T08:22:19.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:659: TEST_scrub_snaps: grep -q snaptrim 2026-02-23T08:22:19.714 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:22:19.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:661: TEST_scrub_snaps: ceph pg dump pgs 2026-02-23T08:22:19.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:661: TEST_scrub_snaps: grep -q snaptrim_error 2026-02-23T08:22:19.875 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:22:19.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:663: TEST_scrub_snaps: break 2026-02-23T08:22:19.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:672: TEST_scrub_snaps: ceph pg dump pgs 2026-02-23T08:22:20.038 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T08:22:20.038 INFO:tasks.workunit.client.0.trial129.stdout:1.0 35 0 0 0 0 23416 0 0 60 0 60 active+clean+inconsistent+snaptrim_error 2026-02-23T08:22:14.560064+0000 22'60 28:139 [0] 0 [0] 0 17'56 2026-02-23T08:22:10.732191+0000 0'0 2026-02-23T08:21:51.195514+0000 7 1 periodic scrub scheduled @ 2026-02-24T09:18:08.015612+0000 33 0 2026-02-23T08:22:20.038 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:22:20.039 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T08:22:20.039 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:22:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:674: TEST_scrub_snaps: for pid in $pids 2026-02-23T08:22:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:676: TEST_scrub_snaps: kill -0 851100 2026-02-23T08:22:20.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:683: TEST_scrub_snaps: kill_daemons td/osd-scrub-snaps 2026-02-23T08:22:20.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:22:20.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:22:20.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:22:20.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:22:20.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:685: TEST_scrub_snaps: declare -a err_strings 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:686: TEST_scrub_snaps: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj10:.* : is missing in clone_overlap' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:687: TEST_scrub_snaps: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : no '\''_'\'' attr' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:688: TEST_scrub_snaps: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : is an unexpected clone' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:689: TEST_scrub_snaps: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:4 : on disk size [(]4608[)] does not match object info size [(]512[)] adjusted for ondisk to [(]512[)]' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:690: TEST_scrub_snaps: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:2' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:691: TEST_scrub_snaps: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:1' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:692: TEST_scrub_snaps: err_strings[6]='log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj5:head : 2 missing clone[(]s[)]' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:693: TEST_scrub_snaps: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj8:head : snaps.seq not set' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:694: TEST_scrub_snaps: err_strings[8]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj7:1 : is an unexpected clone' 2026-02-23T08:22:25.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:695: TEST_scrub_snaps: err_strings[9]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj3:head : on disk size [(]3840[)] does not match object info size [(]768[)] adjusted for ondisk to [(]768[)]' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:696: TEST_scrub_snaps: err_strings[10]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj6:1 : is an unexpected clone' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:697: TEST_scrub_snaps: err_strings[11]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:head : no '\''snapset'\'' attr' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:698: TEST_scrub_snaps: err_strings[12]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:7 : clone ignored due to missing snapset' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:699: TEST_scrub_snaps: err_strings[13]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:4 : clone ignored due to missing snapset' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:700: TEST_scrub_snaps: err_strings[14]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj4:head : expected clone .*:::obj4:7' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:701: TEST_scrub_snaps: err_strings[15]='log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj4:head : 1 missing clone[(]s[)]' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:702: TEST_scrub_snaps: err_strings[16]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj1:1 : is an unexpected clone' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:703: TEST_scrub_snaps: err_strings[17]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj9:1 : is missing in clone_size' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:704: TEST_scrub_snaps: err_strings[18]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj11:1 : is an unexpected clone' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:705: TEST_scrub_snaps: err_strings[19]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj14:1 : size 1032 != clone_size 1033' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:706: TEST_scrub_snaps: err_strings[20]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:707: TEST_scrub_snaps: err_strings[21]='log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj15:head : can'\''t decode '\''snapset'\'' attr ' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:708: TEST_scrub_snaps: err_strings[22]='log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj10:.* : is missing in clone_overlap' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : no '\''_'\'' attr' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:7 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*::obj5:4 : on disk size [(]4608[)] does not match object info size [(]512[)] adjusted for ondisk to [(]512[)]' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:2' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj5:head : expected clone .*:::obj5:1' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj5:head : 2 missing clone[(]s[)]' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj8:head : snaps.seq not set' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj7:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj3:head : on disk size [(]3840[)] does not match object info size [(]768[)] adjusted for ondisk to [(]768[)]' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj6:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:head : no '\''snapset'\'' attr' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:7 : clone ignored due to missing snapset' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj2:4 : clone ignored due to missing snapset' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj4:head : expected clone .*:::obj4:7' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]INF[]] : scrub [0-9]*[.]0 .*:::obj4:head : 1 missing clone[(]s[)]' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj1:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj9:1 : is missing in clone_size' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj11:1 : is an unexpected clone' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj14:1 : size 1032 != clone_size 1033' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : scrub [0-9]*[.]0 .*:::obj15:head : can'\''t decode '\''snapset'\'' attr ' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:710: TEST_scrub_snaps: for err_string in "${err_strings[@]}" 2026-02-23T08:22:25.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:712: TEST_scrub_snaps: grep 'log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:25.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:719: TEST_scrub_snaps: '[' 0 '!=' 0 ']' 2026-02-23T08:22:25.398 INFO:tasks.workunit.client.0.trial129.stdout:TEST PASSED 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:725: TEST_scrub_snaps: echo 'TEST PASSED' 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:726: TEST_scrub_snaps: return 0 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:40: run: teardown td/osd-scrub-snaps 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:22:25.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:22:25.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:22:25.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:22:25.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:22:25.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:22:25.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:22:25.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:22:25.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:22:25.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:22:25.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:22:25.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:22:25.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:22:25.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:22:25.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:22:25.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:22:25.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:22:25.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:37: run: for func in $funcs 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:38: run: setup td/osd-scrub-snaps 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-snaps 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:22:25.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:22:25.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:22:25.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:22:25.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:22:25.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:22:25.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:22:25.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:22:25.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:22:25.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:22:25.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:22:25.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:22:25.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:22:25.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:22:25.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:22:25.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:22:25.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:22:25.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:22:25.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:22:25.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:22:25.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-snaps 2026-02-23T08:22:25.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:22:25.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.836428 2026-02-23T08:22:25.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:22:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:22:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:22:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-snaps 1' TERM HUP INT 2026-02-23T08:22:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:39: run: TEST_scrub_snaps_primary td/osd-scrub-snaps 2026-02-23T08:22:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1175: TEST_scrub_snaps_primary: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1176: TEST_scrub_snaps_primary: ORIG_ARGS='--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1177: TEST_scrub_snaps_primary: CEPH_ARGS+=' --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1178: TEST_scrub_snaps_primary: _scrub_snaps_multi td/osd-scrub-snaps primary 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:730: _scrub_snaps_multi: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:731: _scrub_snaps_multi: local poolname=test 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:732: _scrub_snaps_multi: local OBJS=16 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:733: _scrub_snaps_multi: local OSDS=2 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:734: _scrub_snaps_multi: local which=primary 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:736: _scrub_snaps_multi: TESTDATA=testdata.836428 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:738: _scrub_snaps_multi: run_mon td/osd-scrub-snaps a --osd_pool_default_size=2 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-snaps/a 2026-02-23T08:22:25.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-snaps/a --run-dir=td/osd-scrub-snaps --osd_pool_default_size=2 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:25.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-snaps/a '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-snaps/log --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:22:25.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:22:25.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:22:25.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:22:25.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:22:25.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.477 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.836428/ceph-mon.a.asok 2026-02-23T08:22:25.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:22:25.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.836428/ceph-mon.a.asok config get fsid 2026-02-23T08:22:25.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:22:25.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:22:25.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:22:25.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:22:25.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.836428/ceph-mon.a.asok 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:22:25.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.836428/ceph-mon.a.asok config get mon_host 2026-02-23T08:22:25.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:739: _scrub_snaps_multi: run_mgr td/osd-scrub-snaps x 2026-02-23T08:22:25.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:22:25.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:22:25.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:22:25.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-snaps/x 2026-02-23T08:22:25.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:22:25.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:22:25.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:25.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:25.698 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:25.698 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.698 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:25.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:22:25.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-snaps/x '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:22:25.716 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: expr 2 - 1 2026-02-23T08:22:25.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: seq 0 1 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 0 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:22:25.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:25.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fb41b84d-6661-4463-bfa2-cc3b70a2b196 2026-02-23T08:22:25.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 fb41b84d-6661-4463-bfa2-cc3b70a2b196' 2026-02-23T08:22:25.721 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 fb41b84d-6661-4463-bfa2-cc3b70a2b196 2026-02-23T08:22:25.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:22:25.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBBDpxpbzuXKxAAMvXSTqjxZriZ7bQGRhsfNw== 2026-02-23T08:22:25.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBBDpxpbzuXKxAAMvXSTqjxZriZ7bQGRhsfNw=="}' 2026-02-23T08:22:25.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fb41b84d-6661-4463-bfa2-cc3b70a2b196 -i td/osd-scrub-snaps/0/new.json 2026-02-23T08:22:25.826 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:22:25.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/0/new.json 2026-02-23T08:22:25.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBBDpxpbzuXKxAAMvXSTqjxZriZ7bQGRhsfNw== --osd-uuid fb41b84d-6661-4463-bfa2-cc3b70a2b196 2026-02-23T08:22:25.853 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:25.851+0000 7feb6960e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:25.854 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:25.853+0000 7feb6960e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:25.855 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:25.853+0000 7feb6960e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:25.856 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:25.854+0000 7feb6960e780 -1 bdev(0x55bdbf257400 td/osd-scrub-snaps/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:22:25.856 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:25.854+0000 7feb6960e780 -1 bluestore(td/osd-scrub-snaps/0) _read_fsid unparsable uuid 2026-02-23T08:22:26.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/0/keyring 2026-02-23T08:22:26.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:22:26.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:22:26.283 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:22:26.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:22:26.385 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:22:26.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:22:26.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:22:26.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:22:26.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:22:26.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:22:26.402 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:26.401+0000 7f444e481780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:26.404 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:26.402+0000 7f444e481780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:26.405 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:26.403+0000 7f444e481780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:22:26.483 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:22:26.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:26.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:22:26.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:22:26.607 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:26.606+0000 7f444e481780 -1 Falling back to public interface 2026-02-23T08:22:26.913 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:26.911+0000 7f444e481780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:22:27.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:22:27.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:27.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:22:27.582 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:22:27.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:27.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:22:27.676 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/889429915,v1:127.0.0.1:6801/889429915] [v2:127.0.0.1:6802/889429915,v1:127.0.0.1:6803/889429915] exists,up fb41b84d-6661-4463-bfa2-cc3b70a2b196 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 1 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:22:27.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:22:27.681 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:22:27.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e097ae7e-532c-4e2b-b0c6-4281da816444 2026-02-23T08:22:27.683 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 e097ae7e-532c-4e2b-b0c6-4281da816444 2026-02-23T08:22:27.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e097ae7e-532c-4e2b-b0c6-4281da816444' 2026-02-23T08:22:27.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:22:27.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBDDpxpoTwmKRAAFwi4s6l/ZslM42qfZkX+jA== 2026-02-23T08:22:27.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBDDpxpoTwmKRAAFwi4s6l/ZslM42qfZkX+jA=="}' 2026-02-23T08:22:27.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e097ae7e-532c-4e2b-b0c6-4281da816444 -i td/osd-scrub-snaps/1/new.json 2026-02-23T08:22:27.783 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:22:27.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/1/new.json 2026-02-23T08:22:27.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBDDpxpoTwmKRAAFwi4s6l/ZslM42qfZkX+jA== --osd-uuid e097ae7e-532c-4e2b-b0c6-4281da816444 2026-02-23T08:22:27.810 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:27.808+0000 7fd3dea94780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:27.811 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:27.810+0000 7fd3dea94780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:27.812 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:27.810+0000 7fd3dea94780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:27.813 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:27.811+0000 7fd3dea94780 -1 bdev(0x5598605d7400 td/osd-scrub-snaps/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:22:27.813 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:27.811+0000 7fd3dea94780 -1 bluestore(td/osd-scrub-snaps/1) _read_fsid unparsable uuid 2026-02-23T08:22:28.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/1/keyring 2026-02-23T08:22:28.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:22:28.229 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:22:28.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:22:28.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:22:28.445 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:22:28.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:22:28.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:22:28.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:22:28.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:22:28.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:22:28.461 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:28.459+0000 7f63d354b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:28.462 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:28.460+0000 7f63d354b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:28.463 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:28.461+0000 7f63d354b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:28.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:22:28.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:22:28.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:22:28.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:22:28.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:22:28.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:28.614 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:22:28.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:22:28.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:28.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:22:28.623 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:28.621+0000 7f63d354b780 -1 Falling back to public interface 2026-02-23T08:22:28.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:22:28.946 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:28.944+0000 7f63d354b780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:22:29.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:22:29.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:29.781 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:22:29.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:22:29.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:29.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:22:29.951 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1493710926,v1:127.0.0.1:6811/1493710926] [v2:127.0.0.1:6812/1493710926,v1:127.0.0.1:6813/1493710926] exists,up e097ae7e-532c-4e2b-b0c6-4281da816444 2026-02-23T08:22:29.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:22:29.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:22:29.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:22:29.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:746: _scrub_snaps_multi: ceph osd set noscrub 2026-02-23T08:22:30.162 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:22:30.174 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:747: _scrub_snaps_multi: ceph osd set nodeep-scrub 2026-02-23T08:22:30.366 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:22:30.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:750: _scrub_snaps_multi: create_pool test 1 1 2026-02-23T08:22:30.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:22:30.569 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:22:30.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:22:31.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:751: _scrub_snaps_multi: wait_for_clean 2026-02-23T08:22:31.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:22:31.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:22:31.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:22:31.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:22:31.583 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:22:31.583 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:22:31.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:22:31.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:22:31.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:22:31.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:22:31.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:22:31.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:22:31.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:22:31.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:22:31.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:22:31.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:22:31.829 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:22:31.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:22:31.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:31.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:22:31.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:22:31.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:22:31.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:22:31.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:31.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:22:31.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705666 2026-02-23T08:22:31.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705666 2026-02-23T08:22:31.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-38654705666' 2026-02-23T08:22:31.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:31.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:22:31.991 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:31.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:22:31.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:22:31.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:22:31.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:22:31.993 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:22:31.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:32.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:22:32.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:33.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:22:33.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:33.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:22:33.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:34.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:22:34.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-23T08:22:34.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:34.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705666 2026-02-23T08:22:34.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:34.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:22:34.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705666 2026-02-23T08:22:34.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:34.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705666 2026-02-23T08:22:34.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705666' 2026-02-23T08:22:34.510 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705666 2026-02-23T08:22:34.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:22:34.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705666 -lt 38654705666 2026-02-23T08:22:34.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:22:34.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:22:34.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:22:34.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:22:34.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:22:34.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:22:34.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:22:34.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:22:34.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:22:34.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:22:34.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:22:35.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:22:35.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:22:35.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:22:35.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:22:35.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:22:35.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:22:35.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:22:35.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: ceph osd dump 2026-02-23T08:22:35.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: grep '^pool.*['\'']test['\'']' 2026-02-23T08:22:35.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: awk '{ print $2 }' 2026-02-23T08:22:35.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: poolid=1 2026-02-23T08:22:35.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:754: _scrub_snaps_multi: dd if=/dev/urandom of=testdata.836428 bs=1032 count=1 2026-02-23T08:22:35.430 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:22:35.431 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:22:35.431 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 2.3524e-05 s, 43.9 MB/s 2026-02-23T08:22:35.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: seq 1 16 2026-02-23T08:22:35.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj1 testdata.836428 2026-02-23T08:22:35.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj2 testdata.836428 2026-02-23T08:22:35.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj3 testdata.836428 2026-02-23T08:22:35.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj4 testdata.836428 2026-02-23T08:22:35.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj5 testdata.836428 2026-02-23T08:22:35.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj6 testdata.836428 2026-02-23T08:22:35.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj7 testdata.836428 2026-02-23T08:22:35.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj8 testdata.836428 2026-02-23T08:22:35.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj9 testdata.836428 2026-02-23T08:22:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj10 testdata.836428 2026-02-23T08:22:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj11 testdata.836428 2026-02-23T08:22:35.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj12 testdata.836428 2026-02-23T08:22:35.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj13 testdata.836428 2026-02-23T08:22:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj14 testdata.836428 2026-02-23T08:22:35.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj15 testdata.836428 2026-02-23T08:22:35.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:22:35.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj16 testdata.836428 2026-02-23T08:22:35.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: get_primary test obj1 2026-02-23T08:22:35.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:22:35.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:22:35.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:22:35.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:22:35.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: local primary=1 2026-02-23T08:22:35.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: get_not_primary test obj1 2026-02-23T08:22:35.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2026-02-23T08:22:35.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-23T08:22:35.882 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2026-02-23T08:22:35.882 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:22:35.882 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:22:35.883 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:22:35.883 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:22:36.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:22:36.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2026-02-23T08:22:36.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: local replica=0 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: eval create_scenario td/osd-scrub-snaps test testdata.836428 '$primary' 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: create_scenario td/osd-scrub-snaps test testdata.836428 1 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:45: create_scenario: local dir=td/osd-scrub-snaps 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:46: create_scenario: local poolname=test 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:47: create_scenario: local TESTDATA=testdata.836428 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:48: create_scenario: local osd=1 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:50: create_scenario: SNAP=1 2026-02-23T08:22:36.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:51: create_scenario: rados -p test mksnap snap1 2026-02-23T08:22:36.290 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap1 2026-02-23T08:22:36.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:52: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=1 2026-02-23T08:22:36.292 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:22:36.293 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:22:36.293 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.9955e-05 s, 6.4 MB/s 2026-02-23T08:22:36.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:53: create_scenario: rados -p test put obj1 testdata.836428 2026-02-23T08:22:36.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:54: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:22:36.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:55: create_scenario: rados -p test put obj3 testdata.836428 2026-02-23T08:22:36.346 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: seq 6 14 2026-02-23T08:22:36.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj6 testdata.836428 2026-02-23T08:22:36.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj7 testdata.836428 2026-02-23T08:22:36.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj8 testdata.836428 2026-02-23T08:22:36.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.400 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj9 testdata.836428 2026-02-23T08:22:36.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj10 testdata.836428 2026-02-23T08:22:36.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj11 testdata.836428 2026-02-23T08:22:36.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj12 testdata.836428 2026-02-23T08:22:36.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj13 testdata.836428 2026-02-23T08:22:36.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:22:36.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj14 testdata.836428 2026-02-23T08:22:36.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:60: create_scenario: SNAP=2 2026-02-23T08:22:36.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:61: create_scenario: rados -p test mksnap snap2 2026-02-23T08:22:36.566 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap2 2026-02-23T08:22:36.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:62: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=2 2026-02-23T08:22:36.570 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records in 2026-02-23T08:22:36.570 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records out 2026-02-23T08:22:36.570 INFO:tasks.workunit.client.0.trial129.stderr:512 bytes copied, 3.8021e-05 s, 13.5 MB/s 2026-02-23T08:22:36.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:63: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:22:36.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:65: create_scenario: SNAP=3 2026-02-23T08:22:36.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:66: create_scenario: rados -p test mksnap snap3 2026-02-23T08:22:36.668 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap3 2026-02-23T08:22:36.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:67: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=3 2026-02-23T08:22:36.671 INFO:tasks.workunit.client.0.trial129.stderr:3+0 records in 2026-02-23T08:22:36.671 INFO:tasks.workunit.client.0.trial129.stderr:3+0 records out 2026-02-23T08:22:36.671 INFO:tasks.workunit.client.0.trial129.stderr:768 bytes copied, 3.1079e-05 s, 24.7 MB/s 2026-02-23T08:22:36.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:68: create_scenario: rados -p test put obj3 testdata.836428 2026-02-23T08:22:36.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:70: create_scenario: SNAP=4 2026-02-23T08:22:36.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:71: create_scenario: rados -p test mksnap snap4 2026-02-23T08:22:36.769 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap4 2026-02-23T08:22:36.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:72: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=4 2026-02-23T08:22:36.773 INFO:tasks.workunit.client.0.trial129.stderr:4+0 records in 2026-02-23T08:22:36.773 INFO:tasks.workunit.client.0.trial129.stderr:4+0 records out 2026-02-23T08:22:36.773 INFO:tasks.workunit.client.0.trial129.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.6378e-05 s, 28.1 MB/s 2026-02-23T08:22:36.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:73: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:22:36.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:74: create_scenario: rados -p test put obj2 testdata.836428 2026-02-23T08:22:36.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:76: create_scenario: SNAP=5 2026-02-23T08:22:36.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:77: create_scenario: rados -p test mksnap snap5 2026-02-23T08:22:36.870 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap5 2026-02-23T08:22:36.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:78: create_scenario: SNAP=6 2026-02-23T08:22:36.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:79: create_scenario: rados -p test mksnap snap6 2026-02-23T08:22:36.973 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap6 2026-02-23T08:22:36.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:80: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=6 2026-02-23T08:22:36.975 INFO:tasks.workunit.client.0.trial129.stderr:6+0 records in 2026-02-23T08:22:36.975 INFO:tasks.workunit.client.0.trial129.stderr:6+0 records out 2026-02-23T08:22:36.975 INFO:tasks.workunit.client.0.trial129.stderr:1536 bytes (1.5 kB, 1.5 KiB) copied, 4.4924e-05 s, 34.2 MB/s 2026-02-23T08:22:36.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:81: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:22:36.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:83: create_scenario: SNAP=7 2026-02-23T08:22:36.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:84: create_scenario: rados -p test mksnap snap7 2026-02-23T08:22:37.074 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap7 2026-02-23T08:22:37.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:86: create_scenario: rados -p test rm obj4 2026-02-23T08:22:37.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:87: create_scenario: rados -p test rm obj16 2026-02-23T08:22:37.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:88: create_scenario: rados -p test rm obj2 2026-02-23T08:22:37.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:90: create_scenario: kill_daemons td/osd-scrub-snaps TERM osd 2026-02-23T08:22:37.133 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:22:37.133 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:22:37.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:22:37.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:22:37.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:22:37.238 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:22:37.238 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj1 2026-02-23T08:22:37.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: JSON='["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:37.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:95: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' --force remove 2026-02-23T08:22:37.505 INFO:tasks.workunit.client.0.trial129.stdout:WARNING: only removing head with clones present 2026-02-23T08:22:37.506 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-23T08:22:37.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj5 2026-02-23T08:22:37.560 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: grep '"snapid":2' 2026-02-23T08:22:37.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:37.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:98: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:22:37.763 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:2# 2026-02-23T08:22:37.817 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj5 2026-02-23T08:22:37.817 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: grep '"snapid":1' 2026-02-23T08:22:37.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:37.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:101: create_scenario: OBJ5SAVE='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:37.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:103: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-23T08:22:38.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:104: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.068 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:105: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:22:38.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:106: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --rmtype nosnapmap '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:22:38.205 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:1# 2026-02-23T08:22:38.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:108: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-23T08:22:38.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:109: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:22:38.387 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.387 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.388 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:38.389 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:38.390 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:22:38.391 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:38.391 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:38.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:110: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:22:38.391 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:22:38.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:111: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-23T08:22:38.392 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj5 2026-02-23T08:22:38.392 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: grep '"snapid":4' 2026-02-23T08:22:38.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:38.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:114: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=18 2026-02-23T08:22:38.496 INFO:tasks.workunit.client.0.trial129.stderr:18+0 records in 2026-02-23T08:22:38.496 INFO:tasks.workunit.client.0.trial129.stderr:18+0 records out 2026-02-23T08:22:38.496 INFO:tasks.workunit.client.0.trial129.stderr:4608 bytes (4.6 kB, 4.5 KiB) copied, 7.2426e-05 s, 63.6 MB/s 2026-02-23T08:22:38.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:115: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:22:38.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj3 2026-02-23T08:22:38.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: JSON='["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:38.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:118: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=15 2026-02-23T08:22:38.789 INFO:tasks.workunit.client.0.trial129.stderr:15+0 records in 2026-02-23T08:22:38.789 INFO:tasks.workunit.client.0.trial129.stderr:15+0 records out 2026-02-23T08:22:38.789 INFO:tasks.workunit.client.0.trial129.stderr:3840 bytes (3.8 kB, 3.8 KiB) copied, 7.5261e-05 s, 51.0 MB/s 2026-02-23T08:22:38.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:119: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:22:38.952 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj4 2026-02-23T08:22:38.952 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: grep '"snapid":7' 2026-02-23T08:22:39.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: JSON='["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:39.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:122: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:22:39.172 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:0ee9ae15:::obj4:7# 2026-02-23T08:22:39.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:125: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-23T08:22:39.366 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:126: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:22:39.367 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:22:39.367 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.367 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:22:39.368 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:39.369 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:39.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:39.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:39.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:127: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:22:39.370 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:22:39.371 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --op list obj16 2026-02-23T08:22:39.372 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: grep '"snapid":7' 2026-02-23T08:22:39.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: JSON='["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:39.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:129: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --rmtype snapmap '["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:22:39.588 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:461f8b5e:::obj16:7# 2026-02-23T08:22:39.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:131: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/1 list 2026-02-23T08:22:39.798 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:132: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:22:39.799 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:133: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:22:39.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:134: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-23T08:22:39.801 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj2 2026-02-23T08:22:39.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: JSON='["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:39.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:137: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' rm-attr snapset 2026-02-23T08:22:40.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: echo '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:40.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: sed 's/snapid":1/snapid":7/' 2026-02-23T08:22:40.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:40.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:141: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=7 2026-02-23T08:22:40.075 INFO:tasks.workunit.client.0.trial129.stderr:7+0 records in 2026-02-23T08:22:40.075 INFO:tasks.workunit.client.0.trial129.stderr:7+0 records out 2026-02-23T08:22:40.075 INFO:tasks.workunit.client.0.trial129.stderr:1792 bytes (1.8 kB, 1.8 KiB) copied, 4.4132e-05 s, 40.6 MB/s 2026-02-23T08:22:40.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:142: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:22:40.223 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj6 2026-02-23T08:22:40.276 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:40.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: JSON='["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:40.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:145: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-23T08:22:40.478 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj7 2026-02-23T08:22:40.523 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:40.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: JSON='["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:40.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:147: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset corrupt 2026-02-23T08:22:40.743 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj8 2026-02-23T08:22:40.789 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:40.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: JSON='["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:40.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:149: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset seq 2026-02-23T08:22:41.014 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj9 2026-02-23T08:22:41.059 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:41.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: JSON='["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:41.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:151: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_size 2026-02-23T08:22:41.285 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj10 2026-02-23T08:22:41.336 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:41.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: JSON='["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:41.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:153: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_overlap 2026-02-23T08:22:41.544 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj11 2026-02-23T08:22:41.605 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:41.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: JSON='["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:41.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:155: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-23T08:22:41.820 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj13 2026-02-23T08:22:41.869 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:41.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: JSON='["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:41.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:157: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset snaps 2026-02-23T08:22:42.115 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj14 2026-02-23T08:22:42.174 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:42.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: JSON='["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:42.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:159: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset size 2026-02-23T08:22:42.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:161: create_scenario: echo garbage 2026-02-23T08:22:42.383 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 --head --op list obj15 2026-02-23T08:22:42.443 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:22:42.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: JSON='["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:22:42.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:163: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/1 '["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' set-attr snapset td/osd-scrub-snaps/bad 2026-02-23T08:22:42.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:164: create_scenario: rm -f td/osd-scrub-snaps/bad 2026-02-23T08:22:42.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:165: create_scenario: return 0 2026-02-23T08:22:42.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:765: _scrub_snaps_multi: rm -f testdata.836428 2026-02-23T08:22:42.672 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: expr 2 - 1 2026-02-23T08:22:42.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: seq 0 1 2026-02-23T08:22:42.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:22:42.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 0 2026-02-23T08:22:42.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:22:42.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:22:42.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:22:42.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:22:42.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:22:42.680 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:22:42.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:22:42.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/0/whoami 2026-02-23T08:22:42.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:22:42.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:22:42.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:22:42.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:22:42.692 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:42.690+0000 7f81a3588780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:42.693 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:42.691+0000 7f81a3588780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:42.694 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:42.692+0000 7f81a3588780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:42.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:22:42.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:22:42.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:22:42.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:22:42.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:22:42.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:42.849 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:22:42.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:22:42.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:42.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:22:42.878 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:42.876+0000 7f81a3588780 -1 Falling back to public interface 2026-02-23T08:22:43.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:22:43.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:43.248+0000 7f81a3588780 -1 osd.0 21 log_to_monitors true 2026-02-23T08:22:44.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:22:44.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:44.018 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:22:44.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:22:44.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:44.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:22:44.187 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 24 up_thru 24 down_at 22 last_clean_interval [5,21) [v2:127.0.0.1:6800/3241199738,v1:127.0.0.1:6801/3241199738] [v2:127.0.0.1:6802/3241199738,v1:127.0.0.1:6803/3241199738] exists,up fb41b84d-6661-4463-bfa2-cc3b70a2b196 2026-02-23T08:22:44.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 1 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:22:44.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:22:44.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:22:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:22:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:22:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-23T08:22:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:22:44.193 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:22:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:22:44.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/1/whoami 2026-02-23T08:22:44.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:22:44.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:22:44.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:22:44.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:22:44.206 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:44.204+0000 7f7935d55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:44.207 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:44.206+0000 7f7935d55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:44.208 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:44.206+0000 7f7935d55780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:22:44.341 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:44.338+0000 7f7935d55780 -1 Falling back to public interface 2026-02-23T08:22:44.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:22:44.361 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:22:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:44.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:22:44.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:22:44.711 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:22:44.709+0000 7f7935d55780 -1 osd.1 21 log_to_monitors true 2026-02-23T08:22:45.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:22:45.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:22:45.531 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:22:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:22:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:22:45.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:22:45.703 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 28 up_thru 28 down_at 22 last_clean_interval [9,21) [v2:127.0.0.1:6810/1582732135,v1:127.0.0.1:6811/1582732135] [v2:127.0.0.1:6812/1582732135,v1:127.0.0.1:6813/1582732135] exists,up e097ae7e-532c-4e2b-b0c6-4281da816444 2026-02-23T08:22:45.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:22:45.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:22:45.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:22:45.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:772: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 3 2026-02-23T08:22:45.774 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:22:45.774 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T08:22:45.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:45.781 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:22:45.781 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T08:22:45.781 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:45.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:773: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_min 3 2026-02-23T08:22:45.859 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:22:45.859 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-23T08:22:45.859 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:45.867 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:22:45.867 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-23T08:22:45.867 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:45.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:774: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_scrub_chunk_min 3 2026-02-23T08:22:45.945 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:22:45.945 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-23T08:22:45.946 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:45.952 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:22:45.952 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-23T08:22:45.952 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:45.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:775: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_seconds 1 2026-02-23T08:22:46.026 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:22:46.026 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-23T08:22:46.026 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:46.033 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:22:46.033 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-23T08:22:46.033 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:46.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:776: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_epochs 1 2026-02-23T08:22:46.110 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:22:46.110 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-23T08:22:46.110 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:46.117 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:22:46.117 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-23T08:22:46.117 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:46.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:777: _scrub_snaps_multi: wait_for_clean 2026-02-23T08:22:46.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:22:46.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:22:46.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:22:46.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:22:46.126 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:22:46.126 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:22:46.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:22:46.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:22:46.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:22:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:22:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:22:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:22:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:22:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:22:46.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:22:46.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:22:46.372 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:22:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:22:46.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:46.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:22:46.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215106 2026-02-23T08:22:46.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215106 2026-02-23T08:22:46.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106' 2026-02-23T08:22:46.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:46.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:22:46.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-23T08:22:46.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-23T08:22:46.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215106 1-120259084290' 2026-02-23T08:22:46.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:46.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215106 2026-02-23T08:22:46.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:46.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:22:46.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215106 2026-02-23T08:22:46.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:46.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215106 2026-02-23T08:22:46.527 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215106 2026-02-23T08:22:46.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215106' 2026-02-23T08:22:46.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:46.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 103079215106 2026-02-23T08:22:46.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:47.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:22:47.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:47.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215106 2026-02-23T08:22:47.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:47.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084290 2026-02-23T08:22:47.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:47.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:22:47.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084290 2026-02-23T08:22:47.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:47.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-23T08:22:47.871 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 120259084290 2026-02-23T08:22:47.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084290' 2026-02-23T08:22:47.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:22:48.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-23T08:22:48.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:22:48.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:22:48.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:22:48.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:22:48.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:22:48.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:22:48.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:22:48.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:22:48.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:779: _scrub_snaps_multi: local pgid=1.0 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:780: _scrub_snaps_multi: pg_scrub 1.0 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-23T08:22:48.629 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:22:48.630 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:22:48.630 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:22:48.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:22:48.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:22:48.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:22:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:22:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:22:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:22:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:22:48.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:22:48.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:22:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:22:48.988 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:22:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:22:48.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:48.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:22:49.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=103079215108 2026-02-23T08:22:49.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 103079215108 2026-02-23T08:22:49.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108' 2026-02-23T08:22:49.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:22:49.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:22:49.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084291 2026-02-23T08:22:49.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084291 2026-02-23T08:22:49.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-103079215108 1-120259084291' 2026-02-23T08:22:49.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:49.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-103079215108 2026-02-23T08:22:49.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:49.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:22:49.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-103079215108 2026-02-23T08:22:49.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=103079215108 2026-02-23T08:22:49.148 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 103079215108 2026-02-23T08:22:49.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 103079215108' 2026-02-23T08:22:49.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:49.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215106 -lt 103079215108 2026-02-23T08:22:49.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:22:50.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:22:50.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:22:50.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 103079215108 -lt 103079215108 2026-02-23T08:22:50.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:22:50.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084291 2026-02-23T08:22:50.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:22:50.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:22:50.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084291 2026-02-23T08:22:50.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:22:50.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084291 2026-02-23T08:22:50.490 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 120259084291 2026-02-23T08:22:50.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084291' 2026-02-23T08:22:50.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:22:50.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084291 -lt 120259084291 2026-02-23T08:22:50.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:22:50.660 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 1.0 loop 0 2026-02-23T08:22:50.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-23T08:22:50.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-23T08:22:50.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-23T08:22:50.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:22:50.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-23T08:22:50.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:22:50.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:50.737 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:50.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:50.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-23T08:22:51.063 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to scrub 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:51.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:51.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:51.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:51.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:22:30.566912+0000 '>' 2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:51.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:52.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:52.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:52.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:52.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:52.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:52.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:52.244 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:52.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:22:30.566912+0000 '>' 2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:52.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:53.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:53.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:53.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:53.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:53.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:53.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:53.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:22:30.566912+0000 '>' 2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:53.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:54.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:54.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:54.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:54.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:54.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:54.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:54.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:54.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:22:30.566912+0000 '>' 2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:54.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:22:55.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:22:55.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:22:55.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:22:55.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:22:55.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:22:55.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:22:55.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:22:55.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:22:51.852953+0000 '>' 2026-02-23T08:22:30.566912+0000 2026-02-23T08:22:55.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:22:55.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:22:55.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: wc -l 2026-02-23T08:22:55.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: test 14 -gt 3 2026-02-23T08:22:55.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:22:55.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: wc -l 2026-02-23T08:22:55.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: test 14 -gt 3 2026-02-23T08:22:55.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:787: _scrub_snaps_multi: rados list-inconsistent-pg test 2026-02-23T08:22:55.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: jq '. | length' td/osd-scrub-snaps/json 2026-02-23T08:22:55.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: test 1 = 1 2026-02-23T08:22:55.955 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: jq -r '.[0]' td/osd-scrub-snaps/json 2026-02-23T08:22:55.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: test 1.0 = 1.0 2026-02-23T08:22:55.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:793: _scrub_snaps_multi: rados list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T08:22:55.973 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:22:55.973 INFO:tasks.workunit.client.0.trial129.stdout: "epoch": 28, 2026-02-23T08:22:55.973 INFO:tasks.workunit.client.0.trial129.stdout: "inconsistents": [ 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj1", 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "version": 18 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:22:55.974 INFO:tasks.workunit.client.0.trial129.stdout: "missing" 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj1", 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1828249343, 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.975 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'18", 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'1", 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4220.0:1", 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 18, 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.307570+0000", 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.308535+0000", 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:55.976 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:55.977 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: "missing" 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.978 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj10", 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "version": 32 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:55.979 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj10", 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 718195851, 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'32", 2026-02-23T08:22:55.980 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'10", 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4241.0:1", 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 32, 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.431028+0000", 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.431326+0000", 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:55.981 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.982 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:55.983 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:55.984 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "????", 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.985 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj11", 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: "version": 34 2026-02-23T08:22:55.986 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj11", 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 693400951, 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:55.987 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'34", 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'11", 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4244.0:1", 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 34, 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.447483+0000", 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.447788+0000", 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.988 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:55.989 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:55.990 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:55.991 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj13", 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:55.992 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "version": 38 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj13", 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2087409765, 2026-02-23T08:22:55.993 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'38", 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'13", 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4250.0:1", 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 38, 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.480956+0000", 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.481241+0000", 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:55.994 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.995 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.996 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]" 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.997 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj14", 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "version": 40 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:55.998 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj14", 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2484217095, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'40", 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'14", 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4253.0:1", 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 40, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:55.999 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.497621+0000", 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.497921+0000", 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.000 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.001 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.002 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1033, 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.003 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj15", 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "version": 15 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_corrupted" 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj15", 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 612772309, 2026-02-23T08:22:56.004 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "version": "14'15", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "0'0", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4205.0:1", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 15, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:35.689868+0000", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:35.690168+0000", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x816e6c5a", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.005 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.006 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_corrupted" 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": "Z2FyYmFnZQo=" 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj2", 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "version": 56 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.007 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_missing" 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj2", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1058988552, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "version": "21'56", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "18'48", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4295.0:1", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 56, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "size": 0, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:37.128995+0000", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:37.129330+0000", 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.008 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "whiteout", 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "dirty" 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xffffffff", 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.009 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "size": 0, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 7, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 4, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: 4, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: 3, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: 2, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 7, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1024, 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.010 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: 7, 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: 6, 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: 5 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_missing" 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "size": 0 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj3", 2026-02-23T08:22:56.011 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "version": 44 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "size_mismatch" 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "size_mismatch_info", 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "obj_size_info_mismatch" 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj3", 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1643547569, 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.012 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'44", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "15'22", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4265.0:1", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 44, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "size": 768, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.685620+0000", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.686606+0000", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xcdf327e9", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.013 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "size": 768 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "size_mismatch_info", 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "obj_size_info_mismatch" 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.014 INFO:tasks.workunit.client.0.trial129.stdout: "size": 3840, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "object_info": { 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj3", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1643547569, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'44", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "15'22", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4265.0:1", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 44, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "size": 768, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.685620+0000", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.686606+0000", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.015 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xcdf327e9", 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj6", 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "version": 24 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:56.016 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj6", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2202164420, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'24", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'6", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4229.0:1", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 24, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.362135+0000", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.362485+0000", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.017 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.018 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj7", 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.019 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "version": 26 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj7", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1552453721, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'26", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'7", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4232.0:1", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 26, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.380040+0000", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.380344+0000", 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.020 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.021 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj8", 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.022 INFO:tasks.workunit.client.0.trial129.stdout: "version": 28 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj8", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2381834917, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'28", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'8", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4235.0:1", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 28, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.397755+0000", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.398054+0000", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.023 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.024 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.025 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj9", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "version": 30 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj9", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 3833113727, 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:22:56.026 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "version": "15'30", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "14'9", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4238.0:1", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 30, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:22:36.414412+0000", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:22:36.414700+0000", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe46c4ee4", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:22:56.027 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "size": "????", 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.028 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.029 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.029 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.029 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.029 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:22:56.029 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:22:56.029 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:795: _scrub_snaps_multi: rados list-inconsistent-snapset 1.0 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:798: _scrub_snaps_multi: '[' primary = replica ']' 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:809: _scrub_snaps_multi: scruberrors=30 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:810: _scrub_snaps_multi: jq .inconsistents 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:810: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: jq .inconsistents td/osd-scrub-snaps/json 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1065: _scrub_snaps_multi: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1066: _scrub_snaps_multi: test no = yes 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1071: _scrub_snaps_multi: test '' = yes 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: find td/osd-scrub-snaps 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: grep 'osd[^/]*\.pid' 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: pidfiles='td/osd-scrub-snaps/osd.0.pid 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:td/osd-scrub-snaps/osd.1.pid' 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1077: _scrub_snaps_multi: pids= 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.0.pid 2026-02-23T08:22:56.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='869079 ' 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.1.pid 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='869621 ' 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1083: _scrub_snaps_multi: ERRORS=0 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1087: _scrub_snaps_multi: '[' primary = primary ']' 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: seq 1 7 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap1 2026-02-23T08:22:56.088 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap1 2026-02-23T08:22:56.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap2 2026-02-23T08:22:56.189 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap2 2026-02-23T08:22:56.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap3 2026-02-23T08:22:56.291 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap3 2026-02-23T08:22:56.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap4 2026-02-23T08:22:56.392 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap4 2026-02-23T08:22:56.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap5 2026-02-23T08:22:56.494 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap5 2026-02-23T08:22:56.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap6 2026-02-23T08:22:56.596 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap6 2026-02-23T08:22:56.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1089: _scrub_snaps_multi: for i in `seq 1 7` 2026-02-23T08:22:56.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1091: _scrub_snaps_multi: rados -p test rmsnap snap7 2026-02-23T08:22:56.696 INFO:tasks.workunit.client.0.trial129.stdout:removed pool test snap snap7 2026-02-23T08:22:56.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1093: _scrub_snaps_multi: sleep 5 2026-02-23T08:23:01.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1094: _scrub_snaps_multi: local -i loop=0 2026-02-23T08:23:01.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1095: _scrub_snaps_multi: ceph pg dump pgs 2026-02-23T08:23:01.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1095: _scrub_snaps_multi: grep -q snaptrim 2026-02-23T08:23:01.859 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:23:01.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1097: _scrub_snaps_multi: ceph pg dump pgs 2026-02-23T08:23:01.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1097: _scrub_snaps_multi: grep -q snaptrim_error 2026-02-23T08:23:02.027 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:23:02.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1099: _scrub_snaps_multi: break 2026-02-23T08:23:02.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1109: _scrub_snaps_multi: ceph pg dump pgs 2026-02-23T08:23:02.195 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T08:23:02.196 INFO:tasks.workunit.client.0.trial129.stdout:1.0 36 0 0 0 0 24448 0 0 56 0 56 active+clean+inconsistent+snaptrim_error 2026-02-23T08:22:56.696318+0000 21'56 37:136 [1,0] 1 [1,0] 1 21'56 2026-02-23T08:22:51.852953+0000 0'0 2026-02-23T08:22:30.566912+0000 7 1 periodic scrub scheduled @ 2026-02-24T09:23:46.882878+0000 33 0 2026-02-23T08:23:02.196 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:23:02.196 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T08:23:02.196 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:23:02.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-23T08:23:02.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 869079 2026-02-23T08:23:02.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 869621 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1120: _scrub_snaps_multi: kill_daemons td/osd-scrub-snaps 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:02.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1122: _scrub_snaps_multi: declare -a err_strings 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1123: _scrub_snaps_multi: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1124: _scrub_snaps_multi: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1125: _scrub_snaps_multi: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1126: _scrub_snaps_multi: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1127: _scrub_snaps_multi: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' 2026-02-23T08:23:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1128: _scrub_snaps_multi: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' 2026-02-23T08:23:07.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1129: _scrub_snaps_multi: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' 2026-02-23T08:23:07.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1130: _scrub_snaps_multi: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 30 errors' 2026-02-23T08:23:07.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:07.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 30 errors' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1142: _scrub_snaps_multi: declare -a rep_err_strings 2026-02-23T08:23:07.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: eval echo '$primary' 2026-02-23T08:23:07.536 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: echo 1 2026-02-23T08:23:07.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: osd=1 2026-02-23T08:23:07.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1144: _scrub_snaps_multi: rep_err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' 2026-02-23T08:23:07.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1145: _scrub_snaps_multi: for err_string in "${rep_err_strings[@]}" 2026-02-23T08:23:07.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1147: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:07.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1154: _scrub_snaps_multi: '[' 0 '!=' 0 ']' 2026-02-23T08:23:07.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1160: _scrub_snaps_multi: echo 'TEST PASSED' 2026-02-23T08:23:07.538 INFO:tasks.workunit.client.0.trial129.stdout:TEST PASSED 2026-02-23T08:23:07.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1161: _scrub_snaps_multi: return 0 2026-02-23T08:23:07.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1179: TEST_scrub_snaps_primary: err=0 2026-02-23T08:23:07.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1180: TEST_scrub_snaps_primary: CEPH_ARGS='--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-23T08:23:07.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1181: TEST_scrub_snaps_primary: return 0 2026-02-23T08:23:07.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:40: run: teardown td/osd-scrub-snaps 2026-02-23T08:23:07.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:07.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:07.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:07.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:23:07.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:23:07.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:23:07.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:23:07.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:23:07.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:23:07.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:07.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:23:07.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:23:07.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:07.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:23:07.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:23:07.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:23:07.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:23:07.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:23:07.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:23:07.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:23:07.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:37: run: for func in $funcs 2026-02-23T08:23:07.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:38: run: setup td/osd-scrub-snaps 2026-02-23T08:23:07.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-snaps 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:07.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:07.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:07.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:23:07.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:23:07.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:23:07.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:23:07.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:23:07.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:23:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:07.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:23:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:23:07.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:07.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:23:07.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:23:07.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:23:07.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:23:07.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:23:07.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:23:07.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:23:07.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-snaps 2026-02-23T08:23:07.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:23:07.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.836428 2026-02-23T08:23:07.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-snaps 1' TERM HUP INT 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:39: run: TEST_scrub_snaps_replica td/osd-scrub-snaps 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1165: TEST_scrub_snaps_replica: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1166: TEST_scrub_snaps_replica: ORIG_ARGS='--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1167: TEST_scrub_snaps_replica: CEPH_ARGS+=' --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1168: TEST_scrub_snaps_replica: _scrub_snaps_multi td/osd-scrub-snaps replica 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:730: _scrub_snaps_multi: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:731: _scrub_snaps_multi: local poolname=test 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:732: _scrub_snaps_multi: local OBJS=16 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:733: _scrub_snaps_multi: local OSDS=2 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:734: _scrub_snaps_multi: local which=replica 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:736: _scrub_snaps_multi: TESTDATA=testdata.836428 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:738: _scrub_snaps_multi: run_mon td/osd-scrub-snaps a --osd_pool_default_size=2 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-snaps/a 2026-02-23T08:23:07.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-snaps/a --run-dir=td/osd-scrub-snaps --osd_pool_default_size=2 2026-02-23T08:23:07.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:23:07.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:23:07.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:23:07.595 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:23:07.595 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.595 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:07.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-snaps/a '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-snaps/log --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:23:07.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:23:07.620 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.621 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.621 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.836428/ceph-mon.a.asok 2026-02-23T08:23:07.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:23:07.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.836428/ceph-mon.a.asok config get fsid 2026-02-23T08:23:07.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:23:07.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:23:07.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.679 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.836428/ceph-mon.a.asok 2026-02-23T08:23:07.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:23:07.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.836428/ceph-mon.a.asok config get mon_host 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:739: _scrub_snaps_multi: run_mgr td/osd-scrub-snaps x 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-snaps/x 2026-02-23T08:23:07.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:07.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:23:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-snaps/x '--log-file=td/osd-scrub-snaps/$name.log' '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --run-dir=td/osd-scrub-snaps '--pid-file=td/osd-scrub-snaps/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:23:07.849 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: expr 2 - 1 2026-02-23T08:23:07.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: seq 0 1 2026-02-23T08:23:07.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:23:07.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 0 2026-02-23T08:23:07.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:23:07.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:23:07.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:23:07.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:23:07.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=180cd242-e8fc-46f2-8f01-2d501e5ce955 2026-02-23T08:23:07.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 180cd242-e8fc-46f2-8f01-2d501e5ce955' 2026-02-23T08:23:07.858 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 180cd242-e8fc-46f2-8f01-2d501e5ce955 2026-02-23T08:23:07.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:23:07.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBrDpxpQwmDMxAABx/W7pIRvLwo87P0EYDfbA== 2026-02-23T08:23:07.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBrDpxpQwmDMxAABx/W7pIRvLwo87P0EYDfbA=="}' 2026-02-23T08:23:07.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 180cd242-e8fc-46f2-8f01-2d501e5ce955 -i td/osd-scrub-snaps/0/new.json 2026-02-23T08:23:07.958 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:07.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/0/new.json 2026-02-23T08:23:07.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBrDpxpQwmDMxAABx/W7pIRvLwo87P0EYDfbA== --osd-uuid 180cd242-e8fc-46f2-8f01-2d501e5ce955 2026-02-23T08:23:07.985 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:07.983+0000 7febe434e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:07.986 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:07.984+0000 7febe434e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:07.987 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:07.985+0000 7febe434e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:07.987 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:07.985+0000 7febe434e780 -1 bdev(0x5625d1dbd400 td/osd-scrub-snaps/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:07.988 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:07.985+0000 7febe434e780 -1 bluestore(td/osd-scrub-snaps/0) _read_fsid unparsable uuid 2026-02-23T08:23:08.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/0/keyring 2026-02-23T08:23:08.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:23:08.421 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:23:08.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:23:08.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:23:08.522 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:23:08.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:23:08.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:23:08.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:23:08.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:23:08.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:23:08.538 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:08.536+0000 7fc391b7d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:08.541 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:08.539+0000 7fc391b7d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:08.541 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:08.540+0000 7fc391b7d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:08.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:23:08.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:23:08.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:23:08.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:23:08.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:23:08.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:08.620 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:08.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:23:08.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:08.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:23:08.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:23:08.745 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:08.743+0000 7fc391b7d780 -1 Falling back to public interface 2026-02-23T08:23:09.091 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:09.089+0000 7fc391b7d780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:23:09.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:23:09.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:09.718 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:09.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:23:09.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:09.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:23:09.813 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4269122426,v1:127.0.0.1:6801/4269122426] [v2:127.0.0.1:6802/4269122426,v1:127.0.0.1:6803/4269122426] exists,up 180cd242-e8fc-46f2-8f01-2d501e5ce955 2026-02-23T08:23:09.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:23:09.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:23:09.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:23:09.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:740: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:742: _scrub_snaps_multi: run_osd td/osd-scrub-snaps 1 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-23T08:23:09.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:09.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:23:09.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=66084b2c-c705-4cc2-8691-e62ade53c182 2026-02-23T08:23:09.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 66084b2c-c705-4cc2-8691-e62ade53c182' 2026-02-23T08:23:09.821 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 66084b2c-c705-4cc2-8691-e62ade53c182 2026-02-23T08:23:09.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:23:09.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBtDpxpwDVSMRAAuvrlywzr4nFDReIEzWl7LA== 2026-02-23T08:23:09.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBtDpxpwDVSMRAAuvrlywzr4nFDReIEzWl7LA=="}' 2026-02-23T08:23:09.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 66084b2c-c705-4cc2-8691-e62ade53c182 -i td/osd-scrub-snaps/1/new.json 2026-02-23T08:23:09.921 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:09.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-snaps/1/new.json 2026-02-23T08:23:09.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBtDpxpwDVSMRAAuvrlywzr4nFDReIEzWl7LA== --osd-uuid 66084b2c-c705-4cc2-8691-e62ade53c182 2026-02-23T08:23:09.948 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:09.946+0000 7f0e1060f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:09.949 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:09.948+0000 7f0e1060f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:09.951 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:09.948+0000 7f0e1060f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:09.951 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:09.949+0000 7f0e1060f780 -1 bdev(0x55e41a8ef400 td/osd-scrub-snaps/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:09.951 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:09.949+0000 7f0e1060f780 -1 bluestore(td/osd-scrub-snaps/1) _read_fsid unparsable uuid 2026-02-23T08:23:10.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-snaps/1/keyring 2026-02-23T08:23:10.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:23:10.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:23:10.347 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:23:10.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-snaps/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:23:10.557 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:23:10.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:23:10.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:23:10.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:23:10.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:23:10.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:23:10.574 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:10.572+0000 7f71fb47e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:10.575 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:10.574+0000 7f71fb47e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:10.576 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:10.575+0000 7f71fb47e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:10.700 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:10.698+0000 7f71fb47e780 -1 Falling back to public interface 2026-02-23T08:23:10.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:23:10.726 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:10.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:10.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:23:10.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:23:11.045 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:11.043+0000 7f71fb47e780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:23:11.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:23:11.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:11.894 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:11.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:23:11.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:11.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:23:12.063 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/64581681,v1:127.0.0.1:6811/64581681] [v2:127.0.0.1:6812/64581681,v1:127.0.0.1:6813/64581681] exists,up 66084b2c-c705-4cc2-8691-e62ade53c182 2026-02-23T08:23:12.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:23:12.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:23:12.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:23:12.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:746: _scrub_snaps_multi: ceph osd set noscrub 2026-02-23T08:23:12.306 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:23:12.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:747: _scrub_snaps_multi: ceph osd set nodeep-scrub 2026-02-23T08:23:12.507 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:23:12.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:750: _scrub_snaps_multi: create_pool test 1 1 2026-02-23T08:23:12.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:23:12.710 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:23:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:23:13.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:751: _scrub_snaps_multi: wait_for_clean 2026-02-23T08:23:13.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:23:13.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:23:13.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:23:13.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:23:13.724 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:23:13.724 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:23:13.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:23:13.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:23:13.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:23:13.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:23:13.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:23:13.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:23:13.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:23:13.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:23:13.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:23:13.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:23:13.977 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:23:13.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:23:13.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:23:13.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:23:14.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836482 2026-02-23T08:23:14.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836482 2026-02-23T08:23:14.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482' 2026-02-23T08:23:14.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:23:14.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:23:14.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672962 2026-02-23T08:23:14.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672962 2026-02-23T08:23:14.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836482 1-42949672962' 2026-02-23T08:23:14.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:23:14.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836482 2026-02-23T08:23:14.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:23:14.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:23:14.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836482 2026-02-23T08:23:14.132 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:23:14.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836482 2026-02-23T08:23:14.133 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836482 2026-02-23T08:23:14.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836482' 2026-02-23T08:23:14.134 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:14.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:23:14.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:23:15.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:23:15.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:15.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836481 -lt 21474836482 2026-02-23T08:23:15.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:23:16.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:23:16.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:16.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836482 2026-02-23T08:23:16.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:23:16.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672962 2026-02-23T08:23:16.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:23:16.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:23:16.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672962 2026-02-23T08:23:16.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:23:16.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672962 2026-02-23T08:23:16.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672962' 2026-02-23T08:23:16.644 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672962 2026-02-23T08:23:16.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:23:16.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672962 -lt 42949672962 2026-02-23T08:23:16.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:23:16.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:23:16.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:23:17.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:23:17.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:23:17.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:23:17.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:23:17.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:23:17.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:23:17.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:23:17.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:23:17.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:23:17.189 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:23:17.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:23:17.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:23:17.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:23:17.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:23:17.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:23:17.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: ceph osd dump 2026-02-23T08:23:17.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: grep '^pool.*['\'']test['\'']' 2026-02-23T08:23:17.397 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: awk '{ print $2 }' 2026-02-23T08:23:17.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:752: _scrub_snaps_multi: poolid=1 2026-02-23T08:23:17.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:754: _scrub_snaps_multi: dd if=/dev/urandom of=testdata.836428 bs=1032 count=1 2026-02-23T08:23:17.564 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:23:17.564 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:23:17.564 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 2.2833e-05 s, 45.2 MB/s 2026-02-23T08:23:17.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: seq 1 16 2026-02-23T08:23:17.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj1 testdata.836428 2026-02-23T08:23:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj2 testdata.836428 2026-02-23T08:23:17.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj3 testdata.836428 2026-02-23T08:23:17.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj4 testdata.836428 2026-02-23T08:23:17.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj5 testdata.836428 2026-02-23T08:23:17.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj6 testdata.836428 2026-02-23T08:23:17.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj7 testdata.836428 2026-02-23T08:23:17.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj8 testdata.836428 2026-02-23T08:23:17.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj9 testdata.836428 2026-02-23T08:23:17.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj10 testdata.836428 2026-02-23T08:23:17.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj11 testdata.836428 2026-02-23T08:23:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj12 testdata.836428 2026-02-23T08:23:17.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj13 testdata.836428 2026-02-23T08:23:17.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj14 testdata.836428 2026-02-23T08:23:17.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj15 testdata.836428 2026-02-23T08:23:17.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:755: _scrub_snaps_multi: for i in `seq 1 $OBJS` 2026-02-23T08:23:17.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:757: _scrub_snaps_multi: rados -p test put obj16 testdata.836428 2026-02-23T08:23:17.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: get_primary test obj1 2026-02-23T08:23:17.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:23:17.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:23:17.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:23:17.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:23:18.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:760: _scrub_snaps_multi: local primary=1 2026-02-23T08:23:18.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: get_not_primary test obj1 2026-02-23T08:23:18.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2026-02-23T08:23:18.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-23T08:23:18.021 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2026-02-23T08:23:18.021 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:23:18.021 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:23:18.021 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:23:18.021 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:23:18.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:23:18.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2026-02-23T08:23:18.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:23:18.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:761: _scrub_snaps_multi: local replica=0 2026-02-23T08:23:18.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: eval create_scenario td/osd-scrub-snaps test testdata.836428 '$replica' 2026-02-23T08:23:18.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:763: _scrub_snaps_multi: create_scenario td/osd-scrub-snaps test testdata.836428 0 2026-02-23T08:23:18.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:45: create_scenario: local dir=td/osd-scrub-snaps 2026-02-23T08:23:18.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:46: create_scenario: local poolname=test 2026-02-23T08:23:18.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:47: create_scenario: local TESTDATA=testdata.836428 2026-02-23T08:23:18.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:48: create_scenario: local osd=0 2026-02-23T08:23:18.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:50: create_scenario: SNAP=1 2026-02-23T08:23:18.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:51: create_scenario: rados -p test mksnap snap1 2026-02-23T08:23:18.428 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap1 2026-02-23T08:23:18.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:52: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=1 2026-02-23T08:23:18.431 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:23:18.431 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:23:18.431 INFO:tasks.workunit.client.0.trial129.stderr:256 bytes copied, 3.7891e-05 s, 6.8 MB/s 2026-02-23T08:23:18.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:53: create_scenario: rados -p test put obj1 testdata.836428 2026-02-23T08:23:18.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:54: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:23:18.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:55: create_scenario: rados -p test put obj3 testdata.836428 2026-02-23T08:23:18.486 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: seq 6 14 2026-02-23T08:23:18.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj6 testdata.836428 2026-02-23T08:23:18.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj7 testdata.836428 2026-02-23T08:23:18.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj8 testdata.836428 2026-02-23T08:23:18.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj9 testdata.836428 2026-02-23T08:23:18.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj10 testdata.836428 2026-02-23T08:23:18.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.572 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj11 testdata.836428 2026-02-23T08:23:18.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj12 testdata.836428 2026-02-23T08:23:18.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj13 testdata.836428 2026-02-23T08:23:18.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:56: create_scenario: for i in `seq 6 14` 2026-02-23T08:23:18.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:57: create_scenario: rados -p test put obj14 testdata.836428 2026-02-23T08:23:18.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:60: create_scenario: SNAP=2 2026-02-23T08:23:18.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:61: create_scenario: rados -p test mksnap snap2 2026-02-23T08:23:18.705 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap2 2026-02-23T08:23:18.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:62: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=2 2026-02-23T08:23:18.707 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records in 2026-02-23T08:23:18.707 INFO:tasks.workunit.client.0.trial129.stderr:2+0 records out 2026-02-23T08:23:18.707 INFO:tasks.workunit.client.0.trial129.stderr:512 bytes copied, 3.8352e-05 s, 13.4 MB/s 2026-02-23T08:23:18.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:63: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:23:18.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:65: create_scenario: SNAP=3 2026-02-23T08:23:18.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:66: create_scenario: rados -p test mksnap snap3 2026-02-23T08:23:18.807 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap3 2026-02-23T08:23:18.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:67: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=3 2026-02-23T08:23:18.811 INFO:tasks.workunit.client.0.trial129.stderr:3+0 records in 2026-02-23T08:23:18.811 INFO:tasks.workunit.client.0.trial129.stderr:3+0 records out 2026-02-23T08:23:18.811 INFO:tasks.workunit.client.0.trial129.stderr:768 bytes copied, 4.8601e-05 s, 15.8 MB/s 2026-02-23T08:23:18.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:68: create_scenario: rados -p test put obj3 testdata.836428 2026-02-23T08:23:18.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:70: create_scenario: SNAP=4 2026-02-23T08:23:18.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:71: create_scenario: rados -p test mksnap snap4 2026-02-23T08:23:18.909 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap4 2026-02-23T08:23:18.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:72: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=4 2026-02-23T08:23:18.911 INFO:tasks.workunit.client.0.trial129.stderr:4+0 records in 2026-02-23T08:23:18.911 INFO:tasks.workunit.client.0.trial129.stderr:4+0 records out 2026-02-23T08:23:18.911 INFO:tasks.workunit.client.0.trial129.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 3.763e-05 s, 27.2 MB/s 2026-02-23T08:23:18.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:73: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:23:18.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:74: create_scenario: rados -p test put obj2 testdata.836428 2026-02-23T08:23:18.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:76: create_scenario: SNAP=5 2026-02-23T08:23:18.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:77: create_scenario: rados -p test mksnap snap5 2026-02-23T08:23:19.009 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap5 2026-02-23T08:23:19.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:78: create_scenario: SNAP=6 2026-02-23T08:23:19.011 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:79: create_scenario: rados -p test mksnap snap6 2026-02-23T08:23:19.111 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap6 2026-02-23T08:23:19.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:80: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=6 2026-02-23T08:23:19.116 INFO:tasks.workunit.client.0.trial129.stderr:6+0 records in 2026-02-23T08:23:19.116 INFO:tasks.workunit.client.0.trial129.stderr:6+0 records out 2026-02-23T08:23:19.116 INFO:tasks.workunit.client.0.trial129.stderr:1536 bytes (1.5 kB, 1.5 KiB) copied, 5.7778e-05 s, 26.6 MB/s 2026-02-23T08:23:19.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:81: create_scenario: rados -p test put obj5 testdata.836428 2026-02-23T08:23:19.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:83: create_scenario: SNAP=7 2026-02-23T08:23:19.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:84: create_scenario: rados -p test mksnap snap7 2026-02-23T08:23:19.213 INFO:tasks.workunit.client.0.trial129.stdout:created pool test snap snap7 2026-02-23T08:23:19.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:86: create_scenario: rados -p test rm obj4 2026-02-23T08:23:19.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:87: create_scenario: rados -p test rm obj16 2026-02-23T08:23:19.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:88: create_scenario: rados -p test rm obj2 2026-02-23T08:23:19.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:90: create_scenario: kill_daemons td/osd-scrub-snaps TERM osd 2026-02-23T08:23:19.270 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:19.270 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:19.270 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:19.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:19.271 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:19.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:19.577 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj1 2026-02-23T08:23:19.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:94: create_scenario: JSON='["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:19.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:95: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj1","key":"","snapid":-2,"hash":1828249343,"max":0,"pool":1,"namespace":"","max":0}]' --force remove 2026-02-23T08:23:19.815 INFO:tasks.workunit.client.0.trial129.stdout:WARNING: only removing head with clones present 2026-02-23T08:23:19.815 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:ff7b1f36:::obj1:head# 2026-02-23T08:23:19.875 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-23T08:23:19.875 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: grep '"snapid":2' 2026-02-23T08:23:19.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:97: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:19.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:98: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":2,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:23:20.072 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:2# 2026-02-23T08:23:20.130 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-23T08:23:20.130 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: grep '"snapid":1' 2026-02-23T08:23:20.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:100: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:20.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:101: create_scenario: OBJ5SAVE='["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:20.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:103: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:23:20.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:104: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:23:20.377 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.378 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:20.379 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:20.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:105: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:23:20.381 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:23:20.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:106: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype nosnapmap '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:23:20.480 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:c52c9666:::obj5:1# 2026-02-23T08:23:20.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:108: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:23:20.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:109: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:23:20.661 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.661 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:23:20.661 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.661 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:23:20.661 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.0779578A.7.obj4.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:20.662 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:20.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:110: create_scenario: grep '^[pm].*SNA_.*[.]1[.]obj5[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:23:20.663 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:23:20.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:111: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-23T08:23:20.664 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj5 2026-02-23T08:23:20.664 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: grep '"snapid":4' 2026-02-23T08:23:20.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:113: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:20.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:114: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=18 2026-02-23T08:23:20.753 INFO:tasks.workunit.client.0.trial129.stderr:18+0 records in 2026-02-23T08:23:20.753 INFO:tasks.workunit.client.0.trial129.stderr:18+0 records out 2026-02-23T08:23:20.753 INFO:tasks.workunit.client.0.trial129.stderr:4608 bytes (4.6 kB, 4.5 KiB) copied, 7.6854e-05 s, 60.0 MB/s 2026-02-23T08:23:20.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:115: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":4,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:23:20.915 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj3 2026-02-23T08:23:21.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:117: create_scenario: JSON='["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:21.009 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:118: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=15 2026-02-23T08:23:21.010 INFO:tasks.workunit.client.0.trial129.stderr:15+0 records in 2026-02-23T08:23:21.010 INFO:tasks.workunit.client.0.trial129.stderr:15+0 records out 2026-02-23T08:23:21.010 INFO:tasks.workunit.client.0.trial129.stderr:3840 bytes (3.8 kB, 3.8 KiB) copied, 7.0953e-05 s, 54.1 MB/s 2026-02-23T08:23:21.010 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:119: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj3","key":"","snapid":-2,"hash":1643547569,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:23:21.200 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj4 2026-02-23T08:23:21.200 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: grep '"snapid":7' 2026-02-23T08:23:21.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:121: create_scenario: JSON='["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:21.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:122: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj4","key":"","snapid":7,"hash":2826278768,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:23:21.389 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:0ee9ae15:::obj4:7# 2026-02-23T08:23:21.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:125: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:23:21.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:126: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:23:21.568 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:23:21.568 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.568 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:23:21.569 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:21.570 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:21.571 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.571 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:21.571 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:21.571 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.571 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:21.571 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:127: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.572 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.268F1DA7.7.obj16.. 2026-02-23T08:23:21.573 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --op list obj16 2026-02-23T08:23:21.573 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: grep '"snapid":7' 2026-02-23T08:23:21.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:128: create_scenario: JSON='["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:21.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:129: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --rmtype snapmap '["1.0",{"oid":"obj16","key":"","snapid":7,"hash":2060580962,"max":0,"pool":1,"namespace":"","max":0}]' remove 2026-02-23T08:23:21.780 INFO:tasks.workunit.client.0.trial129.stdout:remove #1:461f8b5e:::obj16:7# 2026-02-23T08:23:21.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:131: create_scenario: ceph-kvstore-tool bluestore-kv td/osd-scrub-snaps/0 list 2026-02-23T08:23:21.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:132: create_scenario: grep SNA_ td/osd-scrub-snaps/drk.log 2026-02-23T08:23:21.973 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.1BB86F16.1.obj3.. 2026-02-23T08:23:21.973 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.3A439666.1.obj5.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.4CC52438.1.obj6.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5685B6C7.1.obj13.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5AAE7FD8.1.obj8.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.5FAF9A3D.1.obj12.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.70522149.1.obj14.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.77574592.1.obj11.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.950988C5.1.obj7.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.B8CCECA2.1.obj10.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.F7CA874E.1.obj9.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000001_0000000000000001.FFED8FC6.1.obj1.. 2026-02-23T08:23:21.974 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000002_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.1BB86F16.3.obj3.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000003_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.3A439666.4.obj5.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000004_0000000000000001.802EE1F3.4.obj2.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000005_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.3A439666.6.obj5.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000006_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:21.975 INFO:tasks.workunit.client.0.trial129.stdout:p %00%00%00%00%00%00%00%00%c07%16%25%00%00%00%00%00%00%04%02.SNA_1_0000000000000007_0000000000000001.802EE1F3.7.obj2.. 2026-02-23T08:23:21.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:133: create_scenario: grep '^[pm].*SNA_.*[.]7[.]obj16[.][.]$' td/osd-scrub-snaps/drk.log 2026-02-23T08:23:21.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:134: create_scenario: rm -f td/osd-scrub-snaps/drk.log 2026-02-23T08:23:21.976 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj2 2026-02-23T08:23:22.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:136: create_scenario: JSON='["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:22.064 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:137: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj2","key":"","snapid":-2,"hash":1058988552,"max":0,"pool":1,"namespace":"","max":0}]' rm-attr snapset 2026-02-23T08:23:22.230 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: echo '["1.0",{"oid":"obj5","key":"","snapid":1,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:22.230 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: sed 's/snapid":1/snapid":7/' 2026-02-23T08:23:22.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:140: create_scenario: JSON='["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:22.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:141: create_scenario: dd if=/dev/urandom of=testdata.836428 bs=256 count=7 2026-02-23T08:23:22.232 INFO:tasks.workunit.client.0.trial129.stderr:7+0 records in 2026-02-23T08:23:22.232 INFO:tasks.workunit.client.0.trial129.stderr:7+0 records out 2026-02-23T08:23:22.232 INFO:tasks.workunit.client.0.trial129.stderr:1792 bytes (1.8 kB, 1.8 KiB) copied, 4.7429e-05 s, 37.8 MB/s 2026-02-23T08:23:22.232 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:142: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj5","key":"","snapid":7,"hash":1718170787,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes testdata.836428 2026-02-23T08:23:22.371 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj6 2026-02-23T08:23:22.424 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:22.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:144: create_scenario: JSON='["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:22.466 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:145: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj6","key":"","snapid":-2,"hash":2202164420,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-23T08:23:22.619 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj7 2026-02-23T08:23:22.675 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:22.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:146: create_scenario: JSON='["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:22.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:147: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj7","key":"","snapid":-2,"hash":1552453721,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset corrupt 2026-02-23T08:23:22.897 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj8 2026-02-23T08:23:22.944 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:22.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:148: create_scenario: JSON='["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:22.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:149: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj8","key":"","snapid":-2,"hash":2381834917,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset seq 2026-02-23T08:23:23.133 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj9 2026-02-23T08:23:23.192 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:23.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:150: create_scenario: JSON='["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:23.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:151: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj9","key":"","snapid":-2,"hash":3833113727,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_size 2026-02-23T08:23:23.401 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj10 2026-02-23T08:23:23.447 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:23.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:152: create_scenario: JSON='["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:23.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:153: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj10","key":"","snapid":-2,"hash":718195851,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clone_overlap 2026-02-23T08:23:23.652 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj11 2026-02-23T08:23:23.714 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:23.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:154: create_scenario: JSON='["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:23.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:155: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj11","key":"","snapid":-2,"hash":693400951,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset clones 2026-02-23T08:23:23.900 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj13 2026-02-23T08:23:23.952 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:24.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:156: create_scenario: JSON='["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:24.002 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:157: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj13","key":"","snapid":-2,"hash":2087409765,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset snaps 2026-02-23T08:23:24.164 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj14 2026-02-23T08:23:24.210 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:24.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:158: create_scenario: JSON='["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:24.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:159: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj14","key":"","snapid":-2,"hash":2484217095,"max":0,"pool":1,"namespace":"","max":0}]' clear-snapset size 2026-02-23T08:23:24.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:161: create_scenario: echo garbage 2026-02-23T08:23:24.412 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 --head --op list obj15 2026-02-23T08:23:24.465 INFO:tasks.workunit.client.0.trial129.stderr:Error getting attr on : 1.0_head,#1:c52c9666:::obj5:7#, (61) No data available 2026-02-23T08:23:24.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:162: create_scenario: JSON='["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:23:24.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:163: create_scenario: ceph-objectstore-tool --data-path td/osd-scrub-snaps/0 '["1.0",{"oid":"obj15","key":"","snapid":-2,"hash":612772309,"max":0,"pool":1,"namespace":"","max":0}]' set-attr snapset td/osd-scrub-snaps/bad 2026-02-23T08:23:24.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:164: create_scenario: rm -f td/osd-scrub-snaps/bad 2026-02-23T08:23:24.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:165: create_scenario: return 0 2026-02-23T08:23:24.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:765: _scrub_snaps_multi: rm -f testdata.836428 2026-02-23T08:23:24.694 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: expr 2 - 1 2026-02-23T08:23:24.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: seq 0 1 2026-02-23T08:23:24.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:23:24.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 0 2026-02-23T08:23:24.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:23:24.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/0 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/0' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/0/journal' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:24.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/0 2026-02-23T08:23:24.698 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:23:24.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-23T08:23:24.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/0 --osd-journal=td/osd-scrub-snaps/0/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:23:24.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/0/whoami 2026-02-23T08:23:24.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-23T08:23:24.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:23:24.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:23:24.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:23:24.715 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:24.713+0000 7f686a40e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:24.716 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:24.715+0000 7f686a40e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:24.717 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:24.715+0000 7f686a40e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:24.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:23:24.871 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:24.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:24.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:23:24.895 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:24.893+0000 7f686a40e780 -1 Falling back to public interface 2026-02-23T08:23:25.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:23:25.282 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:25.280+0000 7f686a40e780 -1 osd.0 23 log_to_monitors true 2026-02-23T08:23:26.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:23:26.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:26.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:23:26.042 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:26.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:26.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:23:26.213 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 26 up_thru 26 down_at 24 last_clean_interval [5,23) [v2:127.0.0.1:6800/1487528585,v1:127.0.0.1:6801/1487528585] [v2:127.0.0.1:6802/1487528585,v1:127.0.0.1:6803/1487528585] exists,up 180cd242-e8fc-46f2-8f01-2d501e5ce955 2026-02-23T08:23:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:23:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:23:26.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:767: _scrub_snaps_multi: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:769: _scrub_snaps_multi: activate_osd td/osd-scrub-snaps 1 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-snaps 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-snaps/1 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1' 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:23:26.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-snaps/1' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-snaps/1/journal' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-snaps' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:26.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-snaps/$name.log' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-snaps/$name.pid' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-snaps/1 2026-02-23T08:23:26.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:23:26.221 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:23:26.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 --osd_scrub_chunk_min=3 --osd_scrub_chunk_max=20 --osd_shallow_scrub_chunk_min=3 --osd_shallow_scrub_chunk_max=3 --osd_pg_stat_report_interval_max_seconds=1 --osd_pg_stat_report_interval_max_epochs=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-snaps/1 --osd-journal=td/osd-scrub-snaps/1/journal --chdir= --run-dir=td/osd-scrub-snaps '--admin-socket=/tmp/ceph-asok.836428/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-snaps/$name.log' '--pid-file=td/osd-scrub-snaps/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:23:26.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-snaps/1/whoami 2026-02-23T08:23:26.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:23:26.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:23:26.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:23:26.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:23:26.233 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:26.231+0000 7f8a09d50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:26.234 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:26.232+0000 7f8a09d50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:26.235 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:26.233+0000 7f8a09d50780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:26.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:23:26.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:23:26.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:23:26.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:23:26.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:23:26.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:26.388 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:26.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:23:26.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:26.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:23:26.439 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:26.437+0000 7f8a09d50780 -1 Falling back to public interface 2026-02-23T08:23:26.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:23:26.778 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:26.776+0000 7f8a09d50780 -1 osd.1 23 log_to_monitors true 2026-02-23T08:23:27.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:23:27.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:23:27.556 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:23:27.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:23:27.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:23:27.723 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 29 up_thru 29 down_at 24 last_clean_interval [10,23) [v2:127.0.0.1:6810/2152117827,v1:127.0.0.1:6811/2152117827] [v2:127.0.0.1:6812/2152117827,v1:127.0.0.1:6813/2152117827] exists,up 66084b2c-c705-4cc2-8691-e62ade53c182 2026-02-23T08:23:27.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:23:27.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:23:27.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:23:27.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:772: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 3 2026-02-23T08:23:27.791 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:23:27.791 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T08:23:27.791 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:27.799 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:23:27.799 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_shallow_scrub_chunk_max = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-23T08:23:27.799 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:27.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:773: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_min 3 2026-02-23T08:23:27.877 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:23:27.877 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-23T08:23:27.877 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:27.883 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:23:27.884 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_min = '' " 2026-02-23T08:23:27.884 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:27.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:774: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_scrub_chunk_min 3 2026-02-23T08:23:27.962 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:23:27.963 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-23T08:23:27.963 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:27.969 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:23:27.969 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_min = '' " 2026-02-23T08:23:27.969 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:27.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:775: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_seconds 1 2026-02-23T08:23:28.047 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:23:28.047 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-23T08:23:28.047 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:28.054 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:23:28.054 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_seconds = '' " 2026-02-23T08:23:28.054 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:28.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:776: _scrub_snaps_multi: ceph tell 'osd.*' config set osd_pg_stat_report_interval_max_epochs 1 2026-02-23T08:23:28.132 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:23:28.132 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-23T08:23:28.132 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:28.139 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:23:28.139 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_pg_stat_report_interval_max_epochs = '' " 2026-02-23T08:23:28.139 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:28.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:777: _scrub_snaps_multi: wait_for_clean 2026-02-23T08:23:28.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:23:28.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:23:28.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:23:28.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:23:28.151 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:23:28.151 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:23:28.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:23:28.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:23:28.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:23:28.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:23:28.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:23:28.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:23:28.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:23:28.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:23:28.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:23:28.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:23:28.395 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:23:28.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:23:28.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:23:28.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:23:28.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149698 2026-02-23T08:23:28.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149698 2026-02-23T08:23:28.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149698' 2026-02-23T08:23:28.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:23:28.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:23:28.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051586 2026-02-23T08:23:28.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051586 2026-02-23T08:23:28.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149698 1-124554051586' 2026-02-23T08:23:28.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:23:28.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-111669149698 2026-02-23T08:23:28.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:23:28.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:23:28.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-111669149698 2026-02-23T08:23:28.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:23:28.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149698 2026-02-23T08:23:28.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 111669149698' 2026-02-23T08:23:28.557 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 111669149698 2026-02-23T08:23:28.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:28.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 111669149698 2026-02-23T08:23:28.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:23:29.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:23:29.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:29.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149698 -lt 111669149698 2026-02-23T08:23:29.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:23:29.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-124554051586 2026-02-23T08:23:29.902 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:23:29.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:23:29.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-124554051586 2026-02-23T08:23:29.904 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:23:29.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051586 2026-02-23T08:23:29.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 124554051586' 2026-02-23T08:23:29.905 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 124554051586 2026-02-23T08:23:29.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:23:30.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051586 2026-02-23T08:23:30.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:23:30.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:23:30.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:23:30.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:23:30.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:23:30.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:23:30.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:23:30.445 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:23:30.445 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:23:30.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:23:30.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:779: _scrub_snaps_multi: local pgid=1.0 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:780: _scrub_snaps_multi: pg_scrub 1.0 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:23:30.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:23:30.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:23:30.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:23:30.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:23:30.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:23:30.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:23:30.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:23:31.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:23:31.012 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:23:31.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:23:31.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:23:31.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:23:31.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149700 2026-02-23T08:23:31.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149700 2026-02-23T08:23:31.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149700' 2026-02-23T08:23:31.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:23:31.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:23:31.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051587 2026-02-23T08:23:31.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051587 2026-02-23T08:23:31.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-111669149700 1-124554051587' 2026-02-23T08:23:31.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:23:31.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-111669149700 2026-02-23T08:23:31.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:23:31.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:23:31.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-111669149700 2026-02-23T08:23:31.171 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:23:31.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=111669149700 2026-02-23T08:23:31.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 111669149700' 2026-02-23T08:23:31.172 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 111669149700 2026-02-23T08:23:31.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:31.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149698 -lt 111669149700 2026-02-23T08:23:31.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:23:32.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:23:32.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:23:32.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 111669149700 -lt 111669149700 2026-02-23T08:23:32.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:23:32.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-124554051587 2026-02-23T08:23:32.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:23:32.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:23:32.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-124554051587 2026-02-23T08:23:32.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:23:32.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051587 2026-02-23T08:23:32.521 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 124554051587 2026-02-23T08:23:32.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 124554051587' 2026-02-23T08:23:32.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:23:32.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051587 -lt 124554051587 2026-02-23T08:23:32.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:23:32.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-23T08:23:32.689 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 1.0 loop 0 2026-02-23T08:23:32.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-23T08:23:32.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-23T08:23:32.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:23:32.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-23T08:23:32.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:23:32.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:23:32.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:23:32.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:23:32.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:23:32.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-23T08:23:32.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:23:32.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:23:32.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:23:32.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:23:32.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:32.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-23T08:23:33.095 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to scrub 2026-02-23T08:23:33.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:33.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:23:33.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:33.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:23:33.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:23:33.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:23:12.707905+0000 '>' 2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:33.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:23:34.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:23:34.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:23:34.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:23:34.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:23:34.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:23:34.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:23:34.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:23:34.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:23:12.707905+0000 '>' 2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:34.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:23:35.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:23:35.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:23:35.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:23:35.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:23:35.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:23:35.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:23:35.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:23:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:23:12.707905+0000 '>' 2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:35.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:23:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:23:36.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:23:36.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:23:36.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:23:36.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:23:36.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:23:36.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:23:36.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:23:12.707905+0000 '>' 2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:36.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:23:37.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:23:37.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 300 )) 2026-02-23T08:23:37.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:23:37.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:23:37.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:23:37.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:23:37.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:23:37.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:23:33.881707+0000 '>' 2026-02-23T08:23:12.707905+0000 2026-02-23T08:23:37.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:23:37.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:37.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: wc -l 2026-02-23T08:23:37.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:784: _scrub_snaps_multi: test 16 -gt 3 2026-02-23T08:23:37.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: grep '_scan_snaps start' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:23:37.969 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: wc -l 2026-02-23T08:23:37.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:785: _scrub_snaps_multi: test 16 -gt 3 2026-02-23T08:23:37.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:787: _scrub_snaps_multi: rados list-inconsistent-pg test 2026-02-23T08:23:37.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: jq '. | length' td/osd-scrub-snaps/json 2026-02-23T08:23:37.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:789: _scrub_snaps_multi: test 1 = 1 2026-02-23T08:23:37.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: jq -r '.[0]' td/osd-scrub-snaps/json 2026-02-23T08:23:37.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:791: _scrub_snaps_multi: test 1.0 = 1.0 2026-02-23T08:23:37.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:793: _scrub_snaps_multi: rados list-inconsistent-obj 1.0 --format=json-pretty 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "epoch": 29, 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "inconsistents": [ 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj1", 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.009 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "version": 18 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "missing" 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj1", 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.010 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1828249343, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'18", 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'1", 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4220.0:1", 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 18, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.445281+0000", 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.446431+0000", 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.011 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.012 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "missing" 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.013 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj10", 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.014 INFO:tasks.workunit.client.0.trial129.stdout: "version": 32 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj10", 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 718195851, 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.015 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'32", 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'10", 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4241.0:1", 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 32, 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.570253+0000", 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.570545+0000", 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.016 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.017 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.018 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "????", 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.019 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.020 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj11", 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "version": 34 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.021 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj11", 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 693400951, 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.022 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'34", 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'11", 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4244.0:1", 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 34, 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.586543+0000", 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.586844+0000", 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.023 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.024 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.025 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.026 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj13", 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "version": 38 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.027 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj13", 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2087409765, 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'38", 2026-02-23T08:23:38.028 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'13", 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4250.0:1", 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 38, 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.619578+0000", 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.619896+0000", 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.029 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.030 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]" 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.031 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.032 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.033 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj14", 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "version": 40 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.034 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj14", 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2484217095, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'40", 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'14", 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4253.0:1", 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 40, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.635930+0000", 2026-02-23T08:23:38.035 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.636317+0000", 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.036 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.037 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1033, 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.038 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.039 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj15", 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.040 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "version": 15 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_corrupted" 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj15", 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 612772309, 2026-02-23T08:23:38.041 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "version": "16'15", 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "0'0", 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4205.0:1", 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 15, 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:17.827458+0000", 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:17.827750+0000", 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.042 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xe9316540", 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.043 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_corrupted" 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": "Z2FyYmFnZQo=" 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.044 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj2", 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.045 INFO:tasks.workunit.client.0.trial129.stdout: "version": 56 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_missing" 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj2", 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1058988552, 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.046 INFO:tasks.workunit.client.0.trial129.stdout: "version": "23'56", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "20'48", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4295.0:1", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 56, 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "size": 0, 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:19.266865+0000", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:19.267149+0000", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "whiteout", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "dirty" 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0xffffffff", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.047 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_missing" 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.048 INFO:tasks.workunit.client.0.trial129.stdout: "size": 0 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "size": 0, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 7, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 4, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: 4, 2026-02-23T08:23:38.049 INFO:tasks.workunit.client.0.trial129.stdout: 3, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: 2, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 7, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1024, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: 7, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: 6, 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: 5 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.050 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj3", 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "version": 44 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "size_mismatch" 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [ 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "size_mismatch_info", 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "obj_size_info_mismatch" 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.051 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj3", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1643547569, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "version": "19'44", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "17'22", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4265.0:1", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 44, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "size": 768, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.827444+0000", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.827777+0000", 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.052 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x65ebcf8a", 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.053 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "size_mismatch_info", 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "obj_size_info_mismatch" 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "size": 3840, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "object_info": { 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj3", 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1643547569, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.054 INFO:tasks.workunit.client.0.trial129.stdout: "version": "19'44", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "17'22", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4265.0:1", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 44, 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "size": 768, 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.827444+0000", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.827777+0000", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x65ebcf8a", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.055 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "size": 768 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.056 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj6", 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "version": 24 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj6", 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2202164420, 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.057 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'24", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'6", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4229.0:1", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 24, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.502253+0000", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.502576+0000", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.058 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.059 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj7", 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: "version": 26 2026-02-23T08:23:38.060 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj7", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 1552453721, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'26", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'7", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4232.0:1", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 26, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.519665+0000", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.519954+0000", 2026-02-23T08:23:38.061 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.062 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [] 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.063 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj8", 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "version": 28 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj8", 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 2381834917, 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.064 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'28", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'8", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4235.0:1", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 28, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.536436+0000", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.536729+0000", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.065 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 0, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.066 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.067 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "object": { 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "name": "obj9", 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "nspace": "", 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "locator": "", 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "snap": "head", 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "version": 30 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [ 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "snapset_inconsistency" 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "union_shard_errors": [], 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "selected_object_info": { 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "oid": { 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "oid": "obj9", 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "key": "", 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "snapid": -2, 2026-02-23T08:23:38.068 INFO:tasks.workunit.client.0.trial129.stdout: "hash": 3833113727, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "max": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "pool": 1, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "namespace": "" 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "version": "17'30", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "prior_version": "16'9", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "last_reqid": "client.4238.0:1", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "user_version": 30, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "mtime": "2026-02-23T08:23:18.553006+0000", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "local_mtime": "2026-02-23T08:23:18.553288+0000", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "lost": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "flags": [ 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "dirty", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest" 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_seq": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "truncate_size": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "data_digest": "0x3c056cf8", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "omap_digest": "0xffffffff", 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "expected_object_size": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "expected_write_size": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "alloc_hint_flags": 0, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "manifest": { 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "type": 0 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.069 INFO:tasks.workunit.client.0.trial129.stdout: "watchers": {}, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "shard_versions": [] 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "shards": [ 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 0, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "primary": false, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "size": "????", 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "osd": 1, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "primary": true, 2026-02-23T08:23:38.070 INFO:tasks.workunit.client.0.trial129.stdout: "errors": [], 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "size": 256, 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "snapset": { 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "seq": 1, 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "clones": [ 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "snap": 1, 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "size": 1032, 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "overlap": "[]", 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: "snaps": [ 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: 1 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:23:38.071 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:23:38.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:795: _scrub_snaps_multi: rados list-inconsistent-snapset 1.0 2026-02-23T08:23:38.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:798: _scrub_snaps_multi: '[' replica = replica ']' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:800: _scrub_snaps_multi: scruberrors=20 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:801: _scrub_snaps_multi: jq .inconsistents 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:801: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: jq .inconsistents td/osd-scrub-snaps/json 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1064: _scrub_snaps_multi: python3 -c 'import json; import sys ; JSON=sys.stdin.read() ; ud = json.loads(JSON) ; print ( json.dumps(ud, sort_keys=True, indent=2) )' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1065: _scrub_snaps_multi: multidiff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: multidiff: diff td/osd-scrub-snaps/checkcsjson td/osd-scrub-snaps/csjson 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1066: _scrub_snaps_multi: test no = yes 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1071: _scrub_snaps_multi: test '' = yes 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: find td/osd-scrub-snaps 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: grep 'osd[^/]*\.pid' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1076: _scrub_snaps_multi: pidfiles='td/osd-scrub-snaps/osd.0.pid 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:td/osd-scrub-snaps/osd.1.pid' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1077: _scrub_snaps_multi: pids= 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.0.pid 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='887525 ' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1078: _scrub_snaps_multi: for pidfile in ${pidfiles} 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: cat td/osd-scrub-snaps/osd.1.pid 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1080: _scrub_snaps_multi: pids+='888066 ' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1083: _scrub_snaps_multi: ERRORS=0 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1087: _scrub_snaps_multi: '[' replica = primary ']' 2026-02-23T08:23:38.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1109: _scrub_snaps_multi: ceph pg dump pgs 2026-02-23T08:23:38.214 INFO:tasks.workunit.client.0.trial129.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T08:23:38.214 INFO:tasks.workunit.client.0.trial129.stdout:1.0 36 0 0 0 0 24448 0 0 56 0 56 active+clean+inconsistent 2026-02-23T08:23:33.881734+0000 23'56 30:103 [1,0] 1 [1,0] 1 23'56 2026-02-23T08:23:33.881707+0000 0'0 2026-02-23T08:23:12.707905+0000 0 1 periodic scrub scheduled @ 2026-02-24T19:52:10.265309+0000 36 0 2026-02-23T08:23:38.214 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:23:38.215 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T08:23:38.215 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:23:38.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-23T08:23:38.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 887525 2026-02-23T08:23:38.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1111: _scrub_snaps_multi: for pid in $pids 2026-02-23T08:23:38.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1113: _scrub_snaps_multi: kill -0 888066 2026-02-23T08:23:38.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1120: _scrub_snaps_multi: kill_daemons td/osd-scrub-snaps 2026-02-23T08:23:38.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:38.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:38.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:38.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:38.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1122: _scrub_snaps_multi: declare -a err_strings 2026-02-23T08:23:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1123: _scrub_snaps_multi: err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' 2026-02-23T08:23:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1124: _scrub_snaps_multi: err_strings[1]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' 2026-02-23T08:23:43.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1125: _scrub_snaps_multi: err_strings[2]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1126: _scrub_snaps_multi: err_strings[3]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1127: _scrub_snaps_multi: err_strings[4]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1128: _scrub_snaps_multi: err_strings[5]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1129: _scrub_snaps_multi: err_strings[6]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1130: _scrub_snaps_multi: err_strings[7]='log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj4:7 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj3:head : size 3840 != size 768 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:1 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj5:2 : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] soid .*:::obj5:4 : size 4608 != size 512 from auth oi' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 soid .*:::obj5:7 : failed to pick suitable object info' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 shard [0-1] .*:::obj1:head : missing' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1132: _scrub_snaps_multi: for err_string in "${err_strings[@]}" 2026-02-23T08:23:43.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1134: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : [0-9]*[.]0 scrub 20 errors' td/osd-scrub-snaps/osd.1.log 2026-02-23T08:23:43.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1142: _scrub_snaps_multi: declare -a rep_err_strings 2026-02-23T08:23:43.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: eval echo '$replica' 2026-02-23T08:23:43.553 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: echo 0 2026-02-23T08:23:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1143: _scrub_snaps_multi: osd=0 2026-02-23T08:23:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1144: _scrub_snaps_multi: rep_err_strings[0]='log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' 2026-02-23T08:23:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1145: _scrub_snaps_multi: for err_string in "${rep_err_strings[@]}" 2026-02-23T08:23:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1147: _scrub_snaps_multi: grep 'log_channel[(]cluster[)] log [[]ERR[]] : osd[.][0-9]* found snap mapper error on pg 1.0 oid 1:461f8b5e:::obj16:7 snaps missing in mapper, should be: {1, 2, 3, 4, 5, 6, 7} ...repaired' td/osd-scrub-snaps/osd.0.log 2026-02-23T08:23:43.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1154: _scrub_snaps_multi: '[' 0 '!=' 0 ']' 2026-02-23T08:23:43.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1160: _scrub_snaps_multi: echo 'TEST PASSED' 2026-02-23T08:23:43.555 INFO:tasks.workunit.client.0.trial129.stdout:TEST PASSED 2026-02-23T08:23:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1161: _scrub_snaps_multi: return 0 2026-02-23T08:23:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1169: TEST_scrub_snaps_replica: err=0 2026-02-23T08:23:43.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1170: TEST_scrub_snaps_replica: CEPH_ARGS='--fsid=b468793c-7bcf-4b74-9f70-f9eedbc7e7d4 --auth-supported=none --mon-host=127.0.0.1:7121 ' 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:1171: TEST_scrub_snaps_replica: return 0 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh:40: run: teardown td/osd-scrub-snaps 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:43.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:43.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:43.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:23:43.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:23:43.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:23:43.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:23:43.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:23:43.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:23:43.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:43.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:23:43.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:23:43.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:43.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:23:43.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:23:43.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:23:43.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:23:43.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:43.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:43.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-scrub-snaps 0 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-snaps 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-snaps KILL 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:43.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:43.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:43.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:23:43.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:23:43.578 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:23:43.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:23:43.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:23:43.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:23:43.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:43.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:23:43.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:23:43.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:43.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:23:43.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-23T08:23:43.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-snaps 2026-02-23T08:23:43.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:23:43.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:43.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.836428 2026-02-23T08:23:43.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.836428 2026-02-23T08:23:43.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:23:43.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:23:43.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-23T08:23:43.585 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T08:23:43.585 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T08:23:43.615 INFO:tasks.workunit:Running workunit scrub/osd-scrub-test.sh... 2026-02-23T08:23:43.615 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-scrub-test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh 2026-02-23T08:23:43.678 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-scrub-test 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:21: run: local dir=td/osd-scrub-test 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:22: run: shift 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:24: run: export CEPH_MON=127.0.0.1:7138 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:24: run: CEPH_MON=127.0.0.1:7138 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:25: run: export CEPH_ARGS 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:26: run: uuidgen 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:26: run: CEPH_ARGS+='--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none ' 2026-02-23T08:23:43.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:27: run: CEPH_ARGS+='--mon-host=127.0.0.1:7138 ' 2026-02-23T08:23:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:29: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T08:23:43.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:30: run: set 2026-02-23T08:23:43.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:30: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:30: run: local 'funcs=TEST_abort_periodic_for_operator 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_deep_scrub_abort 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_dump_scrub_schedule 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_interval_changes 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_just_deep_scrubs 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_pg_dump_objects_scrubbed 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_scrub_abort 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_scrub_permit_time 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:TEST_scrub_test' 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_abort_periodic_for_operator -------------------' 2026-02-23T08:23:43.686 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_abort_periodic_for_operator ------------------- 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:23:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:23:43.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:23:43.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:23:43.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:23:43.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:23:43.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:23:43.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:23:43.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:23:43.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:43.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:23:43.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:23:43.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:23:43.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:23:43.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:23:43.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:23:43.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:23:43.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:43.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:23:43.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:23:43.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:23:43.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:23:43.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:23:43.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:23:43.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:23:43.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:23:43.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:23:43.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:23:43.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T08:23:43.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T08:23:43.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:23:43.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:23:43.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_abort_periodic_for_operator -----------------------' 2026-02-23T08:23:43.699 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_abort_periodic_for_operator ----------------------- 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_abort_periodic_for_operator td/osd-scrub-test 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:748: TEST_abort_periodic_for_operator: local dir=td/osd-scrub-test 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:749: TEST_abort_periodic_for_operator: cluster_conf=(['osds_num']='5' ['pgs_in_pool']='16' ['pool_name']='test') 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:749: TEST_abort_periodic_for_operator: local -A cluster_conf 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:754: TEST_abort_periodic_for_operator: local extr_dbg=1 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:756: TEST_abort_periodic_for_operator: standard_scrub_wpq_cluster td/osd-scrub-test cluster_conf 2 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:302: standard_scrub_wpq_cluster: local dir=td/osd-scrub-test 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:303: standard_scrub_wpq_cluster: local -n conf=cluster_conf 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:304: standard_scrub_wpq_cluster: local osd_sleep=2 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:306: standard_scrub_wpq_cluster: conf['extras']=' --osd_op_queue=wpq --osd_scrub_sleep=2 ' 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:308: standard_scrub_wpq_cluster: standard_scrub_cluster td/osd-scrub-test conf 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-test 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=conf 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=5 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=16 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local 'extra_pars= --osd_op_queue=wpq --osd_scrub_sleep=2 ' 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T08:23:43.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T08:23:43.972 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 fc588126-4850-4704-8d0d-4a84f4954c4f 2026-02-23T08:23:44.070 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:44.097 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.095+0000 7fc411012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:44.098 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.097+0000 7fc411012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:44.099 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.098+0000 7fc411012780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:44.100 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.098+0000 7fc411012780 -1 bdev(0x562b9f285400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:44.100 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.098+0000 7fc411012780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:23:44.526 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:23:44.623 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:23:44.639 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.637+0000 7fb6d5d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:44.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.638+0000 7fb6d5d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:44.641 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.639+0000 7fb6d5d4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:44.714 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:44.837 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:44.836+0000 7fb6d5d4b780 -1 Falling back to public interface 2026-02-23T08:23:45.242 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:45.240+0000 7fb6d5d4b780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:23:45.811 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:45.903 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3752486926,v1:127.0.0.1:6801/3752486926] [v2:127.0.0.1:6802/3752486926,v1:127.0.0.1:6803/3752486926] exists,up fc588126-4850-4704-8d0d-4a84f4954c4f 2026-02-23T08:23:45.906 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 d200086b-2bd7-4e81-a64a-78e48fa4e8a7 2026-02-23T08:23:46.001 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:46.026 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.024+0000 7f4387549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:46.027 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.026+0000 7f4387549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:46.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.026+0000 7f4387549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:46.028 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.027+0000 7f4387549780 -1 bdev(0x55c91c49b400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:46.029 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.027+0000 7f4387549780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:23:46.422 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:23:46.627 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:23:46.643 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.641+0000 7f76d094f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:46.644 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.642+0000 7f76d094f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:46.645 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.643+0000 7f76d094f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:46.792 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:46.875 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:46.873+0000 7f76d094f780 -1 Falling back to public interface 2026-02-23T08:23:47.186 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:47.184+0000 7f76d094f780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:23:47.955 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:48.124 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4268358259,v1:127.0.0.1:6811/4268358259] [v2:127.0.0.1:6812/4268358259,v1:127.0.0.1:6813/4268358259] exists,up d200086b-2bd7-4e81-a64a-78e48fa4e8a7 2026-02-23T08:23:48.128 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 32fa6c67-e303-4fcd-93cd-798fb9dffd4a 2026-02-23T08:23:48.297 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:23:48.325 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.323+0000 7f7789a06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:48.326 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.324+0000 7f7789a06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:48.327 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.325+0000 7f7789a06780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:48.327 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.326+0000 7f7789a06780 -1 bdev(0x558471fd7400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:48.328 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.326+0000 7f7789a06780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:23:48.746 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:23:48.951 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:23:48.967 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.965+0000 7f6b2354f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:48.968 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.966+0000 7f6b2354f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:48.969 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:48.967+0000 7f6b2354f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:49.113 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:49.136 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:49.134+0000 7f6b2354f780 -1 Falling back to public interface 2026-02-23T08:23:49.480 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:49.478+0000 7f6b2354f780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:23:50.280 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:50.442 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1176504712,v1:127.0.0.1:6819/1176504712] [v2:127.0.0.1:6820/1176504712,v1:127.0.0.1:6821/1176504712] exists,up 32fa6c67-e303-4fcd-93cd-798fb9dffd4a 2026-02-23T08:23:50.447 INFO:tasks.workunit.client.0.trial129.stdout:add osd3 6f816aa4-32a4-42ac-b439-b3b1a03aed14 2026-02-23T08:23:50.612 INFO:tasks.workunit.client.0.trial129.stdout:3 2026-02-23T08:23:50.640 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:50.638+0000 7fa103e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:50.641 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:50.640+0000 7fa103e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:50.642 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:50.640+0000 7fa103e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:50.642 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:50.641+0000 7fa103e0c780 -1 bdev(0x55ff371cb400 td/osd-scrub-test/3/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:50.642 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:50.641+0000 7fa103e0c780 -1 bluestore(td/osd-scrub-test/3) _read_fsid unparsable uuid 2026-02-23T08:23:51.097 INFO:tasks.workunit.client.0.trial129.stdout:adding osd3 key to auth repository 2026-02-23T08:23:51.302 INFO:tasks.workunit.client.0.trial129.stdout:start osd.3 2026-02-23T08:23:51.317 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:51.316+0000 7f4e2a818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:51.319 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:51.318+0000 7f4e2a818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:51.320 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:51.319+0000 7f4e2a818780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:51.470 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:51.511 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:51.510+0000 7f4e2a818780 -1 Falling back to public interface 2026-02-23T08:23:51.858 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:51.856+0000 7f4e2a818780 -1 osd.3 0 log_to_monitors true 2026-02-23T08:23:52.636 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:52.799 INFO:tasks.workunit.client.0.trial129.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2040436377,v1:127.0.0.1:6827/2040436377] [v2:127.0.0.1:6828/2040436377,v1:127.0.0.1:6829/2040436377] exists,up 6f816aa4-32a4-42ac-b439-b3b1a03aed14 2026-02-23T08:23:52.803 INFO:tasks.workunit.client.0.trial129.stdout:add osd4 80de93e9-b1d7-40ab-bae0-76b39fd72c00 2026-02-23T08:23:52.971 INFO:tasks.workunit.client.0.trial129.stdout:4 2026-02-23T08:23:52.999 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:52.997+0000 7ff43fc09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:53.000 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:52.998+0000 7ff43fc09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:53.001 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:52.999+0000 7ff43fc09780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:53.001 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:52.999+0000 7ff43fc09780 -1 bdev(0x5582b356f400 td/osd-scrub-test/4/block) open stat got: (1) Operation not permitted 2026-02-23T08:23:53.001 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:52.999+0000 7ff43fc09780 -1 bluestore(td/osd-scrub-test/4) _read_fsid unparsable uuid 2026-02-23T08:23:53.405 INFO:tasks.workunit.client.0.trial129.stdout:adding osd4 key to auth repository 2026-02-23T08:23:53.614 INFO:tasks.workunit.client.0.trial129.stdout:start osd.4 2026-02-23T08:23:53.629 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:53.627+0000 7f580f775780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:53.631 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:53.629+0000 7f580f775780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:53.631 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:53.630+0000 7f580f775780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:23:53.761 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:53.759+0000 7f580f775780 -1 Falling back to public interface 2026-02-23T08:23:53.778 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:23:54.129 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:23:54.127+0000 7f580f775780 -1 osd.4 0 log_to_monitors true 2026-02-23T08:23:54.942 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:23:55.105 INFO:tasks.workunit.client.0.trial129.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6834/2709345973,v1:127.0.0.1:6835/2709345973] [v2:127.0.0.1:6836/2709345973,v1:127.0.0.1:6837/2709345973] exists,up 80de93e9-b1d7-40ab-bae0-76b39fd72c00 2026-02-23T08:23:55.280 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:23:56.913 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836492 2026-02-23T08:23:58.248 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672970 2026-02-23T08:23:58.417 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542152 2026-02-23T08:23:58.584 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.3 seq 81604378629 2026-02-23T08:23:58.752 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.4 seq 103079215107 2026-02-23T08:24:00.648 INFO:tasks.workunit.client.0.trial129.stdout:standard_scrub_cluster: dbg: test pool is test 1 2026-02-23T08:24:00.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:757: TEST_abort_periodic_for_operator: local poolid=1 2026-02-23T08:24:00.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:758: TEST_abort_periodic_for_operator: local poolname=test 2026-02-23T08:24:00.648 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T08:24:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:759: TEST_abort_periodic_for_operator: echo 'Pool: test : 1' 2026-02-23T08:24:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:762: TEST_abort_periodic_for_operator: local saved_echo_flag=x 2026-02-23T08:24:00.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:763: TEST_abort_periodic_for_operator: set +x 2026-02-23T08:24:00.649 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:24:00.650 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:24:00.650 INFO:tasks.workunit.client.0.trial129.stderr:320 bytes copied, 2.0167e-05 s, 15.9 MB/s 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:776: TEST_abort_periodic_for_operator: declare -A pg_pr 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:777: TEST_abort_periodic_for_operator: declare -A pg_ac 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:778: TEST_abort_periodic_for_operator: declare -A pg_po 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:779: TEST_abort_periodic_for_operator: build_pg_dicts td/osd-scrub-test pg_pr pg_ac pg_po - 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:318: build_pg_dicts: local dir=td/osd-scrub-test 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:319: build_pg_dicts: local -n pg_primary_dict=pg_pr 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:320: build_pg_dicts: local -n pg_acting_dict=pg_ac 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:321: build_pg_dicts: local -n pg_pool_dict=pg_po 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:322: build_pg_dicts: local infile=- 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:324: build_pg_dicts: local extr_dbg=0 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:327: build_pg_dicts: local saved_echo_flag=x 2026-02-23T08:24:04.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:328: build_pg_dicts: set +x 2026-02-23T08:24:04.570 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T08:24:04.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:780: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:781: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:782: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:785: TEST_abort_periodic_for_operator: wait_initial_scrubs pg_pr 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:691: wait_initial_scrubs: local -n pg_to_prim_dict=pg_pr 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:692: wait_initial_scrubs: local extr_dbg=1 2026-02-23T08:24:04.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:696: wait_initial_scrubs: ceph tell 'osd.*' config set osd_scrub_min_interval 7200 2026-02-23T08:24:04.648 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:04.648 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-23T08:24:04.648 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.655 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:04.655 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-23T08:24:04.655 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.662 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:04.662 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-23T08:24:04.662 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.669 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:04.669 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-23T08:24:04.669 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.676 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:04.676 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-23T08:24:04.676 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:697: wait_initial_scrubs: ceph tell 'osd.*' config set osd_deep_scrub_interval 14400 2026-02-23T08:24:04.749 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:04.749 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-23T08:24:04.749 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.756 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:04.756 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-23T08:24:04.756 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.763 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:04.763 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-23T08:24:04.763 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.770 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:04.770 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-23T08:24:04.770 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.777 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:04.777 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_deep_scrub_interval = '' " 2026-02-23T08:24:04.777 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:698: wait_initial_scrubs: ceph tell 'osd.*' config set osd_max_scrubs 32 2026-02-23T08:24:04.849 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:04.849 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:04.849 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.856 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:04.856 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:04.856 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.863 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:04.863 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:04.863 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.869 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:04.870 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:04.870 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.876 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:04.876 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:04.877 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:699: wait_initial_scrubs: ceph tell 'osd.*' config set osd_scrub_sleep 1 2026-02-23T08:24:04.949 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:04.949 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:04.949 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.956 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:04.956 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:04.956 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.963 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:04.963 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:04.963 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.970 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:04.970 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:04.970 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.977 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:04.977 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:04.977 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:04.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:700: wait_initial_scrubs: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 10 2026-02-23T08:24:05.048 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:05.048 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:05.048 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.055 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:05.055 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:05.055 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.063 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:05.063 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:05.063 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.070 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:05.070 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:05.070 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.077 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:05.077 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:05.077 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:701: wait_initial_scrubs: ceph tell 'osd.*' config set osd_scrub_chunk_max 10 2026-02-23T08:24:05.149 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:05.149 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:05.149 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.155 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:05.156 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:05.156 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.162 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:05.163 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:05.163 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.169 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:05.169 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:05.169 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.176 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:05.176 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:05.176 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.8' 2026-02-23T08:24:05.184 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.8 2026-02-23T08:24:05.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.8 scrub 2026-02-23T08:24:05.249 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.250 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.250 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.250 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.250 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.9' 2026-02-23T08:24:05.259 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.9 2026-02-23T08:24:05.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.9 scrub 2026-02-23T08:24:05.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.324 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.324 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.324 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.324 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.4' 2026-02-23T08:24:05.334 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.4 2026-02-23T08:24:05.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.4 scrub 2026-02-23T08:24:05.399 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.400 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.400 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.400 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.400 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.5' 2026-02-23T08:24:05.408 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.5 2026-02-23T08:24:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.5 scrub 2026-02-23T08:24:05.475 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.475 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.476 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.476 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.476 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.6' 2026-02-23T08:24:05.485 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.6 2026-02-23T08:24:05.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.6 scrub 2026-02-23T08:24:05.549 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.549 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.549 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.549 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.549 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.7' 2026-02-23T08:24:05.558 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.7 2026-02-23T08:24:05.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.7 scrub 2026-02-23T08:24:05.624 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.625 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.625 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.625 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.625 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.634 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.0 2026-02-23T08:24:05.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.0' 2026-02-23T08:24:05.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.0 scrub 2026-02-23T08:24:05.698 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.698 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.698 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.698 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.698 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.1' 2026-02-23T08:24:05.706 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.1 2026-02-23T08:24:05.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.1 scrub 2026-02-23T08:24:05.771 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.772 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.772 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.772 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.772 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.780 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.2 2026-02-23T08:24:05.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.2' 2026-02-23T08:24:05.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.2 scrub 2026-02-23T08:24:05.843 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.843 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.843 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.843 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.843 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.3' 2026-02-23T08:24:05.852 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.3 2026-02-23T08:24:05.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.3 scrub 2026-02-23T08:24:05.915 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.916 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.916 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.916 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.916 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.d' 2026-02-23T08:24:05.924 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.d 2026-02-23T08:24:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.d scrub 2026-02-23T08:24:05.988 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:05.989 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:05.989 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:05.989 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:05.989 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:05.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:05.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:05.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.e' 2026-02-23T08:24:05.998 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.e 2026-02-23T08:24:05.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.e scrub 2026-02-23T08:24:06.062 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:06.062 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:06.062 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:06.062 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:06.062 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:06.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:06.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:06.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.f' 2026-02-23T08:24:06.071 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.f 2026-02-23T08:24:06.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.f scrub 2026-02-23T08:24:06.134 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:06.135 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:06.135 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:06.135 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:06.135 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:06.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:06.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:06.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.a' 2026-02-23T08:24:06.144 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.a 2026-02-23T08:24:06.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.a scrub 2026-02-23T08:24:06.208 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:06.208 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:06.208 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:06.208 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:06.208 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:06.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:06.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:06.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.b' 2026-02-23T08:24:06.216 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.b 2026-02-23T08:24:06.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.b scrub 2026-02-23T08:24:06.281 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:06.281 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:06.281 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:06.281 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:06.282 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:06.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:703: wait_initial_scrubs: for pg in "${!pg_to_prim_dict[@]}" 2026-02-23T08:24:06.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:06.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:704: wait_initial_scrubs: echo 'Scheduling initial scrub for 1.c' 2026-02-23T08:24:06.291 INFO:tasks.workunit.client.0.trial129.stdout:Scheduling initial scrub for 1.c 2026-02-23T08:24:06.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:705: wait_initial_scrubs: ceph tell 1.c scrub 2026-02-23T08:24:06.356 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:06.356 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:06.356 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:06.356 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:06.356 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:06.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:708: wait_initial_scrubs: sleep 1 2026-02-23T08:24:07.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:709: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:07.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:709: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:07.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:710: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:07.519 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:07.529 INFO:tasks.workunit.client.0.trial129.stdout:[ 2026-02-23T08:24:07.529 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.529 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.f", 2026-02-23T08:24:07.529 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.529 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.e", 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.d", 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.530 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.1", 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.c", 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.531 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.3", 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.4", 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.5", 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.532 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.6", 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.7", 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.8", 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.533 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.9", 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.a", 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.b", 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:07.534 INFO:tasks.workunit.client.0.trial129.stdout:] 2026-02-23T08:24:07.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:712: wait_initial_scrubs: tout=20 2026-02-23T08:24:07.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 20 -gt 0 ']' 2026-02-23T08:24:07.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-23T08:24:08.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:08.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:08.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:08.681 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout:[ 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.f", 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.692 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.e", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.d", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.1", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.c", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.3", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.6", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.7", 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.693 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.9", 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.a", 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.b", 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stdout:] 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:08.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-23T08:24:08.844 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:08.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=54 2026-02-23T08:24:08.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 54 -le 1 ']' 2026-02-23T08:24:08.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=13 2026-02-23T08:24:08.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 13 PGs to finish initial scrubs (timeout 20)' 2026-02-23T08:24:08.855 INFO:tasks.workunit.client.0.trial129.stdout:Still waiting for 13 PGs to finish initial scrubs (timeout 20) 2026-02-23T08:24:08.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=19 2026-02-23T08:24:08.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 19 -gt 0 ']' 2026-02-23T08:24:08.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-23T08:24:09.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:09.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:09.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:10.010 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout:[ 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.e", 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.c", 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.a", 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.b", 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:10.021 INFO:tasks.workunit.client.0.trial129.stdout:] 2026-02-23T08:24:10.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:10.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:10.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-23T08:24:10.178 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:10.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=22 2026-02-23T08:24:10.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 22 -le 1 ']' 2026-02-23T08:24:10.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=5 2026-02-23T08:24:10.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 5 PGs to finish initial scrubs (timeout 19)' 2026-02-23T08:24:10.190 INFO:tasks.workunit.client.0.trial129.stdout:Still waiting for 5 PGs to finish initial scrubs (timeout 19) 2026-02-23T08:24:10.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=18 2026-02-23T08:24:10.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 18 -gt 0 ']' 2026-02-23T08:24:10.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-23T08:24:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:11.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:11.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:11.344 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:11.355 INFO:tasks.workunit.client.0.trial129.stdout:[ 2026-02-23T08:24:11.355 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:11.355 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.e", 2026-02-23T08:24:11.355 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.c", 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:11.356 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.a", 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.b", 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:11.357 INFO:tasks.workunit.client.0.trial129.stdout:] 2026-02-23T08:24:11.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:11.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:11.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-23T08:24:11.508 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:11.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=22 2026-02-23T08:24:11.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 22 -le 1 ']' 2026-02-23T08:24:11.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=5 2026-02-23T08:24:11.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 5 PGs to finish initial scrubs (timeout 18)' 2026-02-23T08:24:11.520 INFO:tasks.workunit.client.0.trial129.stdout:Still waiting for 5 PGs to finish initial scrubs (timeout 18) 2026-02-23T08:24:11.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=17 2026-02-23T08:24:11.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 17 -gt 0 ']' 2026-02-23T08:24:11.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-23T08:24:12.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:12.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:12.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:12.672 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout:[ 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.a", 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.b", 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: "last_scrub_duration": 0 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:12.683 INFO:tasks.workunit.client.0.trial129.stdout:] 2026-02-23T08:24:12.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:12.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:12.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-23T08:24:12.845 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:12.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=10 2026-02-23T08:24:12.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 10 -le 1 ']' 2026-02-23T08:24:12.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:723: wait_initial_scrubs: not_done=2 2026-02-23T08:24:12.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:724: wait_initial_scrubs: echo 'Still waiting for 2 PGs to finish initial scrubs (timeout 17)' 2026-02-23T08:24:12.857 INFO:tasks.workunit.client.0.trial129.stdout:Still waiting for 2 PGs to finish initial scrubs (timeout 17) 2026-02-23T08:24:12.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:725: wait_initial_scrubs: tout=16 2026-02-23T08:24:12.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:713: wait_initial_scrubs: '[' 16 -gt 0 ']' 2026-02-23T08:24:12.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:714: wait_initial_scrubs: sleep 1 2026-02-23T08:24:13.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: (( extr_dbg >= 1 )) 2026-02-23T08:24:13.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:715: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:13.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:716: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:14.014 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:14.025 INFO:tasks.workunit.client.0.trial129.stdout:[] 2026-02-23T08:24:14.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:14.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:14.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: wc -l 2026-02-23T08:24:14.177 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:14.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:718: wait_initial_scrubs: not_done=1 2026-02-23T08:24:14.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:720: wait_initial_scrubs: '[' 1 -le 1 ']' 2026-02-23T08:24:14.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:721: wait_initial_scrubs: break 2026-02-23T08:24:14.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:727: wait_initial_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:24:14.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:728: wait_initial_scrubs: jq '.pg_stats | map(select(.last_scrub_duration == 0)) | map({pgid: .pgid, last_scrub_duration: .last_scrub_duration})' 2026-02-23T08:24:14.340 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:14.351 INFO:tasks.workunit.client.0.trial129.stdout:[] 2026-02-23T08:24:14.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:729: wait_initial_scrubs: (( tout == 0 )) 2026-02-23T08:24:14.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:730: wait_initial_scrubs: return 0 2026-02-23T08:24:14.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:788: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_max_scrubs 1 2026-02-23T08:24:14.415 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:14.415 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:14.415 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.422 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:14.423 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:14.423 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.430 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:14.430 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:14.430 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.437 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:14.437 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:14.437 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.444 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:14.444 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:14.444 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:789: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_stats_update_period_not_scrubbing 1 2026-02-23T08:24:14.517 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:14.517 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T08:24:14.517 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.523 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:14.523 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T08:24:14.524 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.530 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:14.530 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T08:24:14.530 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.537 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:14.537 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T08:24:14.537 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.544 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:14.544 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_stats_update_period_not_scrubbing = '' " 2026-02-23T08:24:14.544 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:792: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_scrub_sleep 3 2026-02-23T08:24:14.618 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:14.618 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:14.618 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.625 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:14.625 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:14.625 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.633 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:14.633 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:14.633 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.640 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:14.640 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:14.640 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.647 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:14.647 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:24:14.647 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:793: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 2 2026-02-23T08:24:14.719 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:14.719 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:14.719 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.725 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:14.726 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:14.726 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.732 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:14.732 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:14.732 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.739 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:14.739 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:14.739 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.746 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:14.746 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:24:14.746 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:794: TEST_abort_periodic_for_operator: ceph tell 'osd.*' config set osd_scrub_chunk_max 2 2026-02-23T08:24:14.820 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:14.820 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:14.820 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.827 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:14.827 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:14.827 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.834 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:14.834 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:14.834 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.841 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:14.841 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:14.841 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.847 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:14.848 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_chunk_max = '' " 2026-02-23T08:24:14.848 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:795: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:798: TEST_abort_periodic_for_operator: local pg2= 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:799: TEST_abort_periodic_for_operator: for pg1 in "${!pg_pr[@]}" 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:800: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:801: TEST_abort_periodic_for_operator: [[ 1.8 == \1\.\8 ]] 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:802: TEST_abort_periodic_for_operator: continue 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:800: TEST_abort_periodic_for_operator: for pg in "${!pg_pr[@]}" 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:801: TEST_abort_periodic_for_operator: [[ 1.9 == \1\.\8 ]] 2026-02-23T08:24:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:804: TEST_abort_periodic_for_operator: [[ 1 == \1 ]] 2026-02-23T08:24:14.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:805: TEST_abort_periodic_for_operator: count_common_active 1.9 1.8 pg_ac 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:371: count_common_active: local pg1=1.9 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:372: count_common_active: local pg2=1.8 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:373: count_common_active: local -n pg_acting_dict=pg_ac 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:375: count_common_active: a1=('1' '4' '2') 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:375: count_common_active: local -a a1 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:376: count_common_active: a2=('1' '4' '3') 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:376: count_common_active: local -a a2 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:378: count_common_active: local -i cnt=0 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:379: count_common_active: for i in "${a1[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 1 -eq 1 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:382: count_common_active: cnt=1 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 1 -eq 4 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 1 -eq 3 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:379: count_common_active: for i in "${a1[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 4 -eq 1 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 4 -eq 4 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:382: count_common_active: cnt=2 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 4 -eq 3 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:379: count_common_active: for i in "${a1[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 2 -eq 1 ]] 2026-02-23T08:24:14.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 2 -eq 4 ]] 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:380: count_common_active: for j in "${a2[@]}" 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:381: count_common_active: [[ 2 -eq 3 ]] 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:387: count_common_active: printf %d 2 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:805: TEST_abort_periodic_for_operator: local -i common=2 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:806: TEST_abort_periodic_for_operator: [[ 2 -gt 1 ]] 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:807: TEST_abort_periodic_for_operator: pg2=1.9 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:808: TEST_abort_periodic_for_operator: break 2 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:814: TEST_abort_periodic_for_operator: [[ -z 1.9 ]] 2026-02-23T08:24:14.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:820: TEST_abort_periodic_for_operator: ceph tell osd.1 config set osd_max_scrubs 2 2026-02-23T08:24:14.921 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:14.922 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_max_scrubs = '' " 2026-02-23T08:24:14.922 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:14.929 INFO:tasks.workunit.client.0.trial129.stdout:The two PGs to manipulate are 1.8 and 1.9 2026-02-23T08:24:14.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:821: TEST_abort_periodic_for_operator: echo 'The two PGs to manipulate are 1.8 and 1.9' 2026-02-23T08:24:14.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:823: TEST_abort_periodic_for_operator: set_query_debug 1.8 2026-02-23T08:24:14.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.8 2026-02-23T08:24:14.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-23T08:24:14.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.8' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-23T08:24:15.082 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T08:24:15.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=1 2026-02-23T08:24:15.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.8 is 1' 2026-02-23T08:24:15.093 INFO:tasks.workunit.client.0.trial129.stdout:Setting scrub debug data. Primary for 1.8 is 1 2026-02-23T08:24:15.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.1 2026-02-23T08:24:15.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:24:15.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:24:15.094 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:24:15.094 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:15.094 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:15.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:24:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-23T08:24:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.889699/ceph-osd.1.asok scrubdebug 1.8 set sessions 2026-02-23T08:24:15.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:826: TEST_abort_periodic_for_operator: local is_act 2026-02-23T08:24:15.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:827: TEST_abort_periodic_for_operator: seq 1 3 2026-02-23T08:24:15.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:827: TEST_abort_periodic_for_operator: for i in $(seq 1 3) 2026-02-23T08:24:15.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:829: TEST_abort_periodic_for_operator: ceph pg 1.8 query 2026-02-23T08:24:15.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:829: TEST_abort_periodic_for_operator: jq .scrubber.active 2026-02-23T08:24:15.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:829: TEST_abort_periodic_for_operator: is_act=false 2026-02-23T08:24:15.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:830: TEST_abort_periodic_for_operator: [[ false = \f\a\l\s\e ]] 2026-02-23T08:24:15.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:831: TEST_abort_periodic_for_operator: break 2026-02-23T08:24:15.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:836: TEST_abort_periodic_for_operator: ceph pg dump pgs 2026-02-23T08:24:15.385 INFO:tasks.workunit.client.0.trial129.stdout:{"success":true}PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-23T08:24:15.385 INFO:tasks.workunit.client.0.trial129.stdout:1.f 19 0 0 0 0 6080 0 0 19 0 19 active+clean 2026-02-23T08:24:08.679270+0000 28'19 28:44 [3,0,4] 3 [3,0,4] 3 28'19 2026-02-23T08:24:08.679235+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:08.679235+0000 19 0 2026-02-23T08:24:15.385 INFO:tasks.workunit.client.0.trial129.stdout:1.e 20 0 0 0 0 6400 0 0 20 0 20 active+clean 2026-02-23T08:24:10.877544+0000 28'20 28:45 [1,4,2] 1 [1,4,2] 1 28'20 2026-02-23T08:24:10.877439+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:10.877439+0000 20 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.d 14 0 0 0 0 4480 0 0 14 0 14 active+clean 2026-02-23T08:24:07.700099+0000 28'14 28:39 [2,4,1] 2 [2,4,1] 2 28'14 2026-02-23T08:24:07.700047+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:07.700047+0000 14 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.0 22 0 0 0 0 7040 0 0 22 0 22 active+clean 2026-02-23T08:24:09.907716+0000 28'22 28:51 [1,0,2] 1 [1,0,2] 1 28'22 2026-02-23T08:24:09.907678+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:09.907678+0000 22 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.1 12 0 0 0 0 3840 0 0 12 0 12 active+clean 2026-02-23T08:24:08.176531+0000 28'12 28:40 [4,3,0] 4 [4,3,0] 4 28'12 2026-02-23T08:24:08.176481+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:08.176481+0000 12 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.c 15 0 0 0 0 4800 0 0 15 0 15 active+clean 2026-02-23T08:24:09.654474+0000 28'15 28:40 [3,0,4] 3 [3,0,4] 3 28'15 2026-02-23T08:24:09.654435+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:09.654435+0000 15 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.2 15 0 0 0 0 4800 0 0 15 0 15 active+clean 2026-02-23T08:24:07.296962+0000 28'15 28:43 [0,4,1] 0 [0,4,1] 0 28'15 2026-02-23T08:24:07.296928+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:07.296928+0000 15 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.3 19 0 0 0 0 6080 0 0 19 0 19 active+clean 2026-02-23T08:24:09.137181+0000 28'19 28:45 [4,1,2] 4 [4,1,2] 4 28'19 2026-02-23T08:24:09.137139+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:09.137139+0000 19 0 2026-02-23T08:24:15.386 INFO:tasks.workunit.client.0.trial129.stdout:1.4 15 0 0 0 0 4800 0 0 15 0 15 active+clean 2026-02-23T08:24:06.661558+0000 28'15 28:42 [3,0,1] 3 [3,0,1] 3 28'15 2026-02-23T08:24:06.661496+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:06.661496+0000 15 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.5 26 0 0 0 0 8320 0 0 26 0 26 active+clean 2026-02-23T08:24:07.164404+0000 28'26 28:52 [4,2,3] 4 [4,2,3] 4 28'26 2026-02-23T08:24:07.164358+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:07.164358+0000 26 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.6 12 0 0 0 0 3840 0 0 12 0 12 active+clean 2026-02-23T08:24:07.678560+0000 28'12 28:38 [3,4,2] 3 [3,4,2] 3 28'12 2026-02-23T08:24:07.678517+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:07.678517+0000 12 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.7 11 0 0 0 0 3520 0 0 11 0 11 active+clean 2026-02-23T08:24:08.893367+0000 28'11 28:37 [1,3,0] 1 [1,3,0] 1 28'11 2026-02-23T08:24:08.893331+0000 0'0 2026-02-23T08:23:55.279378+0000 0 1 periodic scrub scheduled @ 2026-02-23T10:24:08.893331+0000 11 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.8 28 0 0 0 0 8960 0 0 28 0 28 active+clean 2026-02-23T08:24:06.944518+0000 28'28 28:53 [1,4,3] 1 [1,4,3] 1 28'28 2026-02-23T08:24:06.944484+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:06.944484+0000 28 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.9 8 0 0 0 0 2560 0 0 8 0 8 active+clean 2026-02-23T08:24:07.910206+0000 28'8 28:33 [1,4,2] 1 [1,4,2] 1 28'8 2026-02-23T08:24:07.910149+0000 0'0 2026-02-23T08:23:55.279378+0000 0 2 periodic scrub scheduled @ 2026-02-23T10:24:07.910149+0000 8 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.a 9 0 0 0 0 2880 0 0 9 0 9 active+clean 2026-02-23T08:24:11.885434+0000 28'9 28:35 [1,2,4] 1 [1,2,4] 1 28'9 2026-02-23T08:24:11.885377+0000 0'0 2026-02-23T08:23:55.279378+0000 0 1 periodic scrub scheduled @ 2026-02-23T10:24:11.885377+0000 9 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout:1.b 11 0 0 0 0 3520 0 0 11 0 11 active+clean 2026-02-23T08:24:12.874475+0000 28'11 28:37 [1,0,2] 1 [1,0,2] 1 28'11 2026-02-23T08:24:12.874425+0000 0'0 2026-02-23T08:23:55.279378+0000 0 1 periodic scrub scheduled @ 2026-02-23T10:24:12.874425+0000 11 0 2026-02-23T08:24:15.387 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:24:15.388 INFO:tasks.workunit.client.0.trial129.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-23T08:24:15.388 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:15.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:837: TEST_abort_periodic_for_operator: [[ false != \f\a\l\s\e ]] 2026-02-23T08:24:15.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:842: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-23T08:24:15.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:844: TEST_abort_periodic_for_operator: echo 'Initiating a periodic scrub of 1.8' 2026-02-23T08:24:15.896 INFO:tasks.workunit.client.0.trial129.stdout:Initiating a periodic scrub of 1.8 2026-02-23T08:24:15.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:845: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:15.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:846: TEST_abort_periodic_for_operator: ceph tell 1.8 schedule-deep-scrub 2026-02-23T08:24:15.964 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:15.964 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:24:15.964 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:24:15.964 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-23T02:00:05.963814+0000" 2026-02-23T08:24:15.964 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:15.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:847: TEST_abort_periodic_for_operator: sleep 1 2026-02-23T08:24:16.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:848: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:16.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:850: TEST_abort_periodic_for_operator: seq 1 14 2026-02-23T08:24:16.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:850: TEST_abort_periodic_for_operator: for i in $(seq 1 14) 2026-02-23T08:24:16.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:852: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-23T08:24:17.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:853: TEST_abort_periodic_for_operator: ceph pg 1.8 query 2026-02-23T08:24:17.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:853: TEST_abort_periodic_for_operator: jq .scrubber 2026-02-23T08:24:17.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:853: TEST_abort_periodic_for_operator: stt='{ 2026-02-23T08:24:17.549 INFO:tasks.workunit.client.0.trial129.stderr: "active": true, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "epoch_start": "26", 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "start": "1:10000000::::0", 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "end": "MIN", 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "max_end": "MIN", 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "subset_last_update": "0'\''0", 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "deep": true, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "req_scrub": false, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "auto_repair": false, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "check_repair": false, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "deep_scrub_on_error": false, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "priority": 5, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "shallow_errors": 0, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "deep_errors": 0, 2026-02-23T08:24:17.550 INFO:tasks.workunit.client.0.trial129.stderr: "fixed": 0, 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "waiting_on_whom": [], 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "schedule": "scrubbing", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "is_reserving_replicas": false, 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "test_sequence": 15847428, 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "shallow-target": { 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.8", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-23T10:24:06.944484+0000", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-23T10:24:06.944484+0000", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "queued": false, 2026-02-23T08:24:17.551 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "deep-target": { 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.8", 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "queued": false, 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: "active": true 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:24:17.552 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T08:24:17.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:854: TEST_abort_periodic_for_operator: jq .active 2026-02-23T08:24:17.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:854: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"26",' '"start":' '"1:10000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' true, '"req_scrub":' false, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"periodic-regular",' '"test_sequence":' 15847428, '"shallow-target":' '{' '"pgid":' '"1.8",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-23T10:24:06.944484+0000",' '"orig_sched_time":' '"2026-02-23T10:24:06.944484+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '},' '"deep-target":' '{' '"pgid":' '"1.8",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '}' '}' 2026-02-23T08:24:17.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:854: TEST_abort_periodic_for_operator: is_active=true 2026-02-23T08:24:17.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:855: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"26",' '"start":' '"1:10000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' true, '"req_scrub":' false, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"periodic-regular",' '"test_sequence":' 15847428, '"shallow-target":' '{' '"pgid":' '"1.8",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-23T10:24:06.944484+0000",' '"orig_sched_time":' '"2026-02-23T10:24:06.944484+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '},' '"deep-target":' '{' '"pgid":' '"1.8",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '}' '}' 2026-02-23T08:24:17.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:855: TEST_abort_periodic_for_operator: jq .is_reserving_replicas 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:855: TEST_abort_periodic_for_operator: is_reserving_replicas=false 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:856: TEST_abort_periodic_for_operator: [[ true = \t\r\u\e ]] 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:856: TEST_abort_periodic_for_operator: [[ false = \f\a\l\s\e ]] 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:857: TEST_abort_periodic_for_operator: break 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:861: TEST_abort_periodic_for_operator: [[ true != \t\r\u\e ]] 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:861: TEST_abort_periodic_for_operator: [[ false != \f\a\l\s\e ]] 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:866: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:873: TEST_abort_periodic_for_operator: (( extr_dbg >= 1 )) 2026-02-23T08:24:17.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:873: TEST_abort_periodic_for_operator: ceph tell 'osd.*' dump_scrub_reservations --format=json-pretty 2026-02-23T08:24:17.617 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:24:17.617 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "scrubs_local": 0, 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "osd_max_scrubs": 1, 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "remote_scrub_reservations": { 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "max_allowed": 1, 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "min_priority": 0, 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "queues": [], 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: "in_progress": [] 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.618 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "scrubs_local": 1, 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "osd_max_scrubs": 2, 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "remote_scrub_reservations": { 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "max_allowed": 2, 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "min_priority": 0, 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "queues": [], 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: "in_progress": [] 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.625 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "scrubs_local": 0, 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "osd_max_scrubs": 1, 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "remote_scrub_reservations": { 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "max_allowed": 1, 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "min_priority": 0, 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "queues": [], 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: "in_progress": [] 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.633 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout:osd.3: { 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "scrubs_local": 0, 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "osd_max_scrubs": 1, 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "remote_scrub_reservations": { 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "max_allowed": 1, 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "min_priority": 0, 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "queues": [], 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: "in_progress": [ 2026-02-23T08:24:17.640 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout: "item": "1.8", 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout: "prio": 0, 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout: "can_preempt": false 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.641 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:17.647 INFO:tasks.workunit.client.0.trial129.stdout: 2026-02-23T08:24:17.647 INFO:tasks.workunit.client.0.trial129.stdout:osd.4: { 2026-02-23T08:24:17.647 INFO:tasks.workunit.client.0.trial129.stdout: "scrubs_local": 0, 2026-02-23T08:24:17.647 INFO:tasks.workunit.client.0.trial129.stdout: "osd_max_scrubs": 1, 2026-02-23T08:24:17.647 INFO:tasks.workunit.client.0.trial129.stdout: "remote_scrub_reservations": { 2026-02-23T08:24:17.647 INFO:tasks.workunit.client.0.trial129.stdout: "max_allowed": 1, 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: "min_priority": 0, 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: "queues": [], 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: "in_progress": [ 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: "item": "1.8", 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: "prio": 0, 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: "can_preempt": false 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:24:17.648 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:17.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:876: TEST_abort_periodic_for_operator: set_query_debug 1.9 2026-02-23T08:24:17.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.9 2026-02-23T08:24:17.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-23T08:24:17.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.9' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-23T08:24:17.809 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T08:24:17.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=1 2026-02-23T08:24:17.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.9 is 1' 2026-02-23T08:24:17.820 INFO:tasks.workunit.client.0.trial129.stdout:Setting scrub debug data. Primary for 1.9 is 1 2026-02-23T08:24:17.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.1 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-23T08:24:17.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.889699/ceph-osd.1.asok scrubdebug 1.9 set sessions 2026-02-23T08:24:17.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:877: TEST_abort_periodic_for_operator: ceph tell 1.9 schedule-deep-scrub 2026-02-23T08:24:17.952 INFO:tasks.workunit.client.0.trial129.stdout:{"success":true}{ 2026-02-23T08:24:17.952 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:24:17.953 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:24:17.953 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-23T02:00:07.951912+0000" 2026-02-23T08:24:17.953 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:17.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:878: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-23T08:24:18.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:879: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:18.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:880: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:18.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:881: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:18.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:882: TEST_abort_periodic_for_operator: sleep 1 2026-02-23T08:24:19.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:883: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:19.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:884: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:19.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:885: TEST_abort_periodic_for_operator: (( extr_dbg >= 2 )) 2026-02-23T08:24:19.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:888: TEST_abort_periodic_for_operator: ceph pg 1.9 query 2026-02-23T08:24:19.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:888: TEST_abort_periodic_for_operator: jq .scrubber 2026-02-23T08:24:19.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:888: TEST_abort_periodic_for_operator: local 'stt2={ 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "active": true, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "epoch_start": "26", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "start": "MIN", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "end": "MIN", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "max_end": "MIN", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "subset_last_update": "0'\''0", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "deep": true, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "req_scrub": false, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "auto_repair": false, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "check_repair": false, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "deep_scrub_on_error": false, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "priority": 5, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "shallow_errors": 0, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "deep_errors": 0, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "fixed": 0, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "waiting_on_whom": [], 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "schedule": "scrubbing", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "is_reserving_replicas": true, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "osd_to_respond": 4, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "duration_seconds": 1, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "requested_in_order": 2, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "num_to_reserve": 2, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "test_sequence": 14311427, 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "shallow-target": { 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.9", 2026-02-23T08:24:19.541 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-23T10:24:07.910149+0000", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-23T10:24:07.910149+0000", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "queued": false, 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "deep-target": { 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.9", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:24:19.542 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "queued": false, 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: "active": true 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T08:24:19.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:889: TEST_abort_periodic_for_operator: local pg2_is_reserving 2026-02-23T08:24:19.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:890: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"26",' '"start":' '"MIN",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' true, '"req_scrub":' false, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' true, '"osd_to_respond":' 4, '"duration_seconds":' 1, '"requested_in_order":' 2, '"num_to_reserve":' 2, '"urgency":' '"periodic-regular",' '"test_sequence":' 14311427, '"shallow-target":' '{' '"pgid":' '"1.9",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-23T10:24:07.910149+0000",' '"orig_sched_time":' '"2026-02-23T10:24:07.910149+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '},' '"deep-target":' '{' '"pgid":' '"1.9",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '}' '}' 2026-02-23T08:24:19.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:890: TEST_abort_periodic_for_operator: jq .is_reserving_replicas 2026-02-23T08:24:19.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:890: TEST_abort_periodic_for_operator: pg2_is_reserving=true 2026-02-23T08:24:19.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:891: TEST_abort_periodic_for_operator: [[ true != \t\r\u\e ]] 2026-02-23T08:24:19.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:899: TEST_abort_periodic_for_operator: echo 'Instructing 1.9 to perform a high-priority scrub' 2026-02-23T08:24:19.545 INFO:tasks.workunit.client.0.trial129.stdout:Instructing 1.9 to perform a high-priority scrub 2026-02-23T08:24:19.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:900: TEST_abort_periodic_for_operator: ceph tell 1.9 scrub 2026-02-23T08:24:19.610 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:19.611 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:24:19.611 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:24:19.611 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:24:19.611 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:19.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:901: TEST_abort_periodic_for_operator: seq 1 10 2026-02-23T08:24:19.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:901: TEST_abort_periodic_for_operator: for i in $(seq 1 10) 2026-02-23T08:24:19.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:903: TEST_abort_periodic_for_operator: sleep 0.5 2026-02-23T08:24:20.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:904: TEST_abort_periodic_for_operator: ceph pg 1.9 query 2026-02-23T08:24:20.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:904: TEST_abort_periodic_for_operator: jq .scrubber 2026-02-23T08:24:20.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:904: TEST_abort_periodic_for_operator: stt2='{ 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "active": true, 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "epoch_start": "26", 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "start": "1:90000000::::0", 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "end": "MIN", 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "max_end": "MIN", 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "subset_last_update": "0'\''0", 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "deep": false, 2026-02-23T08:24:20.193 INFO:tasks.workunit.client.0.trial129.stderr: "req_scrub": true, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "auto_repair": false, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "check_repair": false, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "deep_scrub_on_error": false, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "priority": 5, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "shallow_errors": 0, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "deep_errors": 0, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "fixed": 0, 2026-02-23T08:24:20.194 INFO:tasks.workunit.client.0.trial129.stderr: "waiting_on_whom": [], 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "schedule": "scrubbing", 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "is_reserving_replicas": false, 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "operator-requested", 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "test_sequence": 14311429, 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "shallow-target": { 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.9", 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:24:20.195 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "queued": false, 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: "active": true 2026-02-23T08:24:20.196 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "deep-target": { 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.9", 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:24:20.197 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:24:20.198 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:24:20.198 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:24:20.198 INFO:tasks.workunit.client.0.trial129.stderr: "queued": false, 2026-02-23T08:24:20.198 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:24:20.198 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:24:20.198 INFO:tasks.workunit.client.0.trial129.stderr:}' 2026-02-23T08:24:20.200 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:905: TEST_abort_periodic_for_operator: jq .active 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:905: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"26",' '"start":' '"1:90000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' false, '"req_scrub":' true, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"operator-requested",' '"test_sequence":' 14311429, '"shallow-target":' '{' '"pgid":' '"1.9",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '},' '"deep-target":' '{' '"pgid":' '"1.9",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '}' '}' 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:905: TEST_abort_periodic_for_operator: pg2_is_active=true 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:906: TEST_abort_periodic_for_operator: echo '{' '"active":' true, '"epoch_start":' '"26",' '"start":' '"1:90000000::::0",' '"end":' '"MIN",' '"max_end":' '"MIN",' '"subset_last_update":' '"0'\''0",' '"deep":' false, '"req_scrub":' true, '"auto_repair":' false, '"check_repair":' false, '"deep_scrub_on_error":' false, '"priority":' 5, '"shallow_errors":' 0, '"deep_errors":' 0, '"fixed":' 0, '"waiting_on_whom":' '[],' '"schedule":' '"scrubbing",' '"is_reserving_replicas":' false, '"urgency":' '"operator-requested",' '"test_sequence":' 14311429, '"shallow-target":' '{' '"pgid":' '"1.9",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' true '},' '"deep-target":' '{' '"pgid":' '"1.9",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"orig_sched_time":' '"2106-02-07T06:28:15.999999+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' false, '"active":' false '}' '}' 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:906: TEST_abort_periodic_for_operator: jq .is_reserving_replicas 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:906: TEST_abort_periodic_for_operator: pg2_is_reserving=false 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:907: TEST_abort_periodic_for_operator: [[ true = \t\r\u\e ]] 2026-02-23T08:24:20.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:907: TEST_abort_periodic_for_operator: [[ false != \t\r\u\e ]] 2026-02-23T08:24:20.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:908: TEST_abort_periodic_for_operator: break 2026-02-23T08:24:20.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:913: TEST_abort_periodic_for_operator: [[ true != \t\r\u\e ]] 2026-02-23T08:24:20.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:913: TEST_abort_periodic_for_operator: [[ false = \t\r\u\e ]] 2026-02-23T08:24:20.202 INFO:tasks.workunit.client.0.trial129.stdout:Done 2026-02-23T08:24:20.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:917: TEST_abort_periodic_for_operator: echo Done 2026-02-23T08:24:20.203 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_abort_periodic_for_operator ------------------ 2026-02-23T08:24:20.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_abort_periodic_for_operator ------------------' 2026-02-23T08:24:20.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:24:20.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:24:20.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:24:20.305 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:24:20.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:24:20.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:24:20.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:24:20.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:24:20.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:24:20.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:24:20.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:24:20.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:24:20.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:24:20.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:24:20.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:24:20.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:24:20.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:24:20.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:24:20.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:24:20.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:24:20.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:24:20.331 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_abort_periodic_for_operator ------------------ 2026-02-23T08:24:20.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_abort_periodic_for_operator ------------------' 2026-02-23T08:24:20.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:24:20.331 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_deep_scrub_abort ------------------- 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_deep_scrub_abort -------------------' 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:24:20.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:24:20.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:24:20.334 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:24:20.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:24:20.335 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:24:20.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:24:20.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:24:20.336 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:24:20.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:24:20.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:24:20.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:24:20.337 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:24:20.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:24:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:24:20.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:24:20.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:24:20.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:24:20.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:24:20.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:24:20.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:24:20.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:24:20.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:24:20.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:24:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:24:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:24:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:24:20.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_deep_scrub_abort -----------------------' 2026-02-23T08:24:20.344 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_deep_scrub_abort ----------------------- 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_deep_scrub_abort td/osd-scrub-test 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:409: TEST_deep_scrub_abort: local dir=td/osd-scrub-test 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:410: TEST_deep_scrub_abort: _scrub_abort td/osd-scrub-test deep-scrub 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:293: _scrub_abort: local dir=td/osd-scrub-test 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:294: _scrub_abort: local poolname=test 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:295: _scrub_abort: local OSDS=3 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:296: _scrub_abort: local objects=1000 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:297: _scrub_abort: local type=deep-scrub 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:299: _scrub_abort: TESTDATA=testdata.889699 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:300: _scrub_abort: test deep-scrub = scrub 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:305: _scrub_abort: stopscrub=nodeep-scrub 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:306: _scrub_abort: check=nodeep_scrub 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:309: _scrub_abort: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:24:20.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:20.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-23T08:24:20.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:24:20.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:24:20.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:24:20.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:24:20.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:24:20.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:24:20.385 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:24:20.385 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:24:20.385 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:24:20.385 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:24:20.385 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.386 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.386 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:24:20.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:24:20.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:24:20.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:24:20.444 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:24:20.445 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:24:20.445 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.445 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.446 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:24:20.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:24:20.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:24:20.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:310: _scrub_abort: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:24:20.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:24:20.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:24:20.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:24:20.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:24:20.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:24:20.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:24:20.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:24:20.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:24:20.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:24:20.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:24:20.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:20.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:24:20.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:24:20.617 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: expr 3 - 1 2026-02-23T08:24:20.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: seq 0 2 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 0 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:24:20.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:24:20.623 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:24:20.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=fb9f80fe-b282-4bca-a44e-461854f8b96a 2026-02-23T08:24:20.625 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 fb9f80fe-b282-4bca-a44e-461854f8b96a 2026-02-23T08:24:20.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 fb9f80fe-b282-4bca-a44e-461854f8b96a' 2026-02-23T08:24:20.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:24:20.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC0Dpxpp/h+JRAApt0TAU884DWTsKn/IAYT+A== 2026-02-23T08:24:20.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC0Dpxpp/h+JRAApt0TAU884DWTsKn/IAYT+A=="}' 2026-02-23T08:24:20.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new fb9f80fe-b282-4bca-a44e-461854f8b96a -i td/osd-scrub-test/0/new.json 2026-02-23T08:24:20.716 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:24:20.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:24:20.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQC0Dpxpp/h+JRAApt0TAU884DWTsKn/IAYT+A== --osd-uuid fb9f80fe-b282-4bca-a44e-461854f8b96a 2026-02-23T08:24:20.740 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:20.738+0000 7f55c3681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:20.742 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:20.740+0000 7f55c3681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:20.742 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:20.741+0000 7f55c3681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:20.743 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:20.741+0000 7f55c3681780 -1 bdev(0x5617c92c9400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:24:20.743 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:20.741+0000 7f55c3681780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:24:21.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:24:21.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:24:21.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:24:21.177 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:24:21.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:24:21.273 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:24:21.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:24:21.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:24:21.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:24:21.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:24:21.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:24:21.287 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:21.285+0000 7f315bd4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:21.288 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:21.286+0000 7f315bd4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:21.289 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:21.287+0000 7f315bd4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:21.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:24:21.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:24:21.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:24:21.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:24:21.495 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:21.494+0000 7f315bd4b780 -1 Falling back to public interface 2026-02-23T08:24:21.890 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:21.888+0000 7f315bd4b780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:24:22.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:24:22.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:24:22.454 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:24:22.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:24:22.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:24:22.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:24:22.544 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4280974145,v1:127.0.0.1:6801/4280974145] [v2:127.0.0.1:6802/4280974145,v1:127.0.0.1:6803/4280974145] exists,up fb9f80fe-b282-4bca-a44e-461854f8b96a 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 1 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:22.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-23T08:24:22.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:24:22.547 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:24:22.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=150fb762-d320-41ed-a991-02552def8e33 2026-02-23T08:24:22.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 150fb762-d320-41ed-a991-02552def8e33' 2026-02-23T08:24:22.548 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 150fb762-d320-41ed-a991-02552def8e33 2026-02-23T08:24:22.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:24:22.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC2DpxpNbsuIRAAYXLtiVgMceqCudrm7h4YYw== 2026-02-23T08:24:22.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC2DpxpNbsuIRAAYXLtiVgMceqCudrm7h4YYw=="}' 2026-02-23T08:24:22.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 150fb762-d320-41ed-a991-02552def8e33 -i td/osd-scrub-test/1/new.json 2026-02-23T08:24:22.645 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:24:22.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:24:22.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQC2DpxpNbsuIRAAYXLtiVgMceqCudrm7h4YYw== --osd-uuid 150fb762-d320-41ed-a991-02552def8e33 2026-02-23T08:24:22.668 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:22.667+0000 7f62b5b6d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:22.669 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:22.668+0000 7f62b5b6d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:22.670 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:22.669+0000 7f62b5b6d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:22.670 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:22.669+0000 7f62b5b6d780 -1 bdev(0x5615673a5400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:24:22.670 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:22.670+0000 7f62b5b6d780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:24:23.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:24:23.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:24:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:24:23.039 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:24:23.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:24:23.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:24:23.245 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:24:23.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:24:23.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:24:23.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:24:23.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:24:23.259 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:23.258+0000 7fe70f386780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:23.260 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:23.260+0000 7fe70f386780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:23.261 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:23.261+0000 7fe70f386780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:24:23.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:24:23.412 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:24:23.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:24:23.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:24:23.470 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:23.469+0000 7fe70f386780 -1 Falling back to public interface 2026-02-23T08:24:23.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:24:23.811 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:23.810+0000 7fe70f386780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:24:24.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:24:24.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:24:24.575 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:24:24.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:24:24.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:24:24.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:24:24.742 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/747864596,v1:127.0.0.1:6811/747864596] [v2:127.0.0.1:6812/747864596,v1:127.0.0.1:6813/747864596] exists,up 150fb762-d320-41ed-a991-02552def8e33 2026-02-23T08:24:24.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 2 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:24:24.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:24:24.748 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:24:24.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=eaf49045-3d53-484f-ae14-d3901c21877d 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 eaf49045-3d53-484f-ae14-d3901c21877d' 2026-02-23T08:24:24.750 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 eaf49045-3d53-484f-ae14-d3901c21877d 2026-02-23T08:24:24.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:24:24.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC4DpxpTWbkLBAAL/UJPuDu4t/6zhRu9FN9Zw== 2026-02-23T08:24:24.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC4DpxpTWbkLBAAL/UJPuDu4t/6zhRu9FN9Zw=="}' 2026-02-23T08:24:24.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new eaf49045-3d53-484f-ae14-d3901c21877d -i td/osd-scrub-test/2/new.json 2026-02-23T08:24:24.919 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:24:24.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-23T08:24:24.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQC4DpxpTWbkLBAAL/UJPuDu4t/6zhRu9FN9Zw== --osd-uuid eaf49045-3d53-484f-ae14-d3901c21877d 2026-02-23T08:24:24.945 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:24.944+0000 7f4d2ab54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:24.946 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:24.945+0000 7f4d2ab54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:24.947 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:24.946+0000 7f4d2ab54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:24.947 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:24.946+0000 7f4d2ab54780 -1 bdev(0x55875005d400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:24:24.947 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:24.946+0000 7f4d2ab54780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:24:25.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-23T08:24:25.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:24:25.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:24:25.402 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:24:25.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:24:25.607 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:24:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:24:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:24:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:24:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:24:25.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:24:25.622 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:25.621+0000 7fdefb815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:25.623 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:25.622+0000 7fdefb815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:25.624 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:25.623+0000 7fdefb815780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:24:25.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:24:25.772 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:24:25.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:24:25.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:24:25.773 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:25.771+0000 7fdefb815780 -1 Falling back to public interface 2026-02-23T08:24:25.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:24:26.172 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:24:26.171+0000 7fdefb815780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:24:26.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:24:26.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:24:26.937 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:24:26.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:24:26.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:24:26.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:24:27.100 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/535376036,v1:127.0.0.1:6819/535376036] [v2:127.0.0.1:6820/535376036,v1:127.0.0.1:6821/535376036] exists,up eaf49045-3d53-484f-ae14-d3901c21877d 2026-02-23T08:24:27.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:24:27.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:24:27.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:24:27.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:325: _scrub_abort: create_pool test 1 1 2026-02-23T08:24:27.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:24:27.309 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:24:27.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:24:28.323 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:326: _scrub_abort: wait_for_clean 2026-02-23T08:24:28.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:24:28.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:24:28.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:24:28.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:24:28.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:24:28.324 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:24:28.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:24:28.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:24:28.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:24:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:24:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:24:28.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:24:28.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:24:28.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:24:28.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:24:28.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:24:28.565 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:24:28.565 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:24:28.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:24:28.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:28.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:24:28.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:24:28.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:24:28.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:24:28.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:28.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:24:28.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-23T08:24:28.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-23T08:24:28.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2026-02-23T08:24:28.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:28.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:24:28.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-23T08:24:28.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-23T08:24:28.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-60129542147' 2026-02-23T08:24:28.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:28.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:24:28.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:28.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:24:28.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:24:28.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:28.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:24:28.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:24:28.782 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:24:28.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:28.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:24:28.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:29.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:24:29.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:30.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:24:30.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:31.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:24:31.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836487 2026-02-23T08:24:31.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:31.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-23T08:24:31.280 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:31.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:24:31.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-23T08:24:31.282 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:31.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-23T08:24:31.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-23T08:24:31.284 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672965 2026-02-23T08:24:31.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:24:31.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672965 2026-02-23T08:24:31.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:31.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-23T08:24:31.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:31.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:24:31.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-23T08:24:31.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:31.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-23T08:24:31.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-23T08:24:31.451 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542147 2026-02-23T08:24:31.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:24:31.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542149 -lt 60129542147 2026-02-23T08:24:31.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:24:31.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:24:31.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:24:31.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:24:31.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:24:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:24:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:24:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:24:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:24:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:24:31.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:24:31.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:24:31.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:24:31.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:24:31.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:24:32.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:24:32.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:24:32.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:24:32.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: ceph osd dump 2026-02-23T08:24:32.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: grep '^pool.*['\'']test['\'']' 2026-02-23T08:24:32.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: awk '{ print $2 }' 2026-02-23T08:24:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: poolid=1 2026-02-23T08:24:32.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:329: _scrub_abort: dd if=/dev/urandom of=testdata.889699 bs=1032 count=1 2026-02-23T08:24:32.354 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:24:32.354 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:24:32.354 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 1.9787e-05 s, 52.2 MB/s 2026-02-23T08:24:32.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: seq 1 1000 2026-02-23T08:24:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1 testdata.889699 2026-02-23T08:24:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj2 testdata.889699 2026-02-23T08:24:32.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj3 testdata.889699 2026-02-23T08:24:32.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj4 testdata.889699 2026-02-23T08:24:32.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj5 testdata.889699 2026-02-23T08:24:32.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj6 testdata.889699 2026-02-23T08:24:32.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj7 testdata.889699 2026-02-23T08:24:32.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj8 testdata.889699 2026-02-23T08:24:32.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj9 testdata.889699 2026-02-23T08:24:32.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj10 testdata.889699 2026-02-23T08:24:32.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj11 testdata.889699 2026-02-23T08:24:32.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj12 testdata.889699 2026-02-23T08:24:32.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj13 testdata.889699 2026-02-23T08:24:32.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj14 testdata.889699 2026-02-23T08:24:32.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj15 testdata.889699 2026-02-23T08:24:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj16 testdata.889699 2026-02-23T08:24:32.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj17 testdata.889699 2026-02-23T08:24:32.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj18 testdata.889699 2026-02-23T08:24:32.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj19 testdata.889699 2026-02-23T08:24:32.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj20 testdata.889699 2026-02-23T08:24:32.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj21 testdata.889699 2026-02-23T08:24:32.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj22 testdata.889699 2026-02-23T08:24:32.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj23 testdata.889699 2026-02-23T08:24:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj24 testdata.889699 2026-02-23T08:24:32.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj25 testdata.889699 2026-02-23T08:24:32.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj26 testdata.889699 2026-02-23T08:24:32.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj27 testdata.889699 2026-02-23T08:24:32.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj28 testdata.889699 2026-02-23T08:24:32.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj29 testdata.889699 2026-02-23T08:24:32.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj30 testdata.889699 2026-02-23T08:24:32.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj31 testdata.889699 2026-02-23T08:24:32.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj32 testdata.889699 2026-02-23T08:24:32.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj33 testdata.889699 2026-02-23T08:24:32.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj34 testdata.889699 2026-02-23T08:24:32.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj35 testdata.889699 2026-02-23T08:24:32.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj36 testdata.889699 2026-02-23T08:24:32.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj37 testdata.889699 2026-02-23T08:24:32.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj38 testdata.889699 2026-02-23T08:24:32.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj39 testdata.889699 2026-02-23T08:24:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj40 testdata.889699 2026-02-23T08:24:32.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj41 testdata.889699 2026-02-23T08:24:32.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj42 testdata.889699 2026-02-23T08:24:32.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj43 testdata.889699 2026-02-23T08:24:32.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj44 testdata.889699 2026-02-23T08:24:32.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:32.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj45 testdata.889699 2026-02-23T08:24:33.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj46 testdata.889699 2026-02-23T08:24:33.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj47 testdata.889699 2026-02-23T08:24:33.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj48 testdata.889699 2026-02-23T08:24:33.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj49 testdata.889699 2026-02-23T08:24:33.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj50 testdata.889699 2026-02-23T08:24:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj51 testdata.889699 2026-02-23T08:24:33.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj52 testdata.889699 2026-02-23T08:24:33.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj53 testdata.889699 2026-02-23T08:24:33.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj54 testdata.889699 2026-02-23T08:24:33.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj55 testdata.889699 2026-02-23T08:24:33.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj56 testdata.889699 2026-02-23T08:24:33.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj57 testdata.889699 2026-02-23T08:24:33.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj58 testdata.889699 2026-02-23T08:24:33.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj59 testdata.889699 2026-02-23T08:24:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj60 testdata.889699 2026-02-23T08:24:33.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj61 testdata.889699 2026-02-23T08:24:33.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj62 testdata.889699 2026-02-23T08:24:33.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj63 testdata.889699 2026-02-23T08:24:33.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj64 testdata.889699 2026-02-23T08:24:33.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj65 testdata.889699 2026-02-23T08:24:33.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj66 testdata.889699 2026-02-23T08:24:33.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj67 testdata.889699 2026-02-23T08:24:33.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj68 testdata.889699 2026-02-23T08:24:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj69 testdata.889699 2026-02-23T08:24:33.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj70 testdata.889699 2026-02-23T08:24:33.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj71 testdata.889699 2026-02-23T08:24:33.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj72 testdata.889699 2026-02-23T08:24:33.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj73 testdata.889699 2026-02-23T08:24:33.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj74 testdata.889699 2026-02-23T08:24:33.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj75 testdata.889699 2026-02-23T08:24:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj76 testdata.889699 2026-02-23T08:24:33.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj77 testdata.889699 2026-02-23T08:24:33.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj78 testdata.889699 2026-02-23T08:24:33.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj79 testdata.889699 2026-02-23T08:24:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj80 testdata.889699 2026-02-23T08:24:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj81 testdata.889699 2026-02-23T08:24:33.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj82 testdata.889699 2026-02-23T08:24:33.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj83 testdata.889699 2026-02-23T08:24:33.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj84 testdata.889699 2026-02-23T08:24:33.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj85 testdata.889699 2026-02-23T08:24:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj86 testdata.889699 2026-02-23T08:24:33.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj87 testdata.889699 2026-02-23T08:24:33.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj88 testdata.889699 2026-02-23T08:24:33.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj89 testdata.889699 2026-02-23T08:24:33.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj90 testdata.889699 2026-02-23T08:24:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj91 testdata.889699 2026-02-23T08:24:33.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj92 testdata.889699 2026-02-23T08:24:33.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj93 testdata.889699 2026-02-23T08:24:33.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj94 testdata.889699 2026-02-23T08:24:33.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj95 testdata.889699 2026-02-23T08:24:33.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj96 testdata.889699 2026-02-23T08:24:33.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj97 testdata.889699 2026-02-23T08:24:33.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj98 testdata.889699 2026-02-23T08:24:33.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj99 testdata.889699 2026-02-23T08:24:33.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj100 testdata.889699 2026-02-23T08:24:33.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj101 testdata.889699 2026-02-23T08:24:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj102 testdata.889699 2026-02-23T08:24:33.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj103 testdata.889699 2026-02-23T08:24:33.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj104 testdata.889699 2026-02-23T08:24:33.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj105 testdata.889699 2026-02-23T08:24:33.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj106 testdata.889699 2026-02-23T08:24:33.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj107 testdata.889699 2026-02-23T08:24:33.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj108 testdata.889699 2026-02-23T08:24:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj109 testdata.889699 2026-02-23T08:24:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj110 testdata.889699 2026-02-23T08:24:33.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj111 testdata.889699 2026-02-23T08:24:33.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj112 testdata.889699 2026-02-23T08:24:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:33.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj113 testdata.889699 2026-02-23T08:24:34.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj114 testdata.889699 2026-02-23T08:24:34.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj115 testdata.889699 2026-02-23T08:24:34.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj116 testdata.889699 2026-02-23T08:24:34.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj117 testdata.889699 2026-02-23T08:24:34.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj118 testdata.889699 2026-02-23T08:24:34.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj119 testdata.889699 2026-02-23T08:24:34.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj120 testdata.889699 2026-02-23T08:24:34.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj121 testdata.889699 2026-02-23T08:24:34.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj122 testdata.889699 2026-02-23T08:24:34.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj123 testdata.889699 2026-02-23T08:24:34.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj124 testdata.889699 2026-02-23T08:24:34.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj125 testdata.889699 2026-02-23T08:24:34.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj126 testdata.889699 2026-02-23T08:24:34.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj127 testdata.889699 2026-02-23T08:24:34.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj128 testdata.889699 2026-02-23T08:24:34.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj129 testdata.889699 2026-02-23T08:24:34.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj130 testdata.889699 2026-02-23T08:24:34.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj131 testdata.889699 2026-02-23T08:24:34.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj132 testdata.889699 2026-02-23T08:24:34.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj133 testdata.889699 2026-02-23T08:24:34.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj134 testdata.889699 2026-02-23T08:24:34.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj135 testdata.889699 2026-02-23T08:24:34.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj136 testdata.889699 2026-02-23T08:24:34.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj137 testdata.889699 2026-02-23T08:24:34.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj138 testdata.889699 2026-02-23T08:24:34.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj139 testdata.889699 2026-02-23T08:24:34.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj140 testdata.889699 2026-02-23T08:24:34.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj141 testdata.889699 2026-02-23T08:24:34.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj142 testdata.889699 2026-02-23T08:24:34.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj143 testdata.889699 2026-02-23T08:24:34.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj144 testdata.889699 2026-02-23T08:24:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj145 testdata.889699 2026-02-23T08:24:34.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj146 testdata.889699 2026-02-23T08:24:34.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj147 testdata.889699 2026-02-23T08:24:34.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj148 testdata.889699 2026-02-23T08:24:34.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj149 testdata.889699 2026-02-23T08:24:34.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj150 testdata.889699 2026-02-23T08:24:34.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj151 testdata.889699 2026-02-23T08:24:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj152 testdata.889699 2026-02-23T08:24:34.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj153 testdata.889699 2026-02-23T08:24:34.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj154 testdata.889699 2026-02-23T08:24:34.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj155 testdata.889699 2026-02-23T08:24:34.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj156 testdata.889699 2026-02-23T08:24:34.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj157 testdata.889699 2026-02-23T08:24:34.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj158 testdata.889699 2026-02-23T08:24:34.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj159 testdata.889699 2026-02-23T08:24:34.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj160 testdata.889699 2026-02-23T08:24:34.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj161 testdata.889699 2026-02-23T08:24:34.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj162 testdata.889699 2026-02-23T08:24:34.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj163 testdata.889699 2026-02-23T08:24:34.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj164 testdata.889699 2026-02-23T08:24:34.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj165 testdata.889699 2026-02-23T08:24:34.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj166 testdata.889699 2026-02-23T08:24:34.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj167 testdata.889699 2026-02-23T08:24:34.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj168 testdata.889699 2026-02-23T08:24:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj169 testdata.889699 2026-02-23T08:24:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj170 testdata.889699 2026-02-23T08:24:34.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj171 testdata.889699 2026-02-23T08:24:34.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj172 testdata.889699 2026-02-23T08:24:34.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj173 testdata.889699 2026-02-23T08:24:34.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj174 testdata.889699 2026-02-23T08:24:34.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj175 testdata.889699 2026-02-23T08:24:34.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj176 testdata.889699 2026-02-23T08:24:34.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj177 testdata.889699 2026-02-23T08:24:34.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj178 testdata.889699 2026-02-23T08:24:34.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj179 testdata.889699 2026-02-23T08:24:34.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:34.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj180 testdata.889699 2026-02-23T08:24:34.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj181 testdata.889699 2026-02-23T08:24:35.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj182 testdata.889699 2026-02-23T08:24:35.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj183 testdata.889699 2026-02-23T08:24:35.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj184 testdata.889699 2026-02-23T08:24:35.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj185 testdata.889699 2026-02-23T08:24:35.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj186 testdata.889699 2026-02-23T08:24:35.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj187 testdata.889699 2026-02-23T08:24:35.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj188 testdata.889699 2026-02-23T08:24:35.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj189 testdata.889699 2026-02-23T08:24:35.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj190 testdata.889699 2026-02-23T08:24:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj191 testdata.889699 2026-02-23T08:24:35.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj192 testdata.889699 2026-02-23T08:24:35.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj193 testdata.889699 2026-02-23T08:24:35.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj194 testdata.889699 2026-02-23T08:24:35.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj195 testdata.889699 2026-02-23T08:24:35.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj196 testdata.889699 2026-02-23T08:24:35.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj197 testdata.889699 2026-02-23T08:24:35.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj198 testdata.889699 2026-02-23T08:24:35.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj199 testdata.889699 2026-02-23T08:24:35.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj200 testdata.889699 2026-02-23T08:24:35.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj201 testdata.889699 2026-02-23T08:24:35.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj202 testdata.889699 2026-02-23T08:24:35.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj203 testdata.889699 2026-02-23T08:24:35.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj204 testdata.889699 2026-02-23T08:24:35.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj205 testdata.889699 2026-02-23T08:24:35.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj206 testdata.889699 2026-02-23T08:24:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj207 testdata.889699 2026-02-23T08:24:35.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj208 testdata.889699 2026-02-23T08:24:35.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj209 testdata.889699 2026-02-23T08:24:35.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj210 testdata.889699 2026-02-23T08:24:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj211 testdata.889699 2026-02-23T08:24:35.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj212 testdata.889699 2026-02-23T08:24:35.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj213 testdata.889699 2026-02-23T08:24:35.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj214 testdata.889699 2026-02-23T08:24:35.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj215 testdata.889699 2026-02-23T08:24:35.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj216 testdata.889699 2026-02-23T08:24:35.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj217 testdata.889699 2026-02-23T08:24:35.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj218 testdata.889699 2026-02-23T08:24:35.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj219 testdata.889699 2026-02-23T08:24:35.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj220 testdata.889699 2026-02-23T08:24:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj221 testdata.889699 2026-02-23T08:24:35.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj222 testdata.889699 2026-02-23T08:24:35.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj223 testdata.889699 2026-02-23T08:24:35.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj224 testdata.889699 2026-02-23T08:24:35.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj225 testdata.889699 2026-02-23T08:24:35.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj226 testdata.889699 2026-02-23T08:24:35.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj227 testdata.889699 2026-02-23T08:24:35.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj228 testdata.889699 2026-02-23T08:24:35.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj229 testdata.889699 2026-02-23T08:24:35.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj230 testdata.889699 2026-02-23T08:24:35.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj231 testdata.889699 2026-02-23T08:24:35.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj232 testdata.889699 2026-02-23T08:24:35.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj233 testdata.889699 2026-02-23T08:24:35.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj234 testdata.889699 2026-02-23T08:24:35.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj235 testdata.889699 2026-02-23T08:24:35.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj236 testdata.889699 2026-02-23T08:24:35.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj237 testdata.889699 2026-02-23T08:24:35.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj238 testdata.889699 2026-02-23T08:24:35.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj239 testdata.889699 2026-02-23T08:24:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj240 testdata.889699 2026-02-23T08:24:35.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj241 testdata.889699 2026-02-23T08:24:35.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj242 testdata.889699 2026-02-23T08:24:35.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj243 testdata.889699 2026-02-23T08:24:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj244 testdata.889699 2026-02-23T08:24:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj245 testdata.889699 2026-02-23T08:24:35.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj246 testdata.889699 2026-02-23T08:24:35.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj247 testdata.889699 2026-02-23T08:24:35.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:35.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj248 testdata.889699 2026-02-23T08:24:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj249 testdata.889699 2026-02-23T08:24:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj250 testdata.889699 2026-02-23T08:24:36.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj251 testdata.889699 2026-02-23T08:24:36.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj252 testdata.889699 2026-02-23T08:24:36.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj253 testdata.889699 2026-02-23T08:24:36.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj254 testdata.889699 2026-02-23T08:24:36.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj255 testdata.889699 2026-02-23T08:24:36.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj256 testdata.889699 2026-02-23T08:24:36.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj257 testdata.889699 2026-02-23T08:24:36.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj258 testdata.889699 2026-02-23T08:24:36.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj259 testdata.889699 2026-02-23T08:24:36.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj260 testdata.889699 2026-02-23T08:24:36.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj261 testdata.889699 2026-02-23T08:24:36.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj262 testdata.889699 2026-02-23T08:24:36.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj263 testdata.889699 2026-02-23T08:24:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj264 testdata.889699 2026-02-23T08:24:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj265 testdata.889699 2026-02-23T08:24:36.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj266 testdata.889699 2026-02-23T08:24:36.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj267 testdata.889699 2026-02-23T08:24:36.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj268 testdata.889699 2026-02-23T08:24:36.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj269 testdata.889699 2026-02-23T08:24:36.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj270 testdata.889699 2026-02-23T08:24:36.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj271 testdata.889699 2026-02-23T08:24:36.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj272 testdata.889699 2026-02-23T08:24:36.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj273 testdata.889699 2026-02-23T08:24:36.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj274 testdata.889699 2026-02-23T08:24:36.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj275 testdata.889699 2026-02-23T08:24:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj276 testdata.889699 2026-02-23T08:24:36.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj277 testdata.889699 2026-02-23T08:24:36.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj278 testdata.889699 2026-02-23T08:24:36.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj279 testdata.889699 2026-02-23T08:24:36.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj280 testdata.889699 2026-02-23T08:24:36.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj281 testdata.889699 2026-02-23T08:24:36.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj282 testdata.889699 2026-02-23T08:24:36.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj283 testdata.889699 2026-02-23T08:24:36.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj284 testdata.889699 2026-02-23T08:24:36.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj285 testdata.889699 2026-02-23T08:24:36.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj286 testdata.889699 2026-02-23T08:24:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj287 testdata.889699 2026-02-23T08:24:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj288 testdata.889699 2026-02-23T08:24:36.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj289 testdata.889699 2026-02-23T08:24:36.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj290 testdata.889699 2026-02-23T08:24:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj291 testdata.889699 2026-02-23T08:24:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj292 testdata.889699 2026-02-23T08:24:36.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj293 testdata.889699 2026-02-23T08:24:36.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj294 testdata.889699 2026-02-23T08:24:36.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj295 testdata.889699 2026-02-23T08:24:36.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj296 testdata.889699 2026-02-23T08:24:36.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj297 testdata.889699 2026-02-23T08:24:36.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj298 testdata.889699 2026-02-23T08:24:36.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj299 testdata.889699 2026-02-23T08:24:36.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj300 testdata.889699 2026-02-23T08:24:36.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj301 testdata.889699 2026-02-23T08:24:36.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj302 testdata.889699 2026-02-23T08:24:36.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj303 testdata.889699 2026-02-23T08:24:36.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj304 testdata.889699 2026-02-23T08:24:36.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj305 testdata.889699 2026-02-23T08:24:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj306 testdata.889699 2026-02-23T08:24:36.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj307 testdata.889699 2026-02-23T08:24:36.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj308 testdata.889699 2026-02-23T08:24:36.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj309 testdata.889699 2026-02-23T08:24:36.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj310 testdata.889699 2026-02-23T08:24:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj311 testdata.889699 2026-02-23T08:24:36.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj312 testdata.889699 2026-02-23T08:24:36.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj313 testdata.889699 2026-02-23T08:24:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj314 testdata.889699 2026-02-23T08:24:36.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj315 testdata.889699 2026-02-23T08:24:36.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj316 testdata.889699 2026-02-23T08:24:36.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:36.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj317 testdata.889699 2026-02-23T08:24:37.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj318 testdata.889699 2026-02-23T08:24:37.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj319 testdata.889699 2026-02-23T08:24:37.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj320 testdata.889699 2026-02-23T08:24:37.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj321 testdata.889699 2026-02-23T08:24:37.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj322 testdata.889699 2026-02-23T08:24:37.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj323 testdata.889699 2026-02-23T08:24:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj324 testdata.889699 2026-02-23T08:24:37.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj325 testdata.889699 2026-02-23T08:24:37.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj326 testdata.889699 2026-02-23T08:24:37.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj327 testdata.889699 2026-02-23T08:24:37.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj328 testdata.889699 2026-02-23T08:24:37.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj329 testdata.889699 2026-02-23T08:24:37.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj330 testdata.889699 2026-02-23T08:24:37.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj331 testdata.889699 2026-02-23T08:24:37.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj332 testdata.889699 2026-02-23T08:24:37.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj333 testdata.889699 2026-02-23T08:24:37.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj334 testdata.889699 2026-02-23T08:24:37.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj335 testdata.889699 2026-02-23T08:24:37.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj336 testdata.889699 2026-02-23T08:24:37.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj337 testdata.889699 2026-02-23T08:24:37.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj338 testdata.889699 2026-02-23T08:24:37.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj339 testdata.889699 2026-02-23T08:24:37.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj340 testdata.889699 2026-02-23T08:24:37.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj341 testdata.889699 2026-02-23T08:24:37.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj342 testdata.889699 2026-02-23T08:24:37.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj343 testdata.889699 2026-02-23T08:24:37.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj344 testdata.889699 2026-02-23T08:24:37.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj345 testdata.889699 2026-02-23T08:24:37.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj346 testdata.889699 2026-02-23T08:24:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj347 testdata.889699 2026-02-23T08:24:37.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj348 testdata.889699 2026-02-23T08:24:37.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj349 testdata.889699 2026-02-23T08:24:37.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj350 testdata.889699 2026-02-23T08:24:37.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj351 testdata.889699 2026-02-23T08:24:37.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj352 testdata.889699 2026-02-23T08:24:37.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj353 testdata.889699 2026-02-23T08:24:37.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj354 testdata.889699 2026-02-23T08:24:37.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj355 testdata.889699 2026-02-23T08:24:37.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj356 testdata.889699 2026-02-23T08:24:37.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj357 testdata.889699 2026-02-23T08:24:37.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj358 testdata.889699 2026-02-23T08:24:37.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj359 testdata.889699 2026-02-23T08:24:37.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj360 testdata.889699 2026-02-23T08:24:37.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj361 testdata.889699 2026-02-23T08:24:37.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj362 testdata.889699 2026-02-23T08:24:37.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj363 testdata.889699 2026-02-23T08:24:37.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj364 testdata.889699 2026-02-23T08:24:37.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj365 testdata.889699 2026-02-23T08:24:37.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj366 testdata.889699 2026-02-23T08:24:37.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj367 testdata.889699 2026-02-23T08:24:37.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj368 testdata.889699 2026-02-23T08:24:37.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj369 testdata.889699 2026-02-23T08:24:37.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj370 testdata.889699 2026-02-23T08:24:37.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj371 testdata.889699 2026-02-23T08:24:37.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj372 testdata.889699 2026-02-23T08:24:37.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj373 testdata.889699 2026-02-23T08:24:37.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj374 testdata.889699 2026-02-23T08:24:37.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj375 testdata.889699 2026-02-23T08:24:37.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj376 testdata.889699 2026-02-23T08:24:37.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj377 testdata.889699 2026-02-23T08:24:37.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj378 testdata.889699 2026-02-23T08:24:37.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj379 testdata.889699 2026-02-23T08:24:37.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj380 testdata.889699 2026-02-23T08:24:37.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj381 testdata.889699 2026-02-23T08:24:37.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj382 testdata.889699 2026-02-23T08:24:37.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj383 testdata.889699 2026-02-23T08:24:37.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:37.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj384 testdata.889699 2026-02-23T08:24:38.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj385 testdata.889699 2026-02-23T08:24:38.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj386 testdata.889699 2026-02-23T08:24:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj387 testdata.889699 2026-02-23T08:24:38.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj388 testdata.889699 2026-02-23T08:24:38.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj389 testdata.889699 2026-02-23T08:24:38.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj390 testdata.889699 2026-02-23T08:24:38.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj391 testdata.889699 2026-02-23T08:24:38.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj392 testdata.889699 2026-02-23T08:24:38.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj393 testdata.889699 2026-02-23T08:24:38.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj394 testdata.889699 2026-02-23T08:24:38.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj395 testdata.889699 2026-02-23T08:24:38.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj396 testdata.889699 2026-02-23T08:24:38.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj397 testdata.889699 2026-02-23T08:24:38.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj398 testdata.889699 2026-02-23T08:24:38.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj399 testdata.889699 2026-02-23T08:24:38.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj400 testdata.889699 2026-02-23T08:24:38.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj401 testdata.889699 2026-02-23T08:24:38.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj402 testdata.889699 2026-02-23T08:24:38.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj403 testdata.889699 2026-02-23T08:24:38.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj404 testdata.889699 2026-02-23T08:24:38.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj405 testdata.889699 2026-02-23T08:24:38.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj406 testdata.889699 2026-02-23T08:24:38.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj407 testdata.889699 2026-02-23T08:24:38.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj408 testdata.889699 2026-02-23T08:24:38.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj409 testdata.889699 2026-02-23T08:24:38.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj410 testdata.889699 2026-02-23T08:24:38.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj411 testdata.889699 2026-02-23T08:24:38.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj412 testdata.889699 2026-02-23T08:24:38.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj413 testdata.889699 2026-02-23T08:24:38.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj414 testdata.889699 2026-02-23T08:24:38.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj415 testdata.889699 2026-02-23T08:24:38.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj416 testdata.889699 2026-02-23T08:24:38.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj417 testdata.889699 2026-02-23T08:24:38.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj418 testdata.889699 2026-02-23T08:24:38.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj419 testdata.889699 2026-02-23T08:24:38.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj420 testdata.889699 2026-02-23T08:24:38.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj421 testdata.889699 2026-02-23T08:24:38.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj422 testdata.889699 2026-02-23T08:24:38.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj423 testdata.889699 2026-02-23T08:24:38.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj424 testdata.889699 2026-02-23T08:24:38.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj425 testdata.889699 2026-02-23T08:24:38.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj426 testdata.889699 2026-02-23T08:24:38.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj427 testdata.889699 2026-02-23T08:24:38.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj428 testdata.889699 2026-02-23T08:24:38.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj429 testdata.889699 2026-02-23T08:24:38.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj430 testdata.889699 2026-02-23T08:24:38.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj431 testdata.889699 2026-02-23T08:24:38.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj432 testdata.889699 2026-02-23T08:24:38.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj433 testdata.889699 2026-02-23T08:24:38.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj434 testdata.889699 2026-02-23T08:24:38.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj435 testdata.889699 2026-02-23T08:24:38.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj436 testdata.889699 2026-02-23T08:24:38.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj437 testdata.889699 2026-02-23T08:24:38.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj438 testdata.889699 2026-02-23T08:24:38.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj439 testdata.889699 2026-02-23T08:24:38.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj440 testdata.889699 2026-02-23T08:24:38.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj441 testdata.889699 2026-02-23T08:24:38.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj442 testdata.889699 2026-02-23T08:24:38.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj443 testdata.889699 2026-02-23T08:24:38.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj444 testdata.889699 2026-02-23T08:24:38.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj445 testdata.889699 2026-02-23T08:24:38.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj446 testdata.889699 2026-02-23T08:24:38.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj447 testdata.889699 2026-02-23T08:24:38.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj448 testdata.889699 2026-02-23T08:24:38.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj449 testdata.889699 2026-02-23T08:24:38.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj450 testdata.889699 2026-02-23T08:24:38.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj451 testdata.889699 2026-02-23T08:24:38.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:38.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj452 testdata.889699 2026-02-23T08:24:39.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj453 testdata.889699 2026-02-23T08:24:39.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj454 testdata.889699 2026-02-23T08:24:39.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj455 testdata.889699 2026-02-23T08:24:39.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj456 testdata.889699 2026-02-23T08:24:39.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj457 testdata.889699 2026-02-23T08:24:39.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj458 testdata.889699 2026-02-23T08:24:39.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj459 testdata.889699 2026-02-23T08:24:39.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj460 testdata.889699 2026-02-23T08:24:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj461 testdata.889699 2026-02-23T08:24:39.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj462 testdata.889699 2026-02-23T08:24:39.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj463 testdata.889699 2026-02-23T08:24:39.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj464 testdata.889699 2026-02-23T08:24:39.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj465 testdata.889699 2026-02-23T08:24:39.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj466 testdata.889699 2026-02-23T08:24:39.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj467 testdata.889699 2026-02-23T08:24:39.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj468 testdata.889699 2026-02-23T08:24:39.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj469 testdata.889699 2026-02-23T08:24:39.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj470 testdata.889699 2026-02-23T08:24:39.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj471 testdata.889699 2026-02-23T08:24:39.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj472 testdata.889699 2026-02-23T08:24:39.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj473 testdata.889699 2026-02-23T08:24:39.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj474 testdata.889699 2026-02-23T08:24:39.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj475 testdata.889699 2026-02-23T08:24:39.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj476 testdata.889699 2026-02-23T08:24:39.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj477 testdata.889699 2026-02-23T08:24:39.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj478 testdata.889699 2026-02-23T08:24:39.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj479 testdata.889699 2026-02-23T08:24:39.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj480 testdata.889699 2026-02-23T08:24:39.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj481 testdata.889699 2026-02-23T08:24:39.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj482 testdata.889699 2026-02-23T08:24:39.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj483 testdata.889699 2026-02-23T08:24:39.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.462 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj484 testdata.889699 2026-02-23T08:24:39.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj485 testdata.889699 2026-02-23T08:24:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj486 testdata.889699 2026-02-23T08:24:39.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj487 testdata.889699 2026-02-23T08:24:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj488 testdata.889699 2026-02-23T08:24:39.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj489 testdata.889699 2026-02-23T08:24:39.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj490 testdata.889699 2026-02-23T08:24:39.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj491 testdata.889699 2026-02-23T08:24:39.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj492 testdata.889699 2026-02-23T08:24:39.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj493 testdata.889699 2026-02-23T08:24:39.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj494 testdata.889699 2026-02-23T08:24:39.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj495 testdata.889699 2026-02-23T08:24:39.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj496 testdata.889699 2026-02-23T08:24:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj497 testdata.889699 2026-02-23T08:24:39.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj498 testdata.889699 2026-02-23T08:24:39.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj499 testdata.889699 2026-02-23T08:24:39.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj500 testdata.889699 2026-02-23T08:24:39.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj501 testdata.889699 2026-02-23T08:24:39.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj502 testdata.889699 2026-02-23T08:24:39.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj503 testdata.889699 2026-02-23T08:24:39.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj504 testdata.889699 2026-02-23T08:24:39.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj505 testdata.889699 2026-02-23T08:24:39.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj506 testdata.889699 2026-02-23T08:24:39.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj507 testdata.889699 2026-02-23T08:24:39.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj508 testdata.889699 2026-02-23T08:24:39.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj509 testdata.889699 2026-02-23T08:24:39.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj510 testdata.889699 2026-02-23T08:24:39.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj511 testdata.889699 2026-02-23T08:24:39.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj512 testdata.889699 2026-02-23T08:24:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj513 testdata.889699 2026-02-23T08:24:39.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj514 testdata.889699 2026-02-23T08:24:39.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj515 testdata.889699 2026-02-23T08:24:39.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj516 testdata.889699 2026-02-23T08:24:39.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj517 testdata.889699 2026-02-23T08:24:39.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj518 testdata.889699 2026-02-23T08:24:39.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj519 testdata.889699 2026-02-23T08:24:39.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:39.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj520 testdata.889699 2026-02-23T08:24:40.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj521 testdata.889699 2026-02-23T08:24:40.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj522 testdata.889699 2026-02-23T08:24:40.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj523 testdata.889699 2026-02-23T08:24:40.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj524 testdata.889699 2026-02-23T08:24:40.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj525 testdata.889699 2026-02-23T08:24:40.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj526 testdata.889699 2026-02-23T08:24:40.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj527 testdata.889699 2026-02-23T08:24:40.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj528 testdata.889699 2026-02-23T08:24:40.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj529 testdata.889699 2026-02-23T08:24:40.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj530 testdata.889699 2026-02-23T08:24:40.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj531 testdata.889699 2026-02-23T08:24:40.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj532 testdata.889699 2026-02-23T08:24:40.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj533 testdata.889699 2026-02-23T08:24:40.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj534 testdata.889699 2026-02-23T08:24:40.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj535 testdata.889699 2026-02-23T08:24:40.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj536 testdata.889699 2026-02-23T08:24:40.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj537 testdata.889699 2026-02-23T08:24:40.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj538 testdata.889699 2026-02-23T08:24:40.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj539 testdata.889699 2026-02-23T08:24:40.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj540 testdata.889699 2026-02-23T08:24:40.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj541 testdata.889699 2026-02-23T08:24:40.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj542 testdata.889699 2026-02-23T08:24:40.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj543 testdata.889699 2026-02-23T08:24:40.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj544 testdata.889699 2026-02-23T08:24:40.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj545 testdata.889699 2026-02-23T08:24:40.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj546 testdata.889699 2026-02-23T08:24:40.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj547 testdata.889699 2026-02-23T08:24:40.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj548 testdata.889699 2026-02-23T08:24:40.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj549 testdata.889699 2026-02-23T08:24:40.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj550 testdata.889699 2026-02-23T08:24:40.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj551 testdata.889699 2026-02-23T08:24:40.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj552 testdata.889699 2026-02-23T08:24:40.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj553 testdata.889699 2026-02-23T08:24:40.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj554 testdata.889699 2026-02-23T08:24:40.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj555 testdata.889699 2026-02-23T08:24:40.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj556 testdata.889699 2026-02-23T08:24:40.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj557 testdata.889699 2026-02-23T08:24:40.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj558 testdata.889699 2026-02-23T08:24:40.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj559 testdata.889699 2026-02-23T08:24:40.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj560 testdata.889699 2026-02-23T08:24:40.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj561 testdata.889699 2026-02-23T08:24:40.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj562 testdata.889699 2026-02-23T08:24:40.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj563 testdata.889699 2026-02-23T08:24:40.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj564 testdata.889699 2026-02-23T08:24:40.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj565 testdata.889699 2026-02-23T08:24:40.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj566 testdata.889699 2026-02-23T08:24:40.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj567 testdata.889699 2026-02-23T08:24:40.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj568 testdata.889699 2026-02-23T08:24:40.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj569 testdata.889699 2026-02-23T08:24:40.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj570 testdata.889699 2026-02-23T08:24:40.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj571 testdata.889699 2026-02-23T08:24:40.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj572 testdata.889699 2026-02-23T08:24:40.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj573 testdata.889699 2026-02-23T08:24:40.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj574 testdata.889699 2026-02-23T08:24:40.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj575 testdata.889699 2026-02-23T08:24:40.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj576 testdata.889699 2026-02-23T08:24:40.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj577 testdata.889699 2026-02-23T08:24:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj578 testdata.889699 2026-02-23T08:24:40.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj579 testdata.889699 2026-02-23T08:24:40.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj580 testdata.889699 2026-02-23T08:24:40.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj581 testdata.889699 2026-02-23T08:24:40.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj582 testdata.889699 2026-02-23T08:24:40.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj583 testdata.889699 2026-02-23T08:24:40.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj584 testdata.889699 2026-02-23T08:24:40.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj585 testdata.889699 2026-02-23T08:24:40.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj586 testdata.889699 2026-02-23T08:24:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj587 testdata.889699 2026-02-23T08:24:41.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj588 testdata.889699 2026-02-23T08:24:41.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj589 testdata.889699 2026-02-23T08:24:41.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj590 testdata.889699 2026-02-23T08:24:41.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj591 testdata.889699 2026-02-23T08:24:41.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj592 testdata.889699 2026-02-23T08:24:41.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj593 testdata.889699 2026-02-23T08:24:41.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj594 testdata.889699 2026-02-23T08:24:41.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj595 testdata.889699 2026-02-23T08:24:41.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj596 testdata.889699 2026-02-23T08:24:41.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj597 testdata.889699 2026-02-23T08:24:41.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj598 testdata.889699 2026-02-23T08:24:41.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj599 testdata.889699 2026-02-23T08:24:41.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj600 testdata.889699 2026-02-23T08:24:41.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj601 testdata.889699 2026-02-23T08:24:41.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj602 testdata.889699 2026-02-23T08:24:41.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj603 testdata.889699 2026-02-23T08:24:41.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj604 testdata.889699 2026-02-23T08:24:41.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj605 testdata.889699 2026-02-23T08:24:41.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj606 testdata.889699 2026-02-23T08:24:41.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj607 testdata.889699 2026-02-23T08:24:41.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj608 testdata.889699 2026-02-23T08:24:41.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj609 testdata.889699 2026-02-23T08:24:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj610 testdata.889699 2026-02-23T08:24:41.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj611 testdata.889699 2026-02-23T08:24:41.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj612 testdata.889699 2026-02-23T08:24:41.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj613 testdata.889699 2026-02-23T08:24:41.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj614 testdata.889699 2026-02-23T08:24:41.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj615 testdata.889699 2026-02-23T08:24:41.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj616 testdata.889699 2026-02-23T08:24:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj617 testdata.889699 2026-02-23T08:24:41.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj618 testdata.889699 2026-02-23T08:24:41.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj619 testdata.889699 2026-02-23T08:24:41.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj620 testdata.889699 2026-02-23T08:24:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj621 testdata.889699 2026-02-23T08:24:41.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj622 testdata.889699 2026-02-23T08:24:41.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj623 testdata.889699 2026-02-23T08:24:41.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj624 testdata.889699 2026-02-23T08:24:41.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj625 testdata.889699 2026-02-23T08:24:41.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj626 testdata.889699 2026-02-23T08:24:41.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj627 testdata.889699 2026-02-23T08:24:41.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj628 testdata.889699 2026-02-23T08:24:41.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj629 testdata.889699 2026-02-23T08:24:41.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj630 testdata.889699 2026-02-23T08:24:41.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj631 testdata.889699 2026-02-23T08:24:41.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj632 testdata.889699 2026-02-23T08:24:41.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj633 testdata.889699 2026-02-23T08:24:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj634 testdata.889699 2026-02-23T08:24:41.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj635 testdata.889699 2026-02-23T08:24:41.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj636 testdata.889699 2026-02-23T08:24:41.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj637 testdata.889699 2026-02-23T08:24:41.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj638 testdata.889699 2026-02-23T08:24:41.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj639 testdata.889699 2026-02-23T08:24:41.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj640 testdata.889699 2026-02-23T08:24:41.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj641 testdata.889699 2026-02-23T08:24:41.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj642 testdata.889699 2026-02-23T08:24:41.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj643 testdata.889699 2026-02-23T08:24:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj644 testdata.889699 2026-02-23T08:24:41.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj645 testdata.889699 2026-02-23T08:24:41.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj646 testdata.889699 2026-02-23T08:24:41.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj647 testdata.889699 2026-02-23T08:24:41.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj648 testdata.889699 2026-02-23T08:24:41.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj649 testdata.889699 2026-02-23T08:24:41.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj650 testdata.889699 2026-02-23T08:24:41.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj651 testdata.889699 2026-02-23T08:24:41.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj652 testdata.889699 2026-02-23T08:24:41.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj653 testdata.889699 2026-02-23T08:24:41.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj654 testdata.889699 2026-02-23T08:24:41.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:41.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj655 testdata.889699 2026-02-23T08:24:42.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj656 testdata.889699 2026-02-23T08:24:42.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj657 testdata.889699 2026-02-23T08:24:42.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj658 testdata.889699 2026-02-23T08:24:42.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj659 testdata.889699 2026-02-23T08:24:42.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj660 testdata.889699 2026-02-23T08:24:42.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj661 testdata.889699 2026-02-23T08:24:42.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj662 testdata.889699 2026-02-23T08:24:42.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj663 testdata.889699 2026-02-23T08:24:42.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj664 testdata.889699 2026-02-23T08:24:42.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj665 testdata.889699 2026-02-23T08:24:42.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj666 testdata.889699 2026-02-23T08:24:42.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj667 testdata.889699 2026-02-23T08:24:42.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj668 testdata.889699 2026-02-23T08:24:42.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj669 testdata.889699 2026-02-23T08:24:42.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj670 testdata.889699 2026-02-23T08:24:42.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj671 testdata.889699 2026-02-23T08:24:42.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj672 testdata.889699 2026-02-23T08:24:42.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj673 testdata.889699 2026-02-23T08:24:42.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj674 testdata.889699 2026-02-23T08:24:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj675 testdata.889699 2026-02-23T08:24:42.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj676 testdata.889699 2026-02-23T08:24:42.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj677 testdata.889699 2026-02-23T08:24:42.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj678 testdata.889699 2026-02-23T08:24:42.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj679 testdata.889699 2026-02-23T08:24:42.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj680 testdata.889699 2026-02-23T08:24:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj681 testdata.889699 2026-02-23T08:24:42.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj682 testdata.889699 2026-02-23T08:24:42.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj683 testdata.889699 2026-02-23T08:24:42.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj684 testdata.889699 2026-02-23T08:24:42.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj685 testdata.889699 2026-02-23T08:24:42.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj686 testdata.889699 2026-02-23T08:24:42.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj687 testdata.889699 2026-02-23T08:24:42.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj688 testdata.889699 2026-02-23T08:24:42.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj689 testdata.889699 2026-02-23T08:24:42.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj690 testdata.889699 2026-02-23T08:24:42.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj691 testdata.889699 2026-02-23T08:24:42.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj692 testdata.889699 2026-02-23T08:24:42.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj693 testdata.889699 2026-02-23T08:24:42.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj694 testdata.889699 2026-02-23T08:24:42.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj695 testdata.889699 2026-02-23T08:24:42.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj696 testdata.889699 2026-02-23T08:24:42.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj697 testdata.889699 2026-02-23T08:24:42.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj698 testdata.889699 2026-02-23T08:24:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj699 testdata.889699 2026-02-23T08:24:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj700 testdata.889699 2026-02-23T08:24:42.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj701 testdata.889699 2026-02-23T08:24:42.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj702 testdata.889699 2026-02-23T08:24:42.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj703 testdata.889699 2026-02-23T08:24:42.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj704 testdata.889699 2026-02-23T08:24:42.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj705 testdata.889699 2026-02-23T08:24:42.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj706 testdata.889699 2026-02-23T08:24:42.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj707 testdata.889699 2026-02-23T08:24:42.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj708 testdata.889699 2026-02-23T08:24:42.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj709 testdata.889699 2026-02-23T08:24:42.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj710 testdata.889699 2026-02-23T08:24:42.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj711 testdata.889699 2026-02-23T08:24:42.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj712 testdata.889699 2026-02-23T08:24:42.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj713 testdata.889699 2026-02-23T08:24:42.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj714 testdata.889699 2026-02-23T08:24:42.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj715 testdata.889699 2026-02-23T08:24:42.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj716 testdata.889699 2026-02-23T08:24:42.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj717 testdata.889699 2026-02-23T08:24:42.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj718 testdata.889699 2026-02-23T08:24:42.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj719 testdata.889699 2026-02-23T08:24:42.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj720 testdata.889699 2026-02-23T08:24:42.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:42.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj721 testdata.889699 2026-02-23T08:24:43.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj722 testdata.889699 2026-02-23T08:24:43.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj723 testdata.889699 2026-02-23T08:24:43.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj724 testdata.889699 2026-02-23T08:24:43.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj725 testdata.889699 2026-02-23T08:24:43.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj726 testdata.889699 2026-02-23T08:24:43.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj727 testdata.889699 2026-02-23T08:24:43.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj728 testdata.889699 2026-02-23T08:24:43.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj729 testdata.889699 2026-02-23T08:24:43.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj730 testdata.889699 2026-02-23T08:24:43.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj731 testdata.889699 2026-02-23T08:24:43.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj732 testdata.889699 2026-02-23T08:24:43.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj733 testdata.889699 2026-02-23T08:24:43.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj734 testdata.889699 2026-02-23T08:24:43.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj735 testdata.889699 2026-02-23T08:24:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj736 testdata.889699 2026-02-23T08:24:43.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj737 testdata.889699 2026-02-23T08:24:43.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj738 testdata.889699 2026-02-23T08:24:43.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj739 testdata.889699 2026-02-23T08:24:43.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj740 testdata.889699 2026-02-23T08:24:43.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj741 testdata.889699 2026-02-23T08:24:43.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj742 testdata.889699 2026-02-23T08:24:43.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj743 testdata.889699 2026-02-23T08:24:43.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj744 testdata.889699 2026-02-23T08:24:43.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj745 testdata.889699 2026-02-23T08:24:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj746 testdata.889699 2026-02-23T08:24:43.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj747 testdata.889699 2026-02-23T08:24:43.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj748 testdata.889699 2026-02-23T08:24:43.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj749 testdata.889699 2026-02-23T08:24:43.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj750 testdata.889699 2026-02-23T08:24:43.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj751 testdata.889699 2026-02-23T08:24:43.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj752 testdata.889699 2026-02-23T08:24:43.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj753 testdata.889699 2026-02-23T08:24:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj754 testdata.889699 2026-02-23T08:24:43.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj755 testdata.889699 2026-02-23T08:24:43.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj756 testdata.889699 2026-02-23T08:24:43.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj757 testdata.889699 2026-02-23T08:24:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj758 testdata.889699 2026-02-23T08:24:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj759 testdata.889699 2026-02-23T08:24:43.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj760 testdata.889699 2026-02-23T08:24:43.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj761 testdata.889699 2026-02-23T08:24:43.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj762 testdata.889699 2026-02-23T08:24:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj763 testdata.889699 2026-02-23T08:24:43.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj764 testdata.889699 2026-02-23T08:24:43.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj765 testdata.889699 2026-02-23T08:24:43.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj766 testdata.889699 2026-02-23T08:24:43.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj767 testdata.889699 2026-02-23T08:24:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj768 testdata.889699 2026-02-23T08:24:43.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj769 testdata.889699 2026-02-23T08:24:43.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj770 testdata.889699 2026-02-23T08:24:43.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.732 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj771 testdata.889699 2026-02-23T08:24:43.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj772 testdata.889699 2026-02-23T08:24:43.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj773 testdata.889699 2026-02-23T08:24:43.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj774 testdata.889699 2026-02-23T08:24:43.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj775 testdata.889699 2026-02-23T08:24:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj776 testdata.889699 2026-02-23T08:24:43.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj777 testdata.889699 2026-02-23T08:24:43.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj778 testdata.889699 2026-02-23T08:24:43.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj779 testdata.889699 2026-02-23T08:24:43.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj780 testdata.889699 2026-02-23T08:24:43.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj781 testdata.889699 2026-02-23T08:24:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj782 testdata.889699 2026-02-23T08:24:43.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj783 testdata.889699 2026-02-23T08:24:43.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj784 testdata.889699 2026-02-23T08:24:43.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj785 testdata.889699 2026-02-23T08:24:43.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj786 testdata.889699 2026-02-23T08:24:43.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj787 testdata.889699 2026-02-23T08:24:43.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:43.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj788 testdata.889699 2026-02-23T08:24:44.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj789 testdata.889699 2026-02-23T08:24:44.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj790 testdata.889699 2026-02-23T08:24:44.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj791 testdata.889699 2026-02-23T08:24:44.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj792 testdata.889699 2026-02-23T08:24:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj793 testdata.889699 2026-02-23T08:24:44.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj794 testdata.889699 2026-02-23T08:24:44.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj795 testdata.889699 2026-02-23T08:24:44.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj796 testdata.889699 2026-02-23T08:24:44.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj797 testdata.889699 2026-02-23T08:24:44.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj798 testdata.889699 2026-02-23T08:24:44.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj799 testdata.889699 2026-02-23T08:24:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj800 testdata.889699 2026-02-23T08:24:44.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj801 testdata.889699 2026-02-23T08:24:44.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj802 testdata.889699 2026-02-23T08:24:44.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj803 testdata.889699 2026-02-23T08:24:44.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj804 testdata.889699 2026-02-23T08:24:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.237 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj805 testdata.889699 2026-02-23T08:24:44.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj806 testdata.889699 2026-02-23T08:24:44.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj807 testdata.889699 2026-02-23T08:24:44.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj808 testdata.889699 2026-02-23T08:24:44.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj809 testdata.889699 2026-02-23T08:24:44.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj810 testdata.889699 2026-02-23T08:24:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj811 testdata.889699 2026-02-23T08:24:44.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj812 testdata.889699 2026-02-23T08:24:44.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj813 testdata.889699 2026-02-23T08:24:44.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj814 testdata.889699 2026-02-23T08:24:44.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj815 testdata.889699 2026-02-23T08:24:44.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj816 testdata.889699 2026-02-23T08:24:44.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj817 testdata.889699 2026-02-23T08:24:44.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj818 testdata.889699 2026-02-23T08:24:44.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj819 testdata.889699 2026-02-23T08:24:44.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj820 testdata.889699 2026-02-23T08:24:44.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj821 testdata.889699 2026-02-23T08:24:44.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj822 testdata.889699 2026-02-23T08:24:44.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj823 testdata.889699 2026-02-23T08:24:44.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj824 testdata.889699 2026-02-23T08:24:44.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj825 testdata.889699 2026-02-23T08:24:44.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj826 testdata.889699 2026-02-23T08:24:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj827 testdata.889699 2026-02-23T08:24:44.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj828 testdata.889699 2026-02-23T08:24:44.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj829 testdata.889699 2026-02-23T08:24:44.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj830 testdata.889699 2026-02-23T08:24:44.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj831 testdata.889699 2026-02-23T08:24:44.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj832 testdata.889699 2026-02-23T08:24:44.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj833 testdata.889699 2026-02-23T08:24:44.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj834 testdata.889699 2026-02-23T08:24:44.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj835 testdata.889699 2026-02-23T08:24:44.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj836 testdata.889699 2026-02-23T08:24:44.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj837 testdata.889699 2026-02-23T08:24:44.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj838 testdata.889699 2026-02-23T08:24:44.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.736 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj839 testdata.889699 2026-02-23T08:24:44.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj840 testdata.889699 2026-02-23T08:24:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj841 testdata.889699 2026-02-23T08:24:44.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj842 testdata.889699 2026-02-23T08:24:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj843 testdata.889699 2026-02-23T08:24:44.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj844 testdata.889699 2026-02-23T08:24:44.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj845 testdata.889699 2026-02-23T08:24:44.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj846 testdata.889699 2026-02-23T08:24:44.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj847 testdata.889699 2026-02-23T08:24:44.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj848 testdata.889699 2026-02-23T08:24:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj849 testdata.889699 2026-02-23T08:24:44.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj850 testdata.889699 2026-02-23T08:24:44.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj851 testdata.889699 2026-02-23T08:24:44.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj852 testdata.889699 2026-02-23T08:24:44.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj853 testdata.889699 2026-02-23T08:24:44.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj854 testdata.889699 2026-02-23T08:24:44.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj855 testdata.889699 2026-02-23T08:24:44.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:44.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj856 testdata.889699 2026-02-23T08:24:45.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj857 testdata.889699 2026-02-23T08:24:45.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj858 testdata.889699 2026-02-23T08:24:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj859 testdata.889699 2026-02-23T08:24:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj860 testdata.889699 2026-02-23T08:24:45.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj861 testdata.889699 2026-02-23T08:24:45.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj862 testdata.889699 2026-02-23T08:24:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj863 testdata.889699 2026-02-23T08:24:45.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj864 testdata.889699 2026-02-23T08:24:45.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj865 testdata.889699 2026-02-23T08:24:45.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj866 testdata.889699 2026-02-23T08:24:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj867 testdata.889699 2026-02-23T08:24:45.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj868 testdata.889699 2026-02-23T08:24:45.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj869 testdata.889699 2026-02-23T08:24:45.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj870 testdata.889699 2026-02-23T08:24:45.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj871 testdata.889699 2026-02-23T08:24:45.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj872 testdata.889699 2026-02-23T08:24:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj873 testdata.889699 2026-02-23T08:24:45.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj874 testdata.889699 2026-02-23T08:24:45.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj875 testdata.889699 2026-02-23T08:24:45.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj876 testdata.889699 2026-02-23T08:24:45.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj877 testdata.889699 2026-02-23T08:24:45.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj878 testdata.889699 2026-02-23T08:24:45.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj879 testdata.889699 2026-02-23T08:24:45.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj880 testdata.889699 2026-02-23T08:24:45.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj881 testdata.889699 2026-02-23T08:24:45.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj882 testdata.889699 2026-02-23T08:24:45.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj883 testdata.889699 2026-02-23T08:24:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj884 testdata.889699 2026-02-23T08:24:45.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj885 testdata.889699 2026-02-23T08:24:45.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj886 testdata.889699 2026-02-23T08:24:45.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj887 testdata.889699 2026-02-23T08:24:45.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj888 testdata.889699 2026-02-23T08:24:45.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj889 testdata.889699 2026-02-23T08:24:45.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj890 testdata.889699 2026-02-23T08:24:45.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj891 testdata.889699 2026-02-23T08:24:45.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj892 testdata.889699 2026-02-23T08:24:45.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj893 testdata.889699 2026-02-23T08:24:45.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj894 testdata.889699 2026-02-23T08:24:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj895 testdata.889699 2026-02-23T08:24:45.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj896 testdata.889699 2026-02-23T08:24:45.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj897 testdata.889699 2026-02-23T08:24:45.609 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj898 testdata.889699 2026-02-23T08:24:45.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj899 testdata.889699 2026-02-23T08:24:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj900 testdata.889699 2026-02-23T08:24:45.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj901 testdata.889699 2026-02-23T08:24:45.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj902 testdata.889699 2026-02-23T08:24:45.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj903 testdata.889699 2026-02-23T08:24:45.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj904 testdata.889699 2026-02-23T08:24:45.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj905 testdata.889699 2026-02-23T08:24:45.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj906 testdata.889699 2026-02-23T08:24:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj907 testdata.889699 2026-02-23T08:24:45.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj908 testdata.889699 2026-02-23T08:24:45.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj909 testdata.889699 2026-02-23T08:24:45.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj910 testdata.889699 2026-02-23T08:24:45.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj911 testdata.889699 2026-02-23T08:24:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj912 testdata.889699 2026-02-23T08:24:45.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj913 testdata.889699 2026-02-23T08:24:45.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj914 testdata.889699 2026-02-23T08:24:45.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj915 testdata.889699 2026-02-23T08:24:45.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj916 testdata.889699 2026-02-23T08:24:45.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj917 testdata.889699 2026-02-23T08:24:45.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj918 testdata.889699 2026-02-23T08:24:45.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj919 testdata.889699 2026-02-23T08:24:45.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj920 testdata.889699 2026-02-23T08:24:45.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj921 testdata.889699 2026-02-23T08:24:45.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj922 testdata.889699 2026-02-23T08:24:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj923 testdata.889699 2026-02-23T08:24:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:45.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj924 testdata.889699 2026-02-23T08:24:46.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.009 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj925 testdata.889699 2026-02-23T08:24:46.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj926 testdata.889699 2026-02-23T08:24:46.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj927 testdata.889699 2026-02-23T08:24:46.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj928 testdata.889699 2026-02-23T08:24:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj929 testdata.889699 2026-02-23T08:24:46.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj930 testdata.889699 2026-02-23T08:24:46.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj931 testdata.889699 2026-02-23T08:24:46.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj932 testdata.889699 2026-02-23T08:24:46.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj933 testdata.889699 2026-02-23T08:24:46.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj934 testdata.889699 2026-02-23T08:24:46.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj935 testdata.889699 2026-02-23T08:24:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj936 testdata.889699 2026-02-23T08:24:46.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj937 testdata.889699 2026-02-23T08:24:46.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj938 testdata.889699 2026-02-23T08:24:46.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj939 testdata.889699 2026-02-23T08:24:46.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj940 testdata.889699 2026-02-23T08:24:46.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj941 testdata.889699 2026-02-23T08:24:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj942 testdata.889699 2026-02-23T08:24:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.280 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj943 testdata.889699 2026-02-23T08:24:46.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj944 testdata.889699 2026-02-23T08:24:46.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj945 testdata.889699 2026-02-23T08:24:46.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj946 testdata.889699 2026-02-23T08:24:46.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj947 testdata.889699 2026-02-23T08:24:46.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj948 testdata.889699 2026-02-23T08:24:46.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj949 testdata.889699 2026-02-23T08:24:46.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj950 testdata.889699 2026-02-23T08:24:46.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj951 testdata.889699 2026-02-23T08:24:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj952 testdata.889699 2026-02-23T08:24:46.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj953 testdata.889699 2026-02-23T08:24:46.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj954 testdata.889699 2026-02-23T08:24:46.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj955 testdata.889699 2026-02-23T08:24:46.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj956 testdata.889699 2026-02-23T08:24:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj957 testdata.889699 2026-02-23T08:24:46.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj958 testdata.889699 2026-02-23T08:24:46.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj959 testdata.889699 2026-02-23T08:24:46.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj960 testdata.889699 2026-02-23T08:24:46.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj961 testdata.889699 2026-02-23T08:24:46.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj962 testdata.889699 2026-02-23T08:24:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj963 testdata.889699 2026-02-23T08:24:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj964 testdata.889699 2026-02-23T08:24:46.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj965 testdata.889699 2026-02-23T08:24:46.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj966 testdata.889699 2026-02-23T08:24:46.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj967 testdata.889699 2026-02-23T08:24:46.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj968 testdata.889699 2026-02-23T08:24:46.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj969 testdata.889699 2026-02-23T08:24:46.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj970 testdata.889699 2026-02-23T08:24:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj971 testdata.889699 2026-02-23T08:24:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj972 testdata.889699 2026-02-23T08:24:46.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj973 testdata.889699 2026-02-23T08:24:46.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj974 testdata.889699 2026-02-23T08:24:46.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj975 testdata.889699 2026-02-23T08:24:46.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj976 testdata.889699 2026-02-23T08:24:46.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj977 testdata.889699 2026-02-23T08:24:46.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj978 testdata.889699 2026-02-23T08:24:46.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj979 testdata.889699 2026-02-23T08:24:46.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj980 testdata.889699 2026-02-23T08:24:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj981 testdata.889699 2026-02-23T08:24:46.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj982 testdata.889699 2026-02-23T08:24:46.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj983 testdata.889699 2026-02-23T08:24:46.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj984 testdata.889699 2026-02-23T08:24:46.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj985 testdata.889699 2026-02-23T08:24:46.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj986 testdata.889699 2026-02-23T08:24:46.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj987 testdata.889699 2026-02-23T08:24:46.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj988 testdata.889699 2026-02-23T08:24:46.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj989 testdata.889699 2026-02-23T08:24:46.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj990 testdata.889699 2026-02-23T08:24:46.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:46.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj991 testdata.889699 2026-02-23T08:24:47.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj992 testdata.889699 2026-02-23T08:24:47.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj993 testdata.889699 2026-02-23T08:24:47.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj994 testdata.889699 2026-02-23T08:24:47.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj995 testdata.889699 2026-02-23T08:24:47.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj996 testdata.889699 2026-02-23T08:24:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj997 testdata.889699 2026-02-23T08:24:47.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj998 testdata.889699 2026-02-23T08:24:47.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj999 testdata.889699 2026-02-23T08:24:47.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:24:47.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1000 testdata.889699 2026-02-23T08:24:47.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:334: _scrub_abort: rm -f testdata.889699 2026-02-23T08:24:47.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: get_primary test obj1 2026-02-23T08:24:47.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:24:47.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:24:47.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:24:47.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:24:47.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: local primary=1 2026-02-23T08:24:47.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:337: _scrub_abort: local pgid=1.0 2026-02-23T08:24:47.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:339: _scrub_abort: ceph tell 1.0 schedule-deep-scrub 2026-02-23T08:24:47.366 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:24:47.366 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:24:47.366 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:24:47.366 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-12T03:36:37.365587+0000" 2026-02-23T08:24:47.366 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:24:47.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:342: _scrub_abort: set -o pipefail 2026-02-23T08:24:47.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:343: _scrub_abort: found=no 2026-02-23T08:24:47.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: seq 0 200 2026-02-23T08:24:47.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:24:47.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:24:47.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:24:47.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:24:47.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:24:47.541 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:24:47.541 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:24:47.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:24:47.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:47.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:24:47.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-23T08:24:47.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-23T08:24:47.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-23T08:24:47.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:47.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:24:47.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672985 2026-02-23T08:24:47.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672985 2026-02-23T08:24:47.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-42949672985' 2026-02-23T08:24:47.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:47.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:24:47.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542167 2026-02-23T08:24:47.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542167 2026-02-23T08:24:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-42949672985 2-60129542167' 2026-02-23T08:24:47.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:47.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-23T08:24:47.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:47.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:24:47.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-23T08:24:47.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:47.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-23T08:24:47.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-23T08:24:47.764 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836507 2026-02-23T08:24:47.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:47.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836507 2026-02-23T08:24:47.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:48.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:24:48.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:49.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836507 2026-02-23T08:24:49.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:49.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672985 2026-02-23T08:24:49.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:49.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:24:49.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672985 2026-02-23T08:24:49.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:49.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672985 2026-02-23T08:24:49.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672985' 2026-02-23T08:24:49.098 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672985 2026-02-23T08:24:49.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:24:49.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672986 -lt 42949672985 2026-02-23T08:24:49.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:49.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542167 2026-02-23T08:24:49.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:49.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:24:49.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542167 2026-02-23T08:24:49.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:49.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542167 2026-02-23T08:24:49.266 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542167 2026-02-23T08:24:49.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542167' 2026-02-23T08:24:49.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:24:49.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542168 -lt 60129542167 2026-02-23T08:24:49.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:24:49.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:24:49.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:24:49.589 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:49.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:24:49.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:24:49.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:24:49.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:24:49.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:24:49.766 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:24:49.766 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:24:49.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:24:49.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:49.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:24:49.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-23T08:24:49.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-23T08:24:49.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-23T08:24:49.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:49.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:24:49.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672988 2026-02-23T08:24:49.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672988 2026-02-23T08:24:49.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-42949672988' 2026-02-23T08:24:49.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:49.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:24:49.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542170 2026-02-23T08:24:49.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542170 2026-02-23T08:24:49.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-42949672988 2-60129542170' 2026-02-23T08:24:49.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:49.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-23T08:24:49.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:49.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:24:49.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-23T08:24:49.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-23T08:24:49.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-23T08:24:49.988 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836511 2026-02-23T08:24:49.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:50.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836511 2026-02-23T08:24:50.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:51.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:24:51.158 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:51.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836511 2026-02-23T08:24:51.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:51.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672988 2026-02-23T08:24:51.325 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:51.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:24:51.326 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672988 2026-02-23T08:24:51.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:51.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672988 2026-02-23T08:24:51.328 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672988 2026-02-23T08:24:51.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672988' 2026-02-23T08:24:51.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:24:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672989 -lt 42949672988 2026-02-23T08:24:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:51.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542170 2026-02-23T08:24:51.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:51.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:24:51.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542170 2026-02-23T08:24:51.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:51.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542170 2026-02-23T08:24:51.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542170' 2026-02-23T08:24:51.496 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542170 2026-02-23T08:24:51.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:24:51.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542171 -lt 60129542170 2026-02-23T08:24:51.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:24:51.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:24:51.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:24:51.814 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:51.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:24:51.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:24:51.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:24:51.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:24:51.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:24:51.993 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:24:51.994 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:24:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:24:51.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:51.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:24:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-23T08:24:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-23T08:24:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514' 2026-02-23T08:24:52.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:52.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:24:52.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672992 2026-02-23T08:24:52.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672992 2026-02-23T08:24:52.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-42949672992' 2026-02-23T08:24:52.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:52.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:24:52.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542173 2026-02-23T08:24:52.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542173 2026-02-23T08:24:52.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-42949672992 2-60129542173' 2026-02-23T08:24:52.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:52.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836514 2026-02-23T08:24:52.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:52.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:24:52.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-23T08:24:52.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:52.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836514 2026-02-23T08:24:52.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-23T08:24:52.217 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836514 2026-02-23T08:24:52.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:52.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836514 2026-02-23T08:24:52.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:53.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:24:53.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:53.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836514 2026-02-23T08:24:53.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:53.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672992 2026-02-23T08:24:53.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:53.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:24:53.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672992 2026-02-23T08:24:53.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:53.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672992 2026-02-23T08:24:53.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672992' 2026-02-23T08:24:53.553 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672992 2026-02-23T08:24:53.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:24:53.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672992 -lt 42949672992 2026-02-23T08:24:53.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:53.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542173 2026-02-23T08:24:53.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:53.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:24:53.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542173 2026-02-23T08:24:53.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:53.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542173 2026-02-23T08:24:53.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542173' 2026-02-23T08:24:53.725 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542173 2026-02-23T08:24:53.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:24:53.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542174 -lt 60129542173 2026-02-23T08:24:53.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:24:53.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:24:53.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:24:54.042 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:54.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:349: _scrub_abort: found=yes 2026-02-23T08:24:54.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:351: _scrub_abort: break 2026-02-23T08:24:54.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:354: _scrub_abort: set +o pipefail 2026-02-23T08:24:54.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:356: _scrub_abort: test yes = no 2026-02-23T08:24:54.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:362: _scrub_abort: ceph osd set nodeep-scrub 2026-02-23T08:24:54.261 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:24:54.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:363: _scrub_abort: '[' deep-scrub = deep-scrub ']' 2026-02-23T08:24:54.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:365: _scrub_abort: ceph osd set noscrub 2026-02-23T08:24:54.465 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:24:54.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:369: _scrub_abort: set -o pipefail 2026-02-23T08:24:54.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: seq 0 200 2026-02-23T08:24:54.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:24:54.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:24:54.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:24:54.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:24:54.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:24:54.641 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:24:54.641 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:24:54.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:24:54.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:54.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:24:54.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836518 2026-02-23T08:24:54.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836518 2026-02-23T08:24:54.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518' 2026-02-23T08:24:54.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:54.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:24:54.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672995 2026-02-23T08:24:54.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672995 2026-02-23T08:24:54.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518 1-42949672995' 2026-02-23T08:24:54.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:24:54.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:24:54.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542177 2026-02-23T08:24:54.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542177 2026-02-23T08:24:54.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518 1-42949672995 2-60129542177' 2026-02-23T08:24:54.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:54.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836518 2026-02-23T08:24:54.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:54.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:24:54.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836518 2026-02-23T08:24:54.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:54.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836518 2026-02-23T08:24:54.867 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836518 2026-02-23T08:24:54.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836518' 2026-02-23T08:24:54.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:55.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836518 2026-02-23T08:24:55.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:56.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:24:56.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:56.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836516 -lt 21474836518 2026-02-23T08:24:56.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:24:57.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-23T08:24:57.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:24:57.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836519 -lt 21474836518 2026-02-23T08:24:57.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:57.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672995 2026-02-23T08:24:57.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:57.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:24:57.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672995 2026-02-23T08:24:57.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:57.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672995 2026-02-23T08:24:57.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672995' 2026-02-23T08:24:57.374 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672995 2026-02-23T08:24:57.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:24:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672997 -lt 42949672995 2026-02-23T08:24:57.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:24:57.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542177 2026-02-23T08:24:57.539 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:24:57.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:24:57.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542177 2026-02-23T08:24:57.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:24:57.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542177 2026-02-23T08:24:57.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542177' 2026-02-23T08:24:57.541 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542177 2026-02-23T08:24:57.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:24:57.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542179 -lt 60129542177 2026-02-23T08:24:57.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:24:57.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:24:57.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:24:57.860 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:24:57.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:378: _scrub_abort: break 2026-02-23T08:24:57.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:380: _scrub_abort: set +o pipefail 2026-02-23T08:24:57.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:382: _scrub_abort: sleep 5 2026-02-23T08:25:02.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:384: _scrub_abort: grep 'nodeep_scrub set, aborting' td/osd-scrub-test/osd.1.log 2026-02-23T08:25:02.882 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:24:55.833+0000 7fe6f0d346c0 10 osd.1 pg_epoch: 18 pg[1.0( v 17'1000 (0'0,17'1000] local-lis/les=15/16 n=1000 ec=15/15 lis/c=15/15 les/c/f=16/16/0 sis=15) [1,0,2] r=0 lpr=15 crt=17'1000 lcod 17'999 mlcod 17'999 active+clean+scrubbing+deep(periodic-regular)] scrubber: nodeep_scrub set, aborting 2026-02-23T08:25:02.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: get_last_scrub_stamp 1.0 2026-02-23T08:25:02.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:02.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:02.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:02.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:03.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: local last_scrub=2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:03.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:391: _scrub_abort: ceph config set osd osd_scrub_sleep 0.1 2026-02-23T08:25:03.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:393: _scrub_abort: ceph osd unset nodeep-scrub 2026-02-23T08:25:03.407 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is unset 2026-02-23T08:25:03.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:394: _scrub_abort: '[' deep-scrub = deep-scrub ']' 2026-02-23T08:25:03.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:396: _scrub_abort: ceph osd unset noscrub 2026-02-23T08:25:03.609 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is unset 2026-02-23T08:25:03.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:398: _scrub_abort: TIMEOUT=500 2026-02-23T08:25:03.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:399: _scrub_abort: wait_for_scrub 1.0 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:03.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:25:03.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:03.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:25:03.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:25:03.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:03.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:03.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:03.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:03.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:03.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:03.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:03.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:04.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:04.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:04.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:04.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:04.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:04.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:04.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:04.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:04.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:05.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:05.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:05.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:05.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:05.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:05.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:05.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:06.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:06.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:07.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:07.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:07.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:07.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:07.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:07.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:07.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:07.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:07.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:08.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:08.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:08.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:08.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:08.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:08.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:08.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:08.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:08.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:09.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:09.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:09.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:09.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:09.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:09.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:09.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:09.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:09.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:10.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:10.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:10.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:10.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:10.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:10.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:10.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:10.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:10.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:11.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:11.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:11.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:11.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:11.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:11.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:11.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:11.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:11.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:12.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:12.955 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:12.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:12.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:12.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:12.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:12.956 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:13.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:13.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:14.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:14.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:14.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:14.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:14.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:14.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:14.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:15.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:15.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:15.288 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:15.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:15.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:15.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:15.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:15.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:15.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:16.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:16.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:16.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:16.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:16.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:16.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:16.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:16.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:17.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:17.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:17.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:17.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:17.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:17.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:17.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:17.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:17.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:18.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:18.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:18.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:18.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:18.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:18.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:18.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:18.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:18.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:19.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:19.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:19.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:19.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:19.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:19.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:19.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:20.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:20.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:21.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:21.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:21.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:21.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:21.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:21.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:21.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:21.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:21.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:22.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:22.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:22.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:22.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:22.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:22.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:22.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:22.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:22.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:23.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:23.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:23.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:23.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:23.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:23.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:23.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:23.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:23.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:24.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:24.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:24.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:24.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:24.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:24.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:24.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:24.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:24.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:25.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:25.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:25.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:25.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:25.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:26.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:26.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:26.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:26.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:26.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:26.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:26.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:27.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:27.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:28.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:28.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:28.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:28.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:28.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:28.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:28.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:28.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:28.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:29.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:29.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:29.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:29.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:29.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:29.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:29.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:29.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:30.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:30.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:30.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:30.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:30.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:30.446 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:30.447 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:30.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:30.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:31.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:31.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:31.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:31.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:31.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:31.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:31.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:31.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:32.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:32.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:32.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:32.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:32.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:32.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:32.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:32.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:32.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:33.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:33.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:33.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:33.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:33.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:33.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:33.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:34.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:34.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:35.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:35.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:35.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:35.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:35.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:35.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:35.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:35.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:35.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:36.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:36.284 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:36.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:36.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:36.284 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:36.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:36.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:36.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:36.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:37.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:37.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:37.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:37.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:37.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:37.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:37.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:37.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:37.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:38.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:38.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:38.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:38.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:38.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:38.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:38.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:38.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:38.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:39.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:39.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:39.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:39.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:39.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:39.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:39.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:39.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:39.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:40.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:40.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:40.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:40.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:40.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:40.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:40.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:41.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:41.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:42.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:42.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:42.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:42.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:42.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:42.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:42.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:42.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:42.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:43.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:43.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:43.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:43.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:43.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:43.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:43.287 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:43.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:43.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:44.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:44.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:44.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:44.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:44.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:44.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:44.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:44.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:45.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:45.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:45.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:45.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:45.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:45.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:45.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:45.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:46.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:46.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:46.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:46.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:46.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:46.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:46.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:46.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:46.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:47.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:47.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:47.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:47.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:47.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:47.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:48.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:48.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:49.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:49.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:49.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:49.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:49.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:49.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:49.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:49.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:50.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:50.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:50.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:50.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:50.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:50.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:50.293 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:50.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:50.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:51.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:51.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:51.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:51.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:51.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:51.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:51.462 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:51.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:51.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:52.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:52.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:52.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:52.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:52.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:52.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:52.628 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:52.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:52.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:53.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:53.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:53.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:53.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:53.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:53.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:53.793 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:53.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:53.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:54.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:54.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:54.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:54.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:54.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:54.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:54.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:55.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:55.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:56.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:56.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:56.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:56.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:56.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:56.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:56.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:56.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:57.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:57.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:57.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:57.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:57.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:57.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:57.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:57.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:57.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:58.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:58.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:58.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:58.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:58.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:58.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:58.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:58.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:58.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:25:59.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:25:59.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:25:59.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:25:59.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:25:59.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:25:59.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:25:59.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:25:59.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:25:59.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:00.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:00.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:00.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:00.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:00.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:00.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:00.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:01.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:01.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:02.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:02.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:02.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:02.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:02.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:02.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:02.005 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:02.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:02.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:03.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:03.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:03.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:03.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:03.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:03.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:03.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:03.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:03.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:04.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:04.338 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:04.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:04.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:04.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:04.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:04.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:04.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:04.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:05.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:05.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:05.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:05.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:05.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:05.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:05.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:05.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:05.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:06.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:06.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:06.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:06.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:06.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:06.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:06.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:06.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:06.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:07.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:07.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:07.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:07.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:07.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:07.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:07.843 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:08.012 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:08.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:09.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:09.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:09.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:09.014 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:09.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:09.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:09.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:09.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:09.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:10.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:10.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:10.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:10.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:10.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:10.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:10.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:10.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:10.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:11.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:11.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:11.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:11.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:11.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:11.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:11.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:11.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:11.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:12.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:12.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:12.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:12.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:12.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:12.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:12.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:12.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:12.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:13.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:13.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:13.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:13.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:13.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:13.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:13.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:13.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:13.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:14.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:14.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:14.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:14.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:14.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:14.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:14.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:15.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:15.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:16.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:16.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:16.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:16.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:16.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:16.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:16.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:16.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:16.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:17.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:17.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:17.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:17.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:17.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:17.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:17.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:17.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:17.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:18.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:18.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:18.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:18.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:18.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:18.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:18.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:18.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:18.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:19.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:19.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:19.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:19.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:19.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:19.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:19.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:19.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:19.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:20.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:20.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:20.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:20.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:20.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:20.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:20.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:20.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:20.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:21.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:21.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:21.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:21.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:21.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:21.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:21.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:22.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:22.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:23.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:23.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:23.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:23.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:23.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:23.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:23.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:23.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:23.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:24.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:24.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:24.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:24.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:24.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:24.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:24.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:24.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:24.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:25.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:25.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:25.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:25.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:25.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:25.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:25.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:25.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:25.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:26.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:26.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:26.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:26.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:26.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:26.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:26.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:26.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:26.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:27.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:27.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:27.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:27.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:27.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:27.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:27.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:27.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:27.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:28.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:28.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:28.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:28.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:28.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:28.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:28.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:29.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:29.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:30.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:30.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:30.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:30.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:30.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:30.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:30.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:30.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:30.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:31.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:31.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:31.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:31.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:31.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:31.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:31.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:31.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:31.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:32.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:32.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:32.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:32.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:32.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:32.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:32.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:32.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:33.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:33.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:33.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:33.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:33.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:33.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:33.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:33.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:33.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:34.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:34.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:34.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:34.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:34.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:34.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:34.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:34.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:34.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:35.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:35.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:35.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:35.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:35.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:35.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:35.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:36.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:36.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:37.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:37.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:37.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:37.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:37.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:37.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:37.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:37.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:37.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:38.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:38.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:38.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:38.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:38.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:38.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:38.223 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:38.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:39.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:39.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:39.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:39.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:39.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:39.388 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:39.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:39.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:39.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:40.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:40.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:40.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:40.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:40.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:40.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:40.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:40.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:40.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:41.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:41.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:41.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:41.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:41.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:41.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:41.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:41.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:41.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:42.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:42.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:42.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:42.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:42.896 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:43.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:43.060 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:44.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:44.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:44.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:44.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:44.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:44.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:44.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:44.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:45.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:45.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:45.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:45.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:45.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:45.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:45.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:46.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:46.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:46.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:46.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:46.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:46.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:46.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:46.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:46.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:47.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:47.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:47.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:47.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:47.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:47.560 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:47.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:47.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:47.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:48.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:48.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:48.731 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:48.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:48.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:48.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:48.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:48.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:48.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:49.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:49.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:49.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:49.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:49.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:49.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:49.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:50.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:50.063 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:51.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:51.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:51.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:51.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:51.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:51.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:51.066 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:51.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:51.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:52.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:52.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:52.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:52.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:52.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:52.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:52.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:52.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:52.397 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:53.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:53.399 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:53.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:53.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:53.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:53.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:53.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:53.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:53.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:54.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:54.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:54.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:54.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:54.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:54.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:54.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:54.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:54.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:55.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:55.728 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:55.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:55.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:55.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:55.729 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:55.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:55.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:56.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:56.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:56.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:56.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:56.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:56.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:56.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:57.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:57.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:58.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:58.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:58.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:58.062 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:58.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:58.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:58.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:58.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:58.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:26:59.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:26:59.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:26:59.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:26:59.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:26:59.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:26:59.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:26:59.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:26:59.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:26:59.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:00.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:00.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:00.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:00.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:00.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:00.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:00.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:00.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:00.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:01.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:01.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:01.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:01.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:01.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:01.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:01.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:01.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:02.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:02.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:02.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:02.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:02.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:02.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:02.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:02.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:02.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:03.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:04.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:04.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:05.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:05.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:05.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:05.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:05.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:05.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:05.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:05.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:05.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:06.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:06.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:06.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:06.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:06.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:06.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:06.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:06.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:06.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:07.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:07.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:07.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:07.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:07.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:07.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:07.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:07.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:07.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:08.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:08.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:08.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:08.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:08.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:08.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:08.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:08.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:08.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:09.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:09.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:09.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:09.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:09.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:09.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:09.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:09.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:09.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:10.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:10.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:10.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:10.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:10.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:10.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:10.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:11.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:11.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:12.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:12.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:12.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:12.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:12.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:12.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:12.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:12.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:12.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:13.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:13.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:13.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:13.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:13.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:13.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:13.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:13.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:13.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:14.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:14.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:14.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:14.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:14.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:14.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:14.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:14.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:14.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:15.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:15.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:15.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:15.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:15.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:15.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:15.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:15.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:15.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:16.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:16.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:16.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:16.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:16.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:16.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:16.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:16.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:16.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:17.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:17.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:17.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:17.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:17.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:17.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:17.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:18.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:18.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:19.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:19.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:19.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:19.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:19.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:19.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:19.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:19.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:19.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:20.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:20.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:20.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:20.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:20.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:20.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:20.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:20.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:20.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:21.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:21.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:21.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:21.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:21.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:21.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:21.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:21.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:21.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:22.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:22.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:22.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:22.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:22.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:22.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:22.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:22.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:22.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:23.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:23.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:23.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:23.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:23.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:23.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:23.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:23.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:23.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:24.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:24.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:24.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:24.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:24.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:24.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:24.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:25.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:25.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:26.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:26.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:26.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:26.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:26.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:26.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:26.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:26.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:26.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:27.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:27.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:27.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:27.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:27.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:27.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:27.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:27.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:27.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:28.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:28.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:28.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:28.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:28.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:28.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:28.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:28.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:28.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:29.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:29.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:29.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:29.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:29.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:29.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:29.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:29.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:29.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:30.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:30.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:30.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:30.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:30.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:30.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:30.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:30.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:30.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:31.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:31.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:31.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:31.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:31.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:31.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:32.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:32.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:33.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:33.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:33.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:33.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:33.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:33.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:33.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:33.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:34.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:34.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:34.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:34.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:34.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:34.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:34.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:34.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:34.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:35.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:35.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:35.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:35.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:35.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:35.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:35.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:35.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:35.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:36.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:36.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:36.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:36.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:36.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:36.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:36.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:36.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:36.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:37.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:37.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:37.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:37.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:37.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:37.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:37.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:37.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:37.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:38.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:38.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:38.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:38.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:38.910 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:38.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:38.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:39.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:39.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:40.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:40.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:40.077 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:40.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:40.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:40.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:41.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:41.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:41.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:41.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:41.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:41.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:41.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:41.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:41.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:42.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:42.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:42.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:42.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:42.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:42.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:42.411 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:42.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:42.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:43.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:43.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:43.576 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:43.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:43.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:44.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:44.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:44.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:44.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:44.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:44.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:44.743 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:44.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:44.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:45.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:45.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:45.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:45.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:45.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:45.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:45.909 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:47.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:47.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:47.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:47.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:47.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:47.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:47.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:47.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:48.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:48.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:48.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:48.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:48.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:48.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:48.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:48.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:48.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:49.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:49.411 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:49.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:49.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:49.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:49.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:49.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:49.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:49.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:50.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:50.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:50.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:50.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:50.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:50.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:50.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:50.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:50.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:51.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:51.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:51.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:51.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:51.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:51.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:51.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:51.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:51.910 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:52.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:52.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:52.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:52.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:52.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:52.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:52.913 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:53.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:53.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:54.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:54.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:54.078 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:54.079 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:54.079 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:54.079 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:54.079 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:54.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:54.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:55.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:55.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:55.245 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:55.246 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:55.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:55.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:56.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:56.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:56.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:56.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:56.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:56.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:56.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:56.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:56.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:57.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:57.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:57.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:57.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:57.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:57.581 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:57.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:57.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:57.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:58.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:58.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:58.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:58.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:58.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:58.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:58.747 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:27:58.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:27:58.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:27:59.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:27:59.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:27:59.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:27:59.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:27:59.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:27:59.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:27:59.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:00.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:00.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:01.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:01.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:01.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:01.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:01.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:01.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:01.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:01.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:01.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:02.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:02.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:02.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:02.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:02.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:02.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:02.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:02.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:02.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:03.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:03.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:03.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:03.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:03.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:03.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:03.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:03.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:03.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:04.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:04.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:04.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:04.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:04.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:04.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:04.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:04.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:04.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:05.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:05.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:05.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:05.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:05.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:05.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:05.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:05.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:05.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:06.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:06.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:06.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:06.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:06.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:06.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:06.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:07.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:07.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:08.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:08.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:08.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:08.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:08.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:08.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:08.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:08.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:08.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:09.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:09.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:09.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:09.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:09.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:09.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:09.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:09.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:09.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:10.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:10.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:10.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:10.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:10.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:10.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:10.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:10.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:10.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:11.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:11.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:11.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:11.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:11.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:11.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:11.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:11.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:11.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:12.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:12.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:12.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:12.777 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:12.777 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:12.777 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:12.777 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:12.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:12.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:13.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:13.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:13.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:13.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:13.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:13.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:13.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:14.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:14.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:15.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:15.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:15.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:16.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:16.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:16.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:16.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:16.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:16.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:16.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:16.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:16.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:17.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:17.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:17.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:17.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:17.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:17.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:17.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:17.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:17.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:18.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:18.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:18.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:18.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:18.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:18.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:19.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:19.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:19.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:19.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:19.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:19.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:19.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:19.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:19.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:20.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:20.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:20.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:20.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:20.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:20.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:20.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:21.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:21.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:22.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:22.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:22.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:22.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:22.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:22.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:22.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:22.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:22.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:23.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:23.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:23.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:23.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:23.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:24.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:24.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:24.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:24.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:24.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:24.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:24.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:24.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:25.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:25.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:25.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:25.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:25.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:25.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:25.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:25.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:25.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:26.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:26.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:26.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:27.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:27.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:27.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:27.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:27.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:27.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:27.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:28.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:28.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:29.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:29.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:29.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:29.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:29.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:29.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:29.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:29.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:29.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:30.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:30.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:30.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:30.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:30.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:30.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:30.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:30.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:30.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:31.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:31.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:31.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:31.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:31.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:31.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:31.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:31.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:31.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:32.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:32.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:32.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:32.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:32.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:33.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:33.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:33.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:33.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:33.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:33.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:33.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:34.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:34.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:34.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:34.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:34.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:34.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:34.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:35.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:36.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:36.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:36.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:36.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:36.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:36.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:36.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:36.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:36.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:37.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:37.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:37.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:37.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:37.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:37.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:37.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:37.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:37.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:38.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:38.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:38.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:38.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:38.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:38.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:38.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:38.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:38.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:39.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:39.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:39.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:39.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:39.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:39.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:39.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:39.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:39.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:40.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:40.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:40.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:40.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:40.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:40.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:40.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:40.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:40.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:41.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:41.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:41.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:41.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:41.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:41.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:41.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:42.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:42.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:43.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:43.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:43.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:43.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:43.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:43.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:43.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:43.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:43.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:44.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:44.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:44.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:44.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:44.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:44.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:44.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:44.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:45.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:45.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:45.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:45.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:45.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:45.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:45.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:45.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:45.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:46.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:46.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:46.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:46.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:46.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:46.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:46.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:46.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:46.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:47.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:47.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:48.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:48.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:48.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:48.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:48.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:48.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:48.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:49.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:49.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:50.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:50.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:50.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:50.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:50.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:50.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:50.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:50.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:50.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:51.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:51.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:51.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:51.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:51.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:51.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:51.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:51.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:51.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:52.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:52.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:52.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:52.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:52.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:52.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:52.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:52.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:52.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:53.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:53.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:53.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:53.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:53.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:53.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:53.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:53.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:53.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:54.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:54.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:54.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:54.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:54.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:54.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:54.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:54.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:54.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:55.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:55.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:55.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:55.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:55.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:55.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:55.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:56.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:56.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:57.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:57.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:57.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:57.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:57.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:57.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:57.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:57.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:57.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:58.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:58.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:58.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:58.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:58.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:58.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:58.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:58.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:58.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:28:59.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:28:59.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:28:59.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:28:59.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:28:59.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:28:59.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:28:59.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:28:59.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:28:59.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:00.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:00.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:00.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:00.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:00.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:00.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:00.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:00.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:00.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:01.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:01.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:01.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:02.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:02.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:02.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:02.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:02.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:02.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:02.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:03.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:03.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:04.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:04.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:04.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:04.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:04.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:04.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:04.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:04.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:04.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:05.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:05.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:05.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:05.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:05.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:05.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:05.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:05.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:06.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:06.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:06.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:06.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:06.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:06.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:06.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:06.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:06.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:07.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:07.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:07.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:07.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:07.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:07.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:07.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:07.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:07.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:08.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:08.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:08.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:08.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:08.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:08.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:08.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:08.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:08.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:09.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:09.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:09.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:10.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:10.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:11.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:11.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:11.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:11.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:11.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:11.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:11.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:11.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:11.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:12.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:12.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:12.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:12.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:12.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:13.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:13.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:13.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:13.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:13.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:13.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:13.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:13.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:13.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:14.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:14.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:14.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:14.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:14.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:14.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:14.598 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:14.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:14.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:15.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:15.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:15.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:15.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:15.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:15.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:15.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:15.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:15.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:16.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:16.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:16.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:16.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:16.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:16.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:16.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:17.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:17.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:18.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:18.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:18.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:18.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:18.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:18.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:18.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:18.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:18.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:19.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:19.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:19.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:19.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:19.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:19.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:19.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:19.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:19.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:20.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:20.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:20.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:20.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:20.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:20.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:20.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:20.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:20.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:21.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:21.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:21.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:21.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:21.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:21.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:21.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:21.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:22.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:22.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:22.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:22.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:22.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:22.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:22.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:22.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:22.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:23.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:23.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:23.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:23.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:23.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:23.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:23.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:24.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:24.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:25.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:25.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:25.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:25.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:25.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:25.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:25.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:25.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:25.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:26.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:26.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:26.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:26.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:26.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:26.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:26.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:26.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:26.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:27.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:27.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:27.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:27.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:27.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:27.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:27.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:27.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:27.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:28.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:28.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:28.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:28.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:28.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:28.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:28.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:28.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:28.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:29.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:29.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:29.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:29.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:29.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:29.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:29.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:29.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:29.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:30.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:30.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:30.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:30.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:30.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:30.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:30.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:31.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:31.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:32.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:32.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:32.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:32.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:32.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:32.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:32.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:32.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:32.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:33.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:33.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:33.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:33.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:33.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:33.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:33.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:33.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:33.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:34.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:34.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:34.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:34.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:34.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:34.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:34.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:34.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:34.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:35.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:35.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:35.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:35.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:35.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:35.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:35.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:35.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:36.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:36.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:36.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:36.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:36.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:36.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:36.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:36.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:36.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:37.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:37.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:37.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:37.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:37.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:37.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:37.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:38.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:38.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:39.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:39.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:39.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:39.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:39.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:39.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:39.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:39.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:39.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:40.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:40.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:40.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:40.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:40.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:40.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:40.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:40.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:40.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:41.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:41.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:41.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:41.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:41.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:41.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:41.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:41.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:41.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:42.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:42.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:42.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:42.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:42.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:42.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:42.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:42.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:42.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:43.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:43.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:43.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:43.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:43.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:43.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:43.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:43.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:43.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:44.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:44.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:44.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:44.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:44.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:44.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:44.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:45.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:45.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:46.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:46.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:46.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:46.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:46.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:46.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:46.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:46.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:46.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:47.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:47.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:47.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:47.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:47.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:47.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:47.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:47.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:47.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:48.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:48.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:48.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:48.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:48.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:48.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:48.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:48.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:48.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:49.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:49.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:49.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:49.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:49.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:49.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:49.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:49.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:50.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:50.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:50.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:50.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:50.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:50.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:50.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:51.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:51.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:51.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:52.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:52.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:53.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:53.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:53.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:53.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:53.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:53.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:53.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:54.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:54.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:54.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:54.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:54.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:54.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:54.262 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:54.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:54.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:55.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:55.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:55.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:55.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:55.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:55.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:55.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:55.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:55.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:56.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:56.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:56.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:56.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:56.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:56.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:56.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:56.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:56.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:57.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:57.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:57.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:57.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:57.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:57.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:57.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:57.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:57.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:29:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:29:58.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:29:58.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:29:58.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:29:58.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:29:58.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:29:58.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:29:59.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:29:59.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:00.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:00.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:00.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:00.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:00.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:00.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:00.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:01.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:01.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:01.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:01.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:01.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:01.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:01.256 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:01.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:01.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:02.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:02.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:02.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:02.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:02.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:02.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:02.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:02.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:02.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:03.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:03.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:03.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:03.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:03.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:03.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:03.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:03.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:03.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:04.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:04.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:04.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:04.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:04.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:04.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:04.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:04.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:04.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:05.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:05.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:05.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:05.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:05.926 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:06.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:06.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:07.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:07.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:07.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:07.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:07.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:07.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:07.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:07.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:07.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:08.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:08.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:08.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:08.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:08.258 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:08.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:08.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:08.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:08.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:09.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:09.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:09.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:09.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:09.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:09.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:09.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:09.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:09.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:10.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:10.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:10.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:10.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:10.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:10.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:10.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:10.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:10.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:11.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:11.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:11.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:11.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:11.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:11.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:11.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:11.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:11.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:12.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:12.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:12.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:12.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:12.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:12.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:12.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:13.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:13.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:14.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:14.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:14.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:14.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:14.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:14.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:14.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:14.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:14.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:15.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:15.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:15.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:15.249 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:15.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:15.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:15.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:15.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:15.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:16.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:16.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:16.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:16.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:16.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:16.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:16.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:16.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:16.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:17.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:17.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:17.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:17.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:17.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:17.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:17.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:17.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:17.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:18.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:18.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:18.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:18.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:18.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:18.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:18.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:18.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:18.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:19.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:19.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:19.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:19.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:19.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:19.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:19.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:20.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:20.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:21.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:21.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:21.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:21.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:21.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:21.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:21.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:21.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:21.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:22.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:22.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:22.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:22.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:22.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:22.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:22.260 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:22.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:22.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:23.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:23.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:23.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:23.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:23.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:23.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:23.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:23.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:23.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:24.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:24.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:24.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:24.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:24.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:24.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:24.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:24.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:24.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:25.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:25.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:25.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:25.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:25.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:25.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:25.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:25.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:25.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:26.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:26.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:26.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:27.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:27.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:28.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:28.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:28.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:28.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:28.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:28.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:28.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:28.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:28.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:29.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:29.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:29.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:29.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:29.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:29.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:29.259 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:29.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:29.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:30.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:30.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:30.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:30.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:30.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:30.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:30.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:30.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:30.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:31.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:31.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:31.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:31.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:31.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:31.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:31.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:31.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:31.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:32.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:32.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:32.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:32.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:32.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:32.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:32.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:32.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:32.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:33.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:33.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:33.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:33.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:33.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:33.929 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:34.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:34.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:35.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:35.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:35.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:35.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:35.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:35.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:35.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:35.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:35.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:36.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:36.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:36.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:36.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:36.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:36.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:36.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:36.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:36.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:37.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:37.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:37.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:37.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:37.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:37.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:37.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:37.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:37.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:38.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:38.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:38.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:38.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:38.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:38.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:38.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:39.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:39.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:39.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:39.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:39.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:39.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:39.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:39.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:39.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:40.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:40.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:40.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:40.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:40.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:40.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:40.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:41.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:41.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:42.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:42.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:42.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:42.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:42.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:42.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:43.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:43.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:43.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:43.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:43.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:43.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:43.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:43.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:43.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:44.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:44.429 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:44.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:44.429 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:44.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:44.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:44.430 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:44.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:44.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:45.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:45.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:45.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:45.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:45.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:45.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:45.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:45.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:45.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:46.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:46.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:46.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:46.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:46.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:46.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:46.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:46.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:46.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:47.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:47.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:47.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:47.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:47.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:47.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:47.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:48.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:48.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:49.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:49.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:49.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:49.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:49.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:49.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:49.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:49.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:49.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:50.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:50.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:50.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:50.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:50.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:50.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:50.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:50.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:50.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:51.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:51.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:51.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:51.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:51.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:51.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:51.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:51.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:51.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:52.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:52.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:52.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:52.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:52.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:52.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:52.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:52.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:52.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:53.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:53.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:53.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:53.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:53.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:53.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:53.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:53.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:53.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:54.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:54.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:54.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:54.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:54.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:54.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:54.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:55.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:55.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:56.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:56.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:56.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:56.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:56.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:56.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:56.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:57.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:57.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:57.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:57.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:57.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:57.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:57.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:57.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:57.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:58.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:58.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:58.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:58.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:58.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:58.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:58.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:58.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:58.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:30:59.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:30:59.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:30:59.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:30:59.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:30:59.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:30:59.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:30:59.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:30:59.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:30:59.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:31:00.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:31:00.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:31:00.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:31:01.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:31:01.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:31:01.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:31:01.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:31:01.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:31:01.938 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:31:01.939 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:31:02.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:24:27.308524+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:31:02.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:31:03.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:31:03.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:31:03.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:31:03.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:31:03.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:31:03.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:31:03.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:31:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:31:01.246623+0000 '>' 2026-02-23T08:24:27.308524+0000 2026-02-23T08:31:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:31:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:400: _scrub_abort: perf_counters td/osd-scrub-test 3 2026-02-23T08:31:03.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:31:03.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:31:03.276 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:31:03.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:31:03.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:03.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:31:03.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:31:03.349 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.350 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.351 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.352 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.353 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.354 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:31:03.355 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:03.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:03.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:31:03.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.421 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 67, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.422 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.423 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:31:03.424 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:03.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:03.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:31:03.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.493 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:03.494 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.495 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:03.496 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:31:03.497 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:03.498 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_deep_scrub_abort ------------------' 2026-02-23T08:31:03.498 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_deep_scrub_abort ------------------ 2026-02-23T08:31:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:31:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:31:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:31:03.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:31:03.499 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:31:03.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:31:03.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:31:03.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:31:03.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:31:03.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:31:03.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:31:03.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:31:03.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:31:03.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:31:03.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:31:03.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:31:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:31:03.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:31:03.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:03.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:31:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:31:03.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:31:03.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:31:03.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:31:03.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:31:03.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:31:03.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_deep_scrub_abort ------------------' 2026-02-23T08:31:03.659 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_deep_scrub_abort ------------------ 2026-02-23T08:31:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:31:03.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_dump_scrub_schedule -------------------' 2026-02-23T08:31:03.660 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_dump_scrub_schedule ------------------- 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:31:03.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:31:03.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:31:03.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:31:03.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:31:03.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:31:03.664 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:31:03.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:03.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:31:03.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:31:03.665 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:03.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:31:03.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:31:03.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:31:03.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:31:03.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:31:03.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:31:03.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:31:03.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:31:03.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:31:03.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.671 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:31:03.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:31:03.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:31:03.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:31:03.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:31:03.673 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_dump_scrub_schedule ----------------------- 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_dump_scrub_schedule -----------------------' 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_dump_scrub_schedule td/osd-scrub-test 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:530: TEST_dump_scrub_schedule: local dir=td/osd-scrub-test 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:531: TEST_dump_scrub_schedule: local poolname=test 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:532: TEST_dump_scrub_schedule: local OSDS=3 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:533: TEST_dump_scrub_schedule: local objects=90 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:535: TEST_dump_scrub_schedule: TESTDATA=testdata.889699 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:537: TEST_dump_scrub_schedule: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-23T08:31:03.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:31:03.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:31:03.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:31:03.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:31:03.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:31:03.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-23T08:31:03.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:03.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-23T08:31:03.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:31:03.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:31:03.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:31:03.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:31:03.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:31:03.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:31:03.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:31:03.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:31:03.773 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:31:03.774 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.774 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.774 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:31:03.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:31:03.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:31:03.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:538: TEST_dump_scrub_schedule: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:31:03.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:31:03.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:31:03.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:31:03.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:31:03.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:31:03.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:31:03.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:31:03.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:03.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:03.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:03.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:03.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:31:03.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:31:03.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:552: TEST_dump_scrub_schedule: local 'ceph_osd_args=--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-23T08:31:03.939 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: expr 3 - 1 2026-02-23T08:31:03.940 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: seq 0 2 2026-02-23T08:31:03.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:03.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:556: TEST_dump_scrub_schedule: run_osd td/osd-scrub-test 0 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-23T08:31:03.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:31:03.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:31:03.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:31:03.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5b4c6669-6c61-432f-9de0-4712420213f7 2026-02-23T08:31:03.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5b4c6669-6c61-432f-9de0-4712420213f7' 2026-02-23T08:31:03.948 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 5b4c6669-6c61-432f-9de0-4712420213f7 2026-02-23T08:31:03.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:31:03.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBHEJxpHd6uOBAA3z0FVltQZlMLIOdEKpv+PQ== 2026-02-23T08:31:03.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBHEJxpHd6uOBAA3z0FVltQZlMLIOdEKpv+PQ=="}' 2026-02-23T08:31:03.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5b4c6669-6c61-432f-9de0-4712420213f7 -i td/osd-scrub-test/0/new.json 2026-02-23T08:31:04.039 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:04.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:31:04.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 --mkfs --key AQBHEJxpHd6uOBAA3z0FVltQZlMLIOdEKpv+PQ== --osd-uuid 5b4c6669-6c61-432f-9de0-4712420213f7 2026-02-23T08:31:04.064 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.063+0000 7fdfe1b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:04.066 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.064+0000 7fdfe1b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:04.067 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.065+0000 7fdfe1b4f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:04.068 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.066+0000 7fdfe1b4f780 -1 bdev(0x5613a8a5b400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:31:04.068 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.066+0000 7fdfe1b4f780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:31:04.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:31:04.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:31:04.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:31:04.476 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:31:04.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:31:04.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:31:04.572 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:31:04.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-23T08:31:04.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:31:04.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:31:04.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:31:04.587 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.586+0000 7ff463351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:04.589 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.587+0000 7ff463351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:04.589 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.588+0000 7ff463351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:04.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:31:04.664 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:04.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:04.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:31:04.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:31:04.810 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:04.808+0000 7ff463351780 -1 Falling back to public interface 2026-02-23T08:31:05.209 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:05.207+0000 7ff463351780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:31:05.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:31:05.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:05.757 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:05.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:31:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:05.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:31:05.847 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3775806337,v1:127.0.0.1:6801/3775806337] [v2:127.0.0.1:6802/3775806337,v1:127.0.0.1:6803/3775806337] exists,up 5b4c6669-6c61-432f-9de0-4712420213f7 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:556: TEST_dump_scrub_schedule: run_osd td/osd-scrub-test 1 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:31:05.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:05.849 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-23T08:31:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:31:05.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:31:05.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b3e3a917-ff8a-4daa-979a-5030ed0081a1 2026-02-23T08:31:05.852 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 b3e3a917-ff8a-4daa-979a-5030ed0081a1 2026-02-23T08:31:05.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b3e3a917-ff8a-4daa-979a-5030ed0081a1' 2026-02-23T08:31:05.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:31:05.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBJEJxpumEuMxAAC/AJtCR+Jb5VLuGnhnBqZg== 2026-02-23T08:31:05.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBJEJxpumEuMxAAC/AJtCR+Jb5VLuGnhnBqZg=="}' 2026-02-23T08:31:05.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b3e3a917-ff8a-4daa-979a-5030ed0081a1 -i td/osd-scrub-test/1/new.json 2026-02-23T08:31:05.947 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:05.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:31:05.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 --mkfs --key AQBJEJxpumEuMxAAC/AJtCR+Jb5VLuGnhnBqZg== --osd-uuid b3e3a917-ff8a-4daa-979a-5030ed0081a1 2026-02-23T08:31:05.972 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:05.970+0000 7f0c18e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:05.973 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:05.972+0000 7f0c18e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:05.974 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:05.973+0000 7f0c18e0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:05.975 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:05.973+0000 7f0c18e0f780 -1 bdev(0x557d6d42f400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:31:05.975 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:05.973+0000 7f0c18e0f780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:31:06.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:31:06.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:31:06.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:31:06.367 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:31:06.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:31:06.572 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:31:06.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:31:06.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-23T08:31:06.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:31:06.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:31:06.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:31:06.586 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:06.584+0000 7f85e1b52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:06.587 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:06.585+0000 7f85e1b52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:06.588 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:06.586+0000 7f85e1b52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:06.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:31:06.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:31:06.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:31:06.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:31:06.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:31:06.738 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:06.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:31:06.739 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:06.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:06.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:31:06.789 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:06.787+0000 7f85e1b52780 -1 Falling back to public interface 2026-02-23T08:31:06.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:31:07.108 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:07.106+0000 7f85e1b52780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:31:07.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:31:07.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:07.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:31:07.904 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:07.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:07.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:31:08.067 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/591219309,v1:127.0.0.1:6811/591219309] [v2:127.0.0.1:6812/591219309,v1:127.0.0.1:6813/591219309] exists,up b3e3a917-ff8a-4daa-979a-5030ed0081a1 2026-02-23T08:31:08.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:31:08.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:31:08.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:31:08.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:554: TEST_dump_scrub_schedule: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:556: TEST_dump_scrub_schedule: run_osd td/osd-scrub-test 2 --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:31:08.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:08.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2' 2026-02-23T08:31:08.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:31:08.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:31:08.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=da226bcb-41a1-4048-8337-cbb459d03a1c 2026-02-23T08:31:08.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 da226bcb-41a1-4048-8337-cbb459d03a1c' 2026-02-23T08:31:08.075 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 da226bcb-41a1-4048-8337-cbb459d03a1c 2026-02-23T08:31:08.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:31:08.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMEJxpFlWsBBAA9YH6YrMSO2UDlsRzkjq5vw== 2026-02-23T08:31:08.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMEJxpFlWsBBAA9YH6YrMSO2UDlsRzkjq5vw=="}' 2026-02-23T08:31:08.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new da226bcb-41a1-4048-8337-cbb459d03a1c -i td/osd-scrub-test/2/new.json 2026-02-23T08:31:08.237 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:31:08.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-23T08:31:08.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 --mkfs --key AQBMEJxpFlWsBBAA9YH6YrMSO2UDlsRzkjq5vw== --osd-uuid da226bcb-41a1-4048-8337-cbb459d03a1c 2026-02-23T08:31:08.264 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.262+0000 7f44c880c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:08.265 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.263+0000 7f44c880c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:08.266 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.264+0000 7f44c880c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:08.267 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.265+0000 7f44c880c780 -1 bdev(0x563f64693400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:31:08.267 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.265+0000 7f44c880c780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:31:08.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-23T08:31:08.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:31:08.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:31:08.684 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:31:08.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:31:08.890 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:31:08.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:31:08.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_deep_scrub_randomize_ratio=0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_backoff_ratio=0.0 --osd_op_queue=wpq --osd_stats_update_period_not_scrubbing=1 --osd_stats_update_period_scrubbing=1 --osd_scrub_retry_after_noscrub=1 --osd_scrub_retry_pg_state=2 --osd_scrub_retry_delay=2 --osd_scrub_sleep=0.2 2026-02-23T08:31:08.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:31:08.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:31:08.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:31:08.905 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.904+0000 7f3abc54f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:08.907 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.905+0000 7f3abc54f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:08.907 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:08.906+0000 7f3abc54f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:09.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:31:09.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:31:09.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:31:09.087 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:09.086+0000 7f3abc54f780 -1 Falling back to public interface 2026-02-23T08:31:09.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:31:09.471 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:09.469+0000 7f3abc54f780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:31:10.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:31:10.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:10.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:31:10.224 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:10.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:10.225 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:31:10.388 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3174772170,v1:127.0.0.1:6819/3174772170] [v2:127.0.0.1:6820/3174772170,v1:127.0.0.1:6821/3174772170] exists,up da226bcb-41a1-4048-8337-cbb459d03a1c 2026-02-23T08:31:10.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:31:10.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:31:10.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:31:10.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:560: TEST_dump_scrub_schedule: create_pool test 1 1 2026-02-23T08:31:10.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:31:10.631 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:31:10.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:31:11.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:561: TEST_dump_scrub_schedule: wait_for_clean 2026-02-23T08:31:11.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:31:11.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:31:11.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:31:11.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:31:11.645 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:31:11.645 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:31:11.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:31:11.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:31:11.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:31:11.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:31:11.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:31:11.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:31:11.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:31:11.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:31:11.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:31:11.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:31:11.889 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:31:11.889 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:31:11.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:31:11.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:31:11.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:31:11.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:31:11.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:31:11.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:31:11.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:31:11.961 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:31:12.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-23T08:31:12.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-23T08:31:12.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-23T08:31:12.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:31:12.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:31:12.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-23T08:31:12.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-23T08:31:12.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-55834574851' 2026-02-23T08:31:12.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:31:12.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:31:12.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:31:12.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:31:12.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:31:12.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:31:12.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:31:12.111 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:31:12.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:31:12.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:31:12.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:31:12.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:31:13.278 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:31:13.279 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:31:13.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:31:13.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:31:14.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:31:14.445 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:31:14.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836487 2026-02-23T08:31:14.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:31:14.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-23T08:31:14.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:31:14.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:31:14.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-23T08:31:14.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:31:14.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-23T08:31:14.622 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705669 2026-02-23T08:31:14.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-23T08:31:14.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:31:14.787 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705669 2026-02-23T08:31:14.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:31:14.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-23T08:31:14.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:31:14.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:31:14.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-23T08:31:14.789 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:31:14.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-23T08:31:14.791 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574851 2026-02-23T08:31:14.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-23T08:31:14.791 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:31:14.956 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574851 2026-02-23T08:31:14.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:31:14.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:31:14.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:31:15.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:31:15.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:31:15.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:31:15.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:31:15.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:31:15.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:31:15.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:31:15.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:31:15.326 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:31:15.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:31:15.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:31:15.327 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:31:15.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:31:15.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:31:15.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:31:15.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: ceph osd dump 2026-02-23T08:31:15.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: grep '^pool.*['\'']test['\'']' 2026-02-23T08:31:15.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: awk '{ print $2 }' 2026-02-23T08:31:15.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:562: TEST_dump_scrub_schedule: poolid=1 2026-02-23T08:31:15.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:564: TEST_dump_scrub_schedule: dd if=/dev/urandom of=testdata.889699 bs=1032 count=1 2026-02-23T08:31:15.698 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:31:15.698 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:31:15.698 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 1.8635e-05 s, 55.4 MB/s 2026-02-23T08:31:15.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: seq 1 90 2026-02-23T08:31:15.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj1 testdata.889699 2026-02-23T08:31:15.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj2 testdata.889699 2026-02-23T08:31:15.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.729 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj3 testdata.889699 2026-02-23T08:31:15.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj4 testdata.889699 2026-02-23T08:31:15.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj5 testdata.889699 2026-02-23T08:31:15.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj6 testdata.889699 2026-02-23T08:31:15.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj7 testdata.889699 2026-02-23T08:31:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj8 testdata.889699 2026-02-23T08:31:15.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj9 testdata.889699 2026-02-23T08:31:15.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj10 testdata.889699 2026-02-23T08:31:15.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj11 testdata.889699 2026-02-23T08:31:15.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj12 testdata.889699 2026-02-23T08:31:15.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj13 testdata.889699 2026-02-23T08:31:15.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj14 testdata.889699 2026-02-23T08:31:15.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.906 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj15 testdata.889699 2026-02-23T08:31:15.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj16 testdata.889699 2026-02-23T08:31:15.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj17 testdata.889699 2026-02-23T08:31:15.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj18 testdata.889699 2026-02-23T08:31:15.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj19 testdata.889699 2026-02-23T08:31:15.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj20 testdata.889699 2026-02-23T08:31:15.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:15.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj21 testdata.889699 2026-02-23T08:31:16.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj22 testdata.889699 2026-02-23T08:31:16.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj23 testdata.889699 2026-02-23T08:31:16.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj24 testdata.889699 2026-02-23T08:31:16.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj25 testdata.889699 2026-02-23T08:31:16.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj26 testdata.889699 2026-02-23T08:31:16.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj27 testdata.889699 2026-02-23T08:31:16.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj28 testdata.889699 2026-02-23T08:31:16.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj29 testdata.889699 2026-02-23T08:31:16.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj30 testdata.889699 2026-02-23T08:31:16.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj31 testdata.889699 2026-02-23T08:31:16.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj32 testdata.889699 2026-02-23T08:31:16.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj33 testdata.889699 2026-02-23T08:31:16.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj34 testdata.889699 2026-02-23T08:31:16.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj35 testdata.889699 2026-02-23T08:31:16.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj36 testdata.889699 2026-02-23T08:31:16.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj37 testdata.889699 2026-02-23T08:31:16.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj38 testdata.889699 2026-02-23T08:31:16.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj39 testdata.889699 2026-02-23T08:31:16.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj40 testdata.889699 2026-02-23T08:31:16.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj41 testdata.889699 2026-02-23T08:31:16.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj42 testdata.889699 2026-02-23T08:31:16.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj43 testdata.889699 2026-02-23T08:31:16.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj44 testdata.889699 2026-02-23T08:31:16.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj45 testdata.889699 2026-02-23T08:31:16.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj46 testdata.889699 2026-02-23T08:31:16.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj47 testdata.889699 2026-02-23T08:31:16.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj48 testdata.889699 2026-02-23T08:31:16.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj49 testdata.889699 2026-02-23T08:31:16.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj50 testdata.889699 2026-02-23T08:31:16.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj51 testdata.889699 2026-02-23T08:31:16.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj52 testdata.889699 2026-02-23T08:31:16.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj53 testdata.889699 2026-02-23T08:31:16.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj54 testdata.889699 2026-02-23T08:31:16.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj55 testdata.889699 2026-02-23T08:31:16.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj56 testdata.889699 2026-02-23T08:31:16.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj57 testdata.889699 2026-02-23T08:31:16.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj58 testdata.889699 2026-02-23T08:31:16.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj59 testdata.889699 2026-02-23T08:31:16.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj60 testdata.889699 2026-02-23T08:31:16.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj61 testdata.889699 2026-02-23T08:31:16.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj62 testdata.889699 2026-02-23T08:31:16.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj63 testdata.889699 2026-02-23T08:31:16.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj64 testdata.889699 2026-02-23T08:31:16.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj65 testdata.889699 2026-02-23T08:31:16.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj66 testdata.889699 2026-02-23T08:31:16.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj67 testdata.889699 2026-02-23T08:31:16.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj68 testdata.889699 2026-02-23T08:31:16.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj69 testdata.889699 2026-02-23T08:31:16.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj70 testdata.889699 2026-02-23T08:31:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj71 testdata.889699 2026-02-23T08:31:16.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.739 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj72 testdata.889699 2026-02-23T08:31:16.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.753 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj73 testdata.889699 2026-02-23T08:31:16.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj74 testdata.889699 2026-02-23T08:31:16.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj75 testdata.889699 2026-02-23T08:31:16.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj76 testdata.889699 2026-02-23T08:31:16.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj77 testdata.889699 2026-02-23T08:31:16.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj78 testdata.889699 2026-02-23T08:31:16.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj79 testdata.889699 2026-02-23T08:31:16.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj80 testdata.889699 2026-02-23T08:31:16.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj81 testdata.889699 2026-02-23T08:31:16.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj82 testdata.889699 2026-02-23T08:31:16.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj83 testdata.889699 2026-02-23T08:31:16.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj84 testdata.889699 2026-02-23T08:31:16.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.928 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj85 testdata.889699 2026-02-23T08:31:16.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj86 testdata.889699 2026-02-23T08:31:16.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj87 testdata.889699 2026-02-23T08:31:16.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj88 testdata.889699 2026-02-23T08:31:16.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:16.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj89 testdata.889699 2026-02-23T08:31:17.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:565: TEST_dump_scrub_schedule: for i in `seq 1 $objects` 2026-02-23T08:31:17.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:567: TEST_dump_scrub_schedule: rados -p test put obj90 testdata.889699 2026-02-23T08:31:17.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:569: TEST_dump_scrub_schedule: rm -f testdata.889699 2026-02-23T08:31:17.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:571: TEST_dump_scrub_schedule: local pgid=1.0 2026-02-23T08:31:17.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:573: TEST_dump_scrub_schedule: date +%Y-%m-%dT%H:%M:%S.%N%:z 2026-02-23T08:31:17.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:573: TEST_dump_scrub_schedule: local now_is=2026-02-23T08:31:17.019399414+00:00 2026-02-23T08:31:17.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:581: TEST_dump_scrub_schedule: expct_starting=(['query_active']='false' ['query_is_future']='true' ['query_schedule']='scrub scheduled') 2026-02-23T08:31:17.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:581: TEST_dump_scrub_schedule: declare -A expct_starting 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:582: TEST_dump_scrub_schedule: declare -A sched_data 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:583: TEST_dump_scrub_schedule: extract_published_sch 1.0 2026-02-23T08:31:17.019399414+00:00 2019-10-12T20:32:43.645168+0000 sched_data 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.0 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sched_data 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-23T08:31:17.019399414+00:00 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2019-10-12T20:32:43.645168+0000 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-23T08:31:17.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-23T08:31:17.179 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 0, 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-24T08:31:10.629491+0000", 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 17, 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 16 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:17.190 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:17.261 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:31:10.629491+0000", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-24T08:31:10.629 (2026-02-24T08:31:10.629)", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:31:10.629491+0000", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:31:10.629491+0000", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-03-01T20:33:05.123019+0000", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-03-01T20:33:05.123019+0000", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:17.262 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:17.336 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=17 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=108 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-24T08:31:10.629' 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-24T08:31:10.629' 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=0 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:31:10.629491+0000' 2026-02-23T08:31:17.337 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='0x0' 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=true 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=0 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-24T08:31:10.629491+0000' 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=17 2026-02-23T08:31:17.338 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=16 2026-02-23T08:31:17.339 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:584: TEST_dump_scrub_schedule: schedule_against_expected sched_data expct_starting initial 2026-02-23T08:31:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:178: schedule_against_expected: local -n dict=sched_data 2026-02-23T08:31:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:179: schedule_against_expected: local -n ep=expct_starting 2026-02-23T08:31:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:180: schedule_against_expected: local extr_dbg=1 2026-02-23T08:31:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:183: schedule_against_expected: local saved_echo_flag=x 2026-02-23T08:31:17.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:184: schedule_against_expected: set +x 2026-02-23T08:31:17.341 INFO:tasks.workunit.client.0.trial129.stdout:-- - comparing: 2026-02-23T08:31:17.341 INFO:tasks.workunit.client.0.trial129.stdout:key is query_schedule expected: scrub scheduled in actual: scrub scheduled 2026-02-23T08:31:17.341 INFO:tasks.workunit.client.0.trial129.stdout:key is query_is_future expected: true in actual: true 2026-02-23T08:31:17.341 INFO:tasks.workunit.client.0.trial129.stdout:key is query_active expected: false in actual: false 2026-02-23T08:31:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:203: schedule_against_expected: return 0 2026-02-23T08:31:17.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:585: TEST_dump_scrub_schedule: (( 0 == 0 )) 2026-02-23T08:31:17.342 INFO:tasks.workunit.client.0.trial129.stdout:last-scrub --- 0x0 2026-02-23T08:31:17.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:586: TEST_dump_scrub_schedule: echo 'last-scrub --- ' 0x0 2026-02-23T08:31:17.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:592: TEST_dump_scrub_schedule: saved_last_stamp=2026-02-23T08:31:10.629491+0000 2026-02-23T08:31:17.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:593: TEST_dump_scrub_schedule: ceph tell 'osd.*' config set osd_scrub_sleep 0 2026-02-23T08:31:17.401 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:31:17.402 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:31:17.402 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:17.408 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:31:17.409 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:31:17.409 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:17.415 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:31:17.415 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:31:17.415 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:17.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:594: TEST_dump_scrub_schedule: ceph tell 1.0 deep-scrub 2026-02-23T08:31:17.484 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:17.484 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:31:17.484 INFO:tasks.workunit.client.0.trial129.stdout: "must": true, 2026-02-23T08:31:17.484 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "0.000000" 2026-02-23T08:31:17.484 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:17.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:599: TEST_dump_scrub_schedule: sleep 5 2026-02-23T08:31:22.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:600: TEST_dump_scrub_schedule: sched_data=() 2026-02-23T08:31:22.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:601: TEST_dump_scrub_schedule: expct_qry_duration=(['query_last_duration']='0' ['query_last_duration_neg']='not0') 2026-02-23T08:31:22.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:601: TEST_dump_scrub_schedule: declare -A expct_qry_duration 2026-02-23T08:31:22.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:602: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-23T08:31:10.629491+0000 expct_qry_duration 'WaitingAfterScrub ' sched_data 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-23T08:31:10.629491+0000 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_qry_duration 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-23T08:31:22.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-23T08:31:22.497 INFO:tasks.workunit.client.0.trial129.stdout:waiting for any condition (WaitingAfterScrub ): pg:1.0 dt:2026-02-23T08:31:10.629491+0000 (10 retries) 2026-02-23T08:31:23.154 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:23.164 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:23.164 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 17, 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 124 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:23.165 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-24T08:31:18.294 (2026-02-24T08:31:18.294)", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:23.237 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-28T22:14:58.638996+0000", 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-28T22:14:58.638996+0000", 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:23.238 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:23.311 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:23.311 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=17 2026-02-23T08:31:23.311 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=126 2026-02-23T08:31:23.311 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-24T08:31:18.294' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-24T08:31:18.294' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:31:18.294546+0000' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=true 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-24T08:31:18.294546+0000' 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=17 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=124 2026-02-23T08:31:23.312 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:23.314 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 1 ~ false / 126 / 124 / true / 2026-02-23T08:31:18.294546+0000 / scrub scheduled %%% query_last_duration_neg query_last_duration 2026-02-23T08:31:23.314 INFO:tasks.workunit.client.0.trial129.stdout:key is query_last_duration: negation:1 # expected: 0 # in actual: 1 2026-02-23T08:31:23.314 INFO:tasks.workunit.client.0.trial129.stdout:WaitingAfterScrub - 'query_last_duration' actual value (1) matches expected (0) (negation: 1) 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:604: TEST_dump_scrub_schedule: sched_data=() 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:605: TEST_dump_scrub_schedule: expct_dmp_duration=(['dmp_last_duration']='0' ['dmp_last_duration_neg']='not0') 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:605: TEST_dump_scrub_schedule: declare -A expct_dmp_duration 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:606: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-23T08:31:10.629491+0000 expct_dmp_duration 'WaitingAfterScrub_dmp ' sched_data 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-23T08:31:10.629491+0000 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_dmp_duration 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-23T08:31:23.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-23T08:31:23.316 INFO:tasks.workunit.client.0.trial129.stdout:waiting for any condition (WaitingAfterScrub_dmp ): pg:1.0 dt:2026-02-23T08:31:10.629491+0000 (10 retries) 2026-02-23T08:31:23.972 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:23.983 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:23.983 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 17, 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 125 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:23.984 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-24T08:31:18.294 (2026-02-24T08:31:18.294)", 2026-02-23T08:31:24.057 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:31:18.294546+0000", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:24.058 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-28T22:14:58.638996+0000", 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-28T22:14:58.638996+0000", 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:24.059 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:24.060 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:24.060 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:24.131 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=17 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=126 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-24T08:31:18.294' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-24T08:31:18.294' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:31:18.294546+0000' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=true 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-24T08:31:18.294546+0000' 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=17 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=125 2026-02-23T08:31:24.132 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:24.134 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 1 ~ false / 126 / 125 / true / 2026-02-23T08:31:18.294546+0000 / scrub scheduled %%% dmp_last_duration dmp_last_duration_neg 2026-02-23T08:31:24.135 INFO:tasks.workunit.client.0.trial129.stdout:key is dmp_last_duration: negation:1 # expected: 0 # in actual: 1 2026-02-23T08:31:24.135 INFO:tasks.workunit.client.0.trial129.stdout:WaitingAfterScrub_dmp - 'dmp_last_duration' actual value (1) matches expected (0) (negation: 1) 2026-02-23T08:31:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-23T08:31:24.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:613: TEST_dump_scrub_schedule: ceph osd set noscrub 2026-02-23T08:31:24.341 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:31:24.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:614: TEST_dump_scrub_schedule: sleep 2 2026-02-23T08:31:26.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:615: TEST_dump_scrub_schedule: ceph tell 'osd.*' config set osd_shallow_scrub_chunk_max 3 2026-02-23T08:31:26.421 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:31:26.421 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:31:26.421 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:26.428 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:31:26.428 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:31:26.428 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:26.436 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:31:26.436 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_shallow_scrub_chunk_max = '' " 2026-02-23T08:31:26.436 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:26.445 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:616: TEST_dump_scrub_schedule: ceph tell 'osd.*' config set osd_scrub_sleep 2.0 2026-02-23T08:31:26.509 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:31:26.509 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:31:26.509 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:26.516 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:31:26.516 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:31:26.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:26.523 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:31:26.523 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_sleep = '' " 2026-02-23T08:31:26.523 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:26.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:617: TEST_dump_scrub_schedule: sleep 8 2026-02-23T08:31:34.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:618: TEST_dump_scrub_schedule: saved_last_stamp=2026-02-23T08:31:18.294546+0000 2026-02-23T08:31:34.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:620: TEST_dump_scrub_schedule: ceph tell 1.0 schedule-scrub 2026-02-23T08:31:34.599 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:34.599 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:31:34.599 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:31:34.599 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:31:34.599310+0000" 2026-02-23T08:31:34.599 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:34.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:621: TEST_dump_scrub_schedule: sleep 1 2026-02-23T08:31:35.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:622: TEST_dump_scrub_schedule: sched_data=() 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:623: TEST_dump_scrub_schedule: expct_scrub_peri_sched=(['query_is_future']='false') 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:623: TEST_dump_scrub_schedule: declare -A expct_scrub_peri_sched 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:624: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-23T08:31:18.294546+0000 expct_scrub_peri_sched waitingBeingScheduled sched_data 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-23T08:31:18.294546+0000 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_scrub_peri_sched 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-23T08:31:35.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-23T08:31:35.613 INFO:tasks.workunit.client.0.trial129.stdout:waiting for any condition (waitingBeingScheduled): pg:1.0 dt:2026-02-23T08:31:18.294546+0000 (10 retries) 2026-02-23T08:31:36.268 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "queued for scrub", 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "0", 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": false, 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": false, 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 18, 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 136 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:36.279 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-23T08:31:37.300744+0000", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-23T08:31:37.300 (2026-02-22T08:31:34.599)", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-23T08:31:37.300744+0000", 2026-02-23T08:31:36.351 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-22T08:31:34.599310+0000", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "noscrub", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:36.352 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:36.427 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=18 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=137 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-23T08:31:37.300' 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-22T08:31:34.599' 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-21T08:31:34.599310+0000' 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:36.428 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='queued for scrub' 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='0' 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=false 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=false 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=18 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=136 2026-02-23T08:31:36.429 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:36.431 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 1 ~ false / 137 / 136 / false / 2026-02-21T08:31:34.599310+0000 / scrub scheduled %%% query_is_future 2026-02-23T08:31:36.431 INFO:tasks.workunit.client.0.trial129.stdout:key is query_is_future: negation:0 # expected: false # in actual: false 2026-02-23T08:31:36.431 INFO:tasks.workunit.client.0.trial129.stdout:waitingBeingScheduled - 'query_is_future' actual value (false) matches expected (false) (negation: 0) 2026-02-23T08:31:36.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-23T08:31:36.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:636: TEST_dump_scrub_schedule: saved_last_stamp=2026-02-21T08:31:34.599310+0000 2026-02-23T08:31:36.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:637: TEST_dump_scrub_schedule: ceph osd unset noscrub 2026-02-23T08:31:36.639 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is unset 2026-02-23T08:31:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:639: TEST_dump_scrub_schedule: cond_active=(['query_active']='true') 2026-02-23T08:31:36.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:639: TEST_dump_scrub_schedule: declare -A cond_active 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:640: TEST_dump_scrub_schedule: sched_data=() 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:641: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-21T08:31:34.599310+0000 cond_active 'WaitingActive ' sched_data 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-21T08:31:34.599310+0000 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=cond_active 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-23T08:31:36.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-23T08:31:36.657 INFO:tasks.workunit.client.0.trial129.stdout:waiting for any condition (WaitingActive ): pg:1.0 dt:2026-02-21T08:31:34.599310+0000 (10 retries) 2026-02-23T08:31:37.312 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:37.322 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:37.322 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "queued for scrub", 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "0", 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": false, 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": false, 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 18, 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 136 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:37.323 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:37.397 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:37.397 INFO:tasks.workunit.client.0.trial129.stdout: "active": true, 2026-02-23T08:31:37.397 INFO:tasks.workunit.client.0.trial129.stdout: "epoch_start": "15", 2026-02-23T08:31:37.397 INFO:tasks.workunit.client.0.trial129.stdout: "start": "1:00000000::::0", 2026-02-23T08:31:37.397 INFO:tasks.workunit.client.0.trial129.stdout: "end": "MIN", 2026-02-23T08:31:37.397 INFO:tasks.workunit.client.0.trial129.stdout: "max_end": "MIN", 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "subset_last_update": "0'0", 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "req_scrub": false, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "auto_repair": false, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "check_repair": false, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "deep_scrub_on_error": false, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "priority": 5, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "shallow_errors": 0, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "deep_errors": 0, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "fixed": 0, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "waiting_on_whom": [], 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrubbing", 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "is_reserving_replicas": false, 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:37.398 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "active": true 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:37.399 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:37.400 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=143 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=true 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrubbing' 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='0' 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='0' 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-21T08:31:34.599310+0000' 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:37.472 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=false 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='queued for scrub' 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='0' 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=false 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=false 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=18 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=136 2026-02-23T08:31:37.473 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:37.475 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 1 ~ true / 143 / 136 / false / 2026-02-21T08:31:34.599310+0000 / scrubbing %%% query_active 2026-02-23T08:31:37.475 INFO:tasks.workunit.client.0.trial129.stdout:key is query_active: negation:0 # expected: true # in actual: true 2026-02-23T08:31:37.475 INFO:tasks.workunit.client.0.trial129.stdout:WaitingActive - 'query_active' actual value (true) matches expected (true) (negation: 0) 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:645: TEST_dump_scrub_schedule: cond_active_dmp=(['dmp_state_has_scrubbing']='true' ['query_active']='false') 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:645: TEST_dump_scrub_schedule: declare -A cond_active_dmp 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:646: TEST_dump_scrub_schedule: sched_data=() 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:647: TEST_dump_scrub_schedule: wait_any_cond 1.0 10 2026-02-21T08:31:34.599310+0000 cond_active_dmp 'WaitingActive ' sched_data 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.0 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-21T08:31:34.599310+0000 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=cond_active_dmp 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sched_data 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-23T08:31:37.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-23T08:31:37.477 INFO:tasks.workunit.client.0.trial129.stdout:waiting for any condition (WaitingActive ): pg:1.0 dt:2026-02-21T08:31:34.599310+0000 (10 retries) 2026-02-23T08:31:38.132 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-23T08:31:37.300744+0000", 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:31:38.143 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 19, 2026-02-23T08:31:38.144 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 139 2026-02-23T08:31:38.144 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:38.144 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:38.215 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "active": true, 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "epoch_start": "15", 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "start": "1:00000000::::0", 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "end": "MIN", 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "max_end": "MIN", 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "subset_last_update": "0'0", 2026-02-23T08:31:38.216 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "req_scrub": false, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "auto_repair": false, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "check_repair": false, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "deep_scrub_on_error": false, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "priority": 5, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "shallow_errors": 0, 2026-02-23T08:31:38.217 INFO:tasks.workunit.client.0.trial129.stdout: "deep_errors": 0, 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "fixed": 0, 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "waiting_on_whom": [], 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrubbing", 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "is_reserving_replicas": false, 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:38.218 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:38.219 INFO:tasks.workunit.client.0.trial129.stdout: "active": true 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:38.220 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:38.221 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=143 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=true 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrubbing' 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='0' 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='0' 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-21T08:31:34.599310+0000' 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=false 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:38.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-23T08:31:37.300744+0000' 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=19 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=139 2026-02-23T08:31:38.290 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:38.292 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 1 ~ true / 143 / 139 / false / 2026-02-21T08:31:34.599310+0000 / scrubbing %%% dmp_state_has_scrubbing query_active 2026-02-23T08:31:38.292 INFO:tasks.workunit.client.0.trial129.stdout:key is dmp_state_has_scrubbing: negation:0 # expected: true # in actual: false 2026-02-23T08:31:38.292 INFO:tasks.workunit.client.0.trial129.stdout:key is query_active: negation:0 # expected: false # in actual: true 2026-02-23T08:31:38.947 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:38.959 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:38.959 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:38.959 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:38.959 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:38.959 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:31:38.959 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-23T08:31:37.300744+0000", 2026-02-23T08:31:38.960 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:31:38.960 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:31:38.960 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 19, 2026-02-23T08:31:38.960 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 139 2026-02-23T08:31:38.960 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:38.960 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "active": true, 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "epoch_start": "15", 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "start": "1:00000000::::0", 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "end": "MIN", 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "max_end": "MIN", 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "subset_last_update": "0'0", 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:31:39.030 INFO:tasks.workunit.client.0.trial129.stdout: "req_scrub": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "auto_repair": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "check_repair": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "deep_scrub_on_error": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "priority": 5, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "shallow_errors": 0, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "deep_errors": 0, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "fixed": 0, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "waiting_on_whom": [], 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrubbing", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "is_reserving_replicas": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:39.031 INFO:tasks.workunit.client.0.trial129.stdout: "active": true 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:39.032 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:39.104 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=143 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=true 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrubbing' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='0' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='0' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-21T08:31:34.599310+0000' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=false 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-23T08:31:37.300744+0000' 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=19 2026-02-23T08:31:39.105 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=139 2026-02-23T08:31:39.106 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:39.107 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 2 ~ true / 143 / 139 / false / 2026-02-21T08:31:34.599310+0000 / scrubbing %%% dmp_state_has_scrubbing query_active 2026-02-23T08:31:39.107 INFO:tasks.workunit.client.0.trial129.stdout:key is dmp_state_has_scrubbing: negation:0 # expected: true # in actual: false 2026-02-23T08:31:39.107 INFO:tasks.workunit.client.0.trial129.stdout:key is query_active: negation:0 # expected: false # in actual: true 2026-02-23T08:31:39.762 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-23T08:31:37.300744+0000", 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 19, 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 139 2026-02-23T08:31:39.774 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:39.775 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "active": true, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "epoch_start": "15", 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "start": "1:a0217245:::obj31:0", 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "end": "1:a0217245:::obj31:0", 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "max_end": "1:a0217245:::obj31:0", 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "subset_last_update": "17'90", 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "req_scrub": false, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "auto_repair": false, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "check_repair": false, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "deep_scrub_on_error": false, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "priority": 5, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "shallow_errors": 0, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "deep_errors": 0, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "fixed": 0, 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "waiting_on_whom": [], 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrubbing", 2026-02-23T08:31:39.849 INFO:tasks.workunit.client.0.trial129.stdout: "is_reserving_replicas": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "active": true 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:39.850 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=145 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=true 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrubbing' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='0' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='0' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-21T08:31:34.599310+0000' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=false 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-23T08:31:37.300744+0000' 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=19 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=139 2026-02-23T08:31:39.925 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:39.927 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 3 ~ true / 145 / 139 / false / 2026-02-21T08:31:34.599310+0000 / scrubbing %%% dmp_state_has_scrubbing query_active 2026-02-23T08:31:39.928 INFO:tasks.workunit.client.0.trial129.stdout:key is dmp_state_has_scrubbing: negation:0 # expected: true # in actual: false 2026-02-23T08:31:39.928 INFO:tasks.workunit.client.0.trial129.stdout:key is query_active: negation:0 # expected: false # in actual: true 2026-02-23T08:31:40.583 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean+scrubbing", 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": true, 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "scrubbing for 2s", 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "0", 2026-02-23T08:31:40.594 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": false, 2026-02-23T08:31:40.595 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": false, 2026-02-23T08:31:40.595 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 19, 2026-02-23T08:31:40.595 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 143 2026-02-23T08:31:40.595 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:40.595 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:31:40.666 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "active": true, 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "epoch_start": "15", 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "start": "1:a0217245:::obj31:0", 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "end": "1:a0217245:::obj31:0", 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "max_end": "1:a0217245:::obj31:0", 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "subset_last_update": "17'90", 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "req_scrub": false, 2026-02-23T08:31:40.667 INFO:tasks.workunit.client.0.trial129.stdout: "auto_repair": false, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "check_repair": false, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "deep_scrub_on_error": false, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "priority": 5, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "shallow_errors": 0, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "deep_errors": 0, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "fixed": 0, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "waiting_on_whom": [], 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrubbing", 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "is_reserving_replicas": false, 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:40.668 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2106-02-07T06:28:15.999999+0000", 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "active": true 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.0", 2026-02-23T08:31:40.669 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-27T13:19:18.294546+0000", 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "queued": false, 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:40.670 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=145 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=true 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrubbing' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='0' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='0' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-21T08:31:34.599310+0000' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x90' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=false 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=null 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean+scrubbing' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=true 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='scrubbing for 2s' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='0' 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=false 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=false 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=19 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=143 2026-02-23T08:31:40.743 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:31:40.745 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 4 ~ true / 145 / 143 / false / 2026-02-21T08:31:34.599310+0000 / scrubbing %%% dmp_state_has_scrubbing query_active 2026-02-23T08:31:40.745 INFO:tasks.workunit.client.0.trial129.stdout:key is dmp_state_has_scrubbing: negation:0 # expected: true # in actual: true 2026-02-23T08:31:40.745 INFO:tasks.workunit.client.0.trial129.stdout:WaitingActive - 'dmp_state_has_scrubbing' actual value (true) matches expected (true) (negation: 0) 2026-02-23T08:31:40.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-23T08:31:40.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:648: TEST_dump_scrub_schedule: sleep 4 2026-02-23T08:31:44.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:649: TEST_dump_scrub_schedule: perf_counters td/osd-scrub-test 3 2026-02-23T08:31:44.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:31:44.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:31:44.748 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:31:44.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:31:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:31:44.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:31:44.822 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:44.823 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:31:44.823 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.823 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.823 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:44.823 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:44.823 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.824 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.825 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.825 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:31:44.825 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.825 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.825 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:44.825 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:44.826 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.826 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.826 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.826 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.826 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.826 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:44.827 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.828 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.829 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:31:44.830 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:44.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:44.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:31:44.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.893 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 7, 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:44.894 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 2, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.895 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:31:44.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:31:44.964 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:44.964 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:31:44.964 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.964 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.964 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.965 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.966 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.967 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:31:44.968 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:31:44.969 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:44.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_dump_scrub_schedule ------------------' 2026-02-23T08:31:44.970 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_dump_scrub_schedule ------------------ 2026-02-23T08:31:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:31:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:31:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:31:44.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:31:44.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:31:44.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:31:44.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:31:44.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:31:44.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:31:45.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:31:45.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:31:45.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:31:45.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:31:45.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:31:45.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:31:45.074 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:31:45.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:45.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:31:45.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:31:45.075 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:45.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:31:45.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:31:45.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:31:45.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:31:45.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:31:45.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:31:45.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:31:45.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_dump_scrub_schedule ------------------' 2026-02-23T08:31:45.088 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_dump_scrub_schedule ------------------ 2026-02-23T08:31:45.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:31:45.088 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_interval_changes ------------------- 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_interval_changes -------------------' 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:31:45.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:31:45.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:31:45.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:31:45.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:31:45.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:31:45.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:31:45.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:31:45.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:31:45.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:45.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:31:45.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:31:45.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:31:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:31:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:31:45.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:31:45.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:31:45.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:31:45.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:31:45.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:31:45.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:31:45.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:31:45.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:31:45.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:31:45.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:31:45.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:31:45.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:31:45.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_interval_changes -----------------------' 2026-02-23T08:31:45.103 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_interval_changes ----------------------- 2026-02-23T08:31:45.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_interval_changes td/osd-scrub-test 2026-02-23T08:31:45.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:142: TEST_interval_changes: local poolname=test 2026-02-23T08:31:45.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:143: TEST_interval_changes: local OSDS=2 2026-02-23T08:31:45.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:144: TEST_interval_changes: local objects=10 2026-02-23T08:31:45.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:146: TEST_interval_changes: expr 24 '*' 60 '*' 60 2026-02-23T08:31:45.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:146: TEST_interval_changes: local day=86400 2026-02-23T08:31:45.105 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:147: TEST_interval_changes: expr 86400 '*' 7 2026-02-23T08:31:45.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:147: TEST_interval_changes: local week=604800 2026-02-23T08:31:45.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:148: TEST_interval_changes: local min_interval=86400 2026-02-23T08:31:45.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:149: TEST_interval_changes: local max_interval=604800 2026-02-23T08:31:45.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:150: TEST_interval_changes: local WAIT_FOR_UPDATE=15 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:152: TEST_interval_changes: TESTDATA=testdata.889699 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:155: TEST_interval_changes: run_mon td/osd-scrub-test a --osd_pool_default_size=2 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:31:45.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=2 2026-02-23T08:31:45.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:31:45.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:45.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:45.123 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:45.124 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.124 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:45.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=2 2026-02-23T08:31:45.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:31:45.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:31:45.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:31:45.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:31:45.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:31:45.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.145 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:31:45.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:31:45.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:31:45.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.209 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:31:45.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:31:45.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:31:45.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:156: TEST_interval_changes: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:31:45.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:31:45.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:31:45.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:31:45.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:31:45.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:31:45.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:31:45.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:45.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:31:45.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:31:45.375 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: expr 2 - 1 2026-02-23T08:31:45.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: seq 0 1 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:159: TEST_interval_changes: run_osd td/osd-scrub-test 0 --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:31:45.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:45.378 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0' 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:31:45.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:31:45.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b0942357-5bb1-4d6f-9c79-2ae86611adc0 2026-02-23T08:31:45.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b0942357-5bb1-4d6f-9c79-2ae86611adc0' 2026-02-23T08:31:45.380 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 b0942357-5bb1-4d6f-9c79-2ae86611adc0 2026-02-23T08:31:45.380 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:31:45.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBxEJxpAf0lFxAAzEU6EnnIayf2pJ35jJLdaQ== 2026-02-23T08:31:45.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBxEJxpAf0lFxAAzEU6EnnIayf2pJ35jJLdaQ=="}' 2026-02-23T08:31:45.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b0942357-5bb1-4d6f-9c79-2ae86611adc0 -i td/osd-scrub-test/0/new.json 2026-02-23T08:31:45.476 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:45.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:31:45.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 --mkfs --key AQBxEJxpAf0lFxAAzEU6EnnIayf2pJ35jJLdaQ== --osd-uuid b0942357-5bb1-4d6f-9c79-2ae86611adc0 2026-02-23T08:31:45.499 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:45.499+0000 7fc58494f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:45.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:45.500+0000 7fc58494f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:45.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:45.501+0000 7fc58494f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:45.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:45.502+0000 7fc58494f780 -1 bdev(0x55929df6d400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:31:45.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:45.502+0000 7fc58494f780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:31:45.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:31:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:31:45.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:31:45.923 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:31:45.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:31:46.018 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:31:46.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:31:46.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-23T08:31:46.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:31:46.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:31:46.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:31:46.031 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:46.030+0000 7f9877f6b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:46.032 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:46.032+0000 7f9877f6b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:46.033 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:46.032+0000 7f9877f6b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:46.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:31:46.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:31:46.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:31:46.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:31:46.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:31:46.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:46.111 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:46.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:31:46.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:46.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:31:46.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:31:46.260 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:46.259+0000 7f9877f6b780 -1 Falling back to public interface 2026-02-23T08:31:46.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:46.653+0000 7f9877f6b780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:31:47.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:31:47.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:47.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:31:47.204 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:47.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:47.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:31:47.295 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2868319477,v1:127.0.0.1:6801/2868319477] [v2:127.0.0.1:6802/2868319477,v1:127.0.0.1:6803/2868319477] exists,up b0942357-5bb1-4d6f-9c79-2ae86611adc0 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:157: TEST_interval_changes: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:159: TEST_interval_changes: run_osd td/osd-scrub-test 1 --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:31:47.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0' 2026-02-23T08:31:47.298 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:31:47.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:31:47.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f39e5ef6-f7f2-48f1-8dad-85034091159e 2026-02-23T08:31:47.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f39e5ef6-f7f2-48f1-8dad-85034091159e' 2026-02-23T08:31:47.299 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 f39e5ef6-f7f2-48f1-8dad-85034091159e 2026-02-23T08:31:47.299 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:31:47.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBzEJxpsHhBEhAALQS9VN7oV9CGQHYJsDxNcg== 2026-02-23T08:31:47.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBzEJxpsHhBEhAALQS9VN7oV9CGQHYJsDxNcg=="}' 2026-02-23T08:31:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f39e5ef6-f7f2-48f1-8dad-85034091159e -i td/osd-scrub-test/1/new.json 2026-02-23T08:31:47.396 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:47.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:31:47.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 --mkfs --key AQBzEJxpsHhBEhAALQS9VN7oV9CGQHYJsDxNcg== --osd-uuid f39e5ef6-f7f2-48f1-8dad-85034091159e 2026-02-23T08:31:47.420 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:47.419+0000 7fe224159780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:47.421 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:47.420+0000 7fe224159780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:47.422 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:47.421+0000 7fe224159780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:47.423 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:47.422+0000 7fe224159780 -1 bdev(0x5559c92d1400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:31:47.423 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:47.422+0000 7fe224159780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:31:47.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:31:47.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:31:47.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:31:47.832 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:31:47.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:31:48.037 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:31:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:31:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_scrub_min_interval=86400 --osd_scrub_max_interval=604800 --osd_scrub_interval_randomize_ratio=0 2026-02-23T08:31:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:31:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:31:48.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:31:48.050 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:48.049+0000 7f4e8856b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:48.051 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:48.051+0000 7f4e8856b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:48.052 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:48.051+0000 7f4e8856b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:48.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:31:48.206 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:31:48.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:48.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:31:48.241 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:48.241+0000 7f4e8856b780 -1 Falling back to public interface 2026-02-23T08:31:48.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:31:48.595 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:31:48.594+0000 7f4e8856b780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:31:49.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:31:49.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:31:49.368 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:31:49.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:31:49.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:31:49.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:31:49.531 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2282913104,v1:127.0.0.1:6811/2282913104] [v2:127.0.0.1:6812/2282913104,v1:127.0.0.1:6813/2282913104] exists,up f39e5ef6-f7f2-48f1-8dad-85034091159e 2026-02-23T08:31:49.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:31:49.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:31:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:31:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:163: TEST_interval_changes: create_pool test 1 1 2026-02-23T08:31:49.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:31:49.766 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:31:49.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:31:50.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:164: TEST_interval_changes: wait_for_clean 2026-02-23T08:31:50.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:31:50.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:31:50.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:31:50.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:31:50.782 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:31:50.782 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:31:50.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:31:50.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:31:50.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:31:50.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:31:50.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:31:50.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:31:50.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:31:50.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:31:50.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:31:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:31:51.025 INFO:tasks.workunit.client.0.trial129.stderr:1' 2026-02-23T08:31:51.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:31:51.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:31:51.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:31:51.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:31:51.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:31:51.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:31:51.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:31:51.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:31:51.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-23T08:31:51.172 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-23T08:31:51.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-42949672964' 2026-02-23T08:31:51.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:31:51.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:31:51.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:31:51.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:31:51.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:31:51.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:31:51.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:31:51.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:31:51.176 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836485 2026-02-23T08:31:51.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:31:51.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836485 2026-02-23T08:31:51.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:31:52.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:31:52.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:31:52.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:31:52.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:31:52.504 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-23T08:31:52.505 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:31:52.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:31:52.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-23T08:31:52.506 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:31:52.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-23T08:31:52.508 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672964 2026-02-23T08:31:52.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-23T08:31:52.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:31:52.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-23T08:31:52.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:31:52.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:31:52.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:31:52.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:31:52.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:31:52.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:31:52.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:31:52.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:31:52.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:31:52.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:31:52.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:31:53.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:31:53.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:31:53.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:31:53.041 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:31:53.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:31:53.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:31:53.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:31:53.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: ceph osd dump 2026-02-23T08:31:53.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: grep '^pool.*['\'']test['\'']' 2026-02-23T08:31:53.243 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: awk '{ print $2 }' 2026-02-23T08:31:53.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:165: TEST_interval_changes: local poolid=1 2026-02-23T08:31:53.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:167: TEST_interval_changes: dd if=/dev/urandom of=testdata.889699 bs=1032 count=1 2026-02-23T08:31:53.407 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:31:53.407 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:31:53.407 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 1.9066e-05 s, 54.1 MB/s 2026-02-23T08:31:53.408 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: seq 1 10 2026-02-23T08:31:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj1 testdata.889699 2026-02-23T08:31:53.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj2 testdata.889699 2026-02-23T08:31:53.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj3 testdata.889699 2026-02-23T08:31:53.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj4 testdata.889699 2026-02-23T08:31:53.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj5 testdata.889699 2026-02-23T08:31:53.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj6 testdata.889699 2026-02-23T08:31:53.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj7 testdata.889699 2026-02-23T08:31:53.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj8 testdata.889699 2026-02-23T08:31:53.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj9 testdata.889699 2026-02-23T08:31:53.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:168: TEST_interval_changes: for i in `seq 1 $objects` 2026-02-23T08:31:53.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:170: TEST_interval_changes: rados -p test put obj10 testdata.889699 2026-02-23T08:31:53.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:172: TEST_interval_changes: rm -f testdata.889699 2026-02-23T08:31:53.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:174: TEST_interval_changes: get_primary test obj1 2026-02-23T08:31:53.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:31:53.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:31:53.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:31:53.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:174: TEST_interval_changes: local primary=1 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:177: TEST_interval_changes: check_dump_scrubs 1 '1 day' 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=1 day' 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:31:53.715 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:31:53.716 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:31:53.716 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:53.716 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:53.716 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:31:53.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-23T08:31:53.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok dump_scrubs 2026-02-23T08:31:53.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-24T08:31:49.764355+0000", 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-24T08:31:49.764355+0000", 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:31:53.782 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-03-03T06:37:41.655630+0000", 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-03-03T06:37:41.655630+0000", 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:31:53.783 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:31:53.784 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:31:53.784 INFO:tasks.workunit.client.0.trial129.stderr:]' 2026-02-23T08:31:53.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-24T08:31:49.764355+0000",' '"orig_sched_time":' '"2026-02-24T08:31:49.764355+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-03-03T06:37:41.655630+0000",' '"orig_sched_time":' '"2026-03-03T06:37:41.655630+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-23T08:31:53.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-23T08:31:53.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-24T08:31:49.764355+0000"' 2026-02-23T08:31:53.785 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-24T08:31:49.764355+0000 2026-02-23T08:31:53.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-24T08:31:49.764355+0000 2026-02-23T08:31:53.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-23T08:31:53.787 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 1 day' 2026-02-23T08:31:53.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-24 = 2026-02-24 2026-02-23T08:31:53.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: get_asok_path osd.1 2026-02-23T08:31:53.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:31:53.788 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:31:53.789 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:31:53.789 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:31:53.789 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:31:53.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:31:53.790 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: expr 86400 '*' 2 2026-02-23T08:31:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: CEPH_ARGS= 2026-02-23T08:31:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:180: TEST_interval_changes: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok config set osd_scrub_min_interval 172800 2026-02-23T08:31:53.846 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:31:53.846 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_min_interval = '' " 2026-02-23T08:31:53.846 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:31:53.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:181: TEST_interval_changes: sleep 15 2026-02-23T08:32:08.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:182: TEST_interval_changes: check_dump_scrubs 1 '2 days' 2026-02-23T08:32:08.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-23T08:32:08.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=2 days' 2026-02-23T08:32:08.854 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-23T08:32:08.854 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:32:08.854 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:32:08.855 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:32:08.855 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:08.855 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:08.856 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:32:08.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-23T08:32:08.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok dump_scrubs 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-25T08:31:49.764355+0000", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-25T08:31:49.764355+0000", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-03-02T19:51:04.316949+0000", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-03-02T19:51:04.316949+0000", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:32:08.918 INFO:tasks.workunit.client.0.trial129.stderr:]' 2026-02-23T08:32:08.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-23T08:32:08.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-25T08:31:49.764355+0000",' '"orig_sched_time":' '"2026-02-25T08:31:49.764355+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-03-02T19:51:04.316949+0000",' '"orig_sched_time":' '"2026-03-02T19:51:04.316949+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-23T08:32:08.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-25T08:31:49.764355+0000"' 2026-02-23T08:32:08.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-25T08:31:49.764355+0000 2026-02-23T08:32:08.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-25T08:31:49.764355+0000 2026-02-23T08:32:08.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-23T08:32:08.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 2 days' 2026-02-23T08:32:08.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-25 = 2026-02-25 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: get_asok_path osd.1 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:08.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:32:08.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: expr 604800 '*' 2 2026-02-23T08:32:08.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: CEPH_ARGS= 2026-02-23T08:32:08.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:185: TEST_interval_changes: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok config set osd_scrub_max_interval 1209600 2026-02-23T08:32:08.982 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:32:08.983 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_max_interval = '' " 2026-02-23T08:32:08.983 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:32:08.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:186: TEST_interval_changes: sleep 15 2026-02-23T08:32:23.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:187: TEST_interval_changes: check_dump_scrubs 1 '2 days' 2026-02-23T08:32:23.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-23T08:32:23.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=2 days' 2026-02-23T08:32:23.993 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-23T08:32:23.993 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:32:23.993 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:32:23.993 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:32:23.993 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:23.994 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:23.994 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:32:23.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-23T08:32:23.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok dump_scrubs 2026-02-23T08:32:24.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-23T08:32:24.056 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:24.056 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:24.056 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:32:24.056 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:24.056 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-25T08:31:49.764355+0000", 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-25T08:31:49.764355+0000", 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:24.057 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-03-02T05:26:27.515893+0000", 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-03-02T05:26:27.515893+0000", 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:32:24.058 INFO:tasks.workunit.client.0.trial129.stderr:]' 2026-02-23T08:32:24.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-25T08:31:49.764355+0000",' '"orig_sched_time":' '"2026-02-25T08:31:49.764355+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-03-02T05:26:27.515893+0000",' '"orig_sched_time":' '"2026-03-02T05:26:27.515893+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-23T08:32:24.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-23T08:32:24.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-25T08:31:49.764355+0000"' 2026-02-23T08:32:24.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-25T08:31:49.764355+0000 2026-02-23T08:32:24.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-25T08:31:49.764355+0000 2026-02-23T08:32:24.060 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-23T08:32:24.061 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 2 days' 2026-02-23T08:32:24.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-25 = 2026-02-25 2026-02-23T08:32:24.063 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:190: TEST_interval_changes: expr 86400 '*' 3 2026-02-23T08:32:24.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:190: TEST_interval_changes: ceph osd pool set test scrub_min_interval 259200 2026-02-23T08:32:24.267 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 scrub_min_interval to 259200 2026-02-23T08:32:24.281 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:191: TEST_interval_changes: sleep 15 2026-02-23T08:32:39.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:192: TEST_interval_changes: check_dump_scrubs 1 '3 days' 2026-02-23T08:32:39.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-23T08:32:39.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=3 days' 2026-02-23T08:32:39.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-23T08:32:39.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:32:39.284 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:32:39.284 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:32:39.284 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:39.284 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:39.285 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:32:39.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-23T08:32:39.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok dump_scrubs 2026-02-23T08:32:39.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-23T08:32:39.350 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-26T08:31:49.764355+0000", 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-26T08:31:49.764355+0000", 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:32:39.351 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-03-01T08:44:36.146859+0000", 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-03-01T08:44:36.146859+0000", 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:32:39.352 INFO:tasks.workunit.client.0.trial129.stderr:]' 2026-02-23T08:32:39.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-26T08:31:49.764355+0000",' '"orig_sched_time":' '"2026-02-26T08:31:49.764355+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-03-01T08:44:36.146859+0000",' '"orig_sched_time":' '"2026-03-01T08:44:36.146859+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-23T08:32:39.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-23T08:32:39.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-26T08:31:49.764355+0000"' 2026-02-23T08:32:39.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-26T08:31:49.764355+0000 2026-02-23T08:32:39.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-26T08:31:49.764355+0000 2026-02-23T08:32:39.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-23T08:32:39.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 3 days' 2026-02-23T08:32:39.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-26 = 2026-02-26 2026-02-23T08:32:39.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:195: TEST_interval_changes: expr 604800 '*' 3 2026-02-23T08:32:39.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:195: TEST_interval_changes: ceph osd pool set test scrub_max_interval 1814400 2026-02-23T08:32:39.530 INFO:tasks.workunit.client.0.trial129.stderr:set pool 1 scrub_max_interval to 1814400 2026-02-23T08:32:39.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:196: TEST_interval_changes: sleep 15 2026-02-23T08:32:54.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:197: TEST_interval_changes: check_dump_scrubs 1 '3 days' 2026-02-23T08:32:54.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:132: check_dump_scrubs: local primary=1 2026-02-23T08:32:54.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:133: check_dump_scrubs: local 'sched_time_check=3 days' 2026-02-23T08:32:54.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: get_asok_path osd.1 2026-02-23T08:32:54.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-23T08:32:54.545 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-23T08:32:54.546 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:32:54.546 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:54.546 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:54.546 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.1.asok 2026-02-23T08:32:54.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: CEPH_ARGS= 2026-02-23T08:32:54.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: ceph --admin-daemon /tmp/ceph-asok.889699/ceph-osd.1.asok dump_scrubs 2026-02-23T08:32:54.610 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:135: check_dump_scrubs: DS='[ 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "level": "shallow", 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-26T08:31:49.764355+0000", 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-26T08:31:49.764355+0000", 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:54.611 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: }, 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: { 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "pgid": "1.0", 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "level": "deep", 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "urgency": "periodic-regular", 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "sched_time": "2026-02-27T13:19:49.764355+0000", 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "orig_sched_time": "2026-02-27T13:19:49.764355+0000", 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "last_issue": "ok", 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "forced": false, 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "eligible": false, 2026-02-23T08:32:54.612 INFO:tasks.workunit.client.0.trial129.stderr: "queued": true, 2026-02-23T08:32:54.613 INFO:tasks.workunit.client.0.trial129.stderr: "active": false 2026-02-23T08:32:54.613 INFO:tasks.workunit.client.0.trial129.stderr: } 2026-02-23T08:32:54.613 INFO:tasks.workunit.client.0.trial129.stderr:]' 2026-02-23T08:32:54.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: echo '[' '{' '"pgid":' '"1.0",' '"level":' '"shallow",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-26T08:31:49.764355+0000",' '"orig_sched_time":' '"2026-02-26T08:31:49.764355+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '},' '{' '"pgid":' '"1.0",' '"level":' '"deep",' '"urgency":' '"periodic-regular",' '"sched_time":' '"2026-02-27T13:19:49.764355+0000",' '"orig_sched_time":' '"2026-02-27T13:19:49.764355+0000",' '"last_issue":' '"ok",' '"forced":' false, '"eligible":' false, '"queued":' true, '"active":' false '}' ']' 2026-02-23T08:32:54.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: jq '.[0].sched_time' 2026-02-23T08:32:54.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: eval 'SCHED_TIME="2026-02-26T08:31:49.764355+0000"' 2026-02-23T08:32:54.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:137: check_dump_scrubs: SCHED_TIME=2026-02-26T08:31:49.764355+0000 2026-02-23T08:32:54.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: echo 2026-02-26T08:31:49.764355+0000 2026-02-23T08:32:54.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: sed 's/\([0-9]*-[0-9]*-[0-9]*\).*/\1/' 2026-02-23T08:32:54.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: date +%Y-%m-%d -d 'now + 3 days' 2026-02-23T08:32:54.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:138: check_dump_scrubs: test 2026-02-26 = 2026-02-26 2026-02-23T08:32:54.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:198: TEST_interval_changes: perf_counters td/osd-scrub-test 2 2026-02-23T08:32:54.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:32:54.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=2 2026-02-23T08:32:54.618 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 2 - 1 2026-02-23T08:32:54.618 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 1 2026-02-23T08:32:54.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:32:54.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:32:54.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:32:54.689 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:32:54.689 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:32:54.689 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.690 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.691 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.692 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:32:54.693 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:32:54.694 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:32:54.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:32:54.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:32:54.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:32:54.760 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:32:54.760 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.761 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.762 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.763 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:32:54.764 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:32:54.765 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:32:54.766 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_interval_changes ------------------ 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_interval_changes ------------------' 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:32:54.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:32:54.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:32:54.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:32:54.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:32:54.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:32:54.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:32:54.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:32:54.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:32:54.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:32:54.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:32:54.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:32:54.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:32:54.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:32:54.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:32:54.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:32:54.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:32:54.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:32:54.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:32:54.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:32:54.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:54.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:54.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:32:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:32:54.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:32:54.881 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_interval_changes ------------------ 2026-02-23T08:32:54.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_interval_changes ------------------' 2026-02-23T08:32:54.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:32:54.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_just_deep_scrubs -------------------' 2026-02-23T08:32:54.882 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_just_deep_scrubs ------------------- 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:32:54.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:32:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:32:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:32:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:32:54.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:32:54.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:32:54.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:32:54.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:32:54.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:32:54.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:32:54.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:32:54.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:32:54.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:32:54.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:32:54.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:32:54.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:32:54.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:32:54.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:32:54.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:32:54.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:54.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:54.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:32:54.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:32:54.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:32:54.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:32:54.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:32:54.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:32:54.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:32:54.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:32:54.894 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:32:54.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:32:54.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:32:54.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:32:54.895 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_just_deep_scrubs ----------------------- 2026-02-23T08:32:54.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_just_deep_scrubs -----------------------' 2026-02-23T08:32:54.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_just_deep_scrubs td/osd-scrub-test 2026-02-23T08:32:54.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:462: TEST_just_deep_scrubs: local dir=td/osd-scrub-test 2026-02-23T08:32:54.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:463: TEST_just_deep_scrubs: cluster_conf=(['osds_num']='3' ['pgs_in_pool']='4' ['pool_name']='test') 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:463: TEST_just_deep_scrubs: local -A cluster_conf 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:469: TEST_just_deep_scrubs: standard_scrub_cluster td/osd-scrub-test cluster_conf 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:229: standard_scrub_cluster: local dir=td/osd-scrub-test 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:230: standard_scrub_cluster: local -n args=cluster_conf 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:232: standard_scrub_cluster: local OSDS=3 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:233: standard_scrub_cluster: local pg_num=4 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:235: standard_scrub_cluster: local poolname=test 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:236: standard_scrub_cluster: args['pool_name']=test 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:238: standard_scrub_cluster: local pool_default_size=3 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:239: standard_scrub_cluster: args['pool_default_size']=3 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:241: standard_scrub_cluster: local extra_pars= 2026-02-23T08:32:54.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:242: standard_scrub_cluster: local debug_msg=dbg 2026-02-23T08:32:54.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:245: standard_scrub_cluster: local saved_echo_flag=x 2026-02-23T08:32:54.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:246: standard_scrub_cluster: set +x 2026-02-23T08:32:55.169 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 7b784899-8b10-4759-86c0-64c5a23a8bf2 2026-02-23T08:32:55.264 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:32:55.292 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.290+0000 7f0aae94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:55.293 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.291+0000 7f0aae94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:55.294 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.292+0000 7f0aae94f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:55.294 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.293+0000 7f0aae94f780 -1 bdev(0x55ad7fc51400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:32:55.294 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.293+0000 7f0aae94f780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:32:55.721 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:32:55.821 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:32:55.837 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.836+0000 7f3604219780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:55.839 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.837+0000 7f3604219780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:55.839 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:55.838+0000 7f3604219780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:55.914 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:32:56.085 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:56.083+0000 7f3604219780 -1 Falling back to public interface 2026-02-23T08:32:56.433 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:56.431+0000 7f3604219780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:32:57.011 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:32:57.102 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2511678263,v1:127.0.0.1:6801/2511678263] [v2:127.0.0.1:6802/2511678263,v1:127.0.0.1:6803/2511678263] exists,up 7b784899-8b10-4759-86c0-64c5a23a8bf2 2026-02-23T08:32:57.106 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 45f5c8e9-4df8-4b5a-8963-457df9c68efb 2026-02-23T08:32:57.202 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:32:57.227 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.225+0000 7f71ba74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:57.228 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.227+0000 7f71ba74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:57.229 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.227+0000 7f71ba74f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:57.230 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.228+0000 7f71ba74f780 -1 bdev(0x562738a4b400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:32:57.230 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.228+0000 7f71ba74f780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:32:57.637 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:32:57.840 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:32:57.855 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.854+0000 7f006ad49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:57.856 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.855+0000 7f006ad49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:57.857 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:57.856+0000 7f006ad49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:58.002 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:32:58.069 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:58.067+0000 7f006ad49780 -1 Falling back to public interface 2026-02-23T08:32:58.449 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:58.447+0000 7f006ad49780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:32:59.169 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:32:59.334 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4002408953,v1:127.0.0.1:6811/4002408953] [v2:127.0.0.1:6812/4002408953,v1:127.0.0.1:6813/4002408953] exists,up 45f5c8e9-4df8-4b5a-8963-457df9c68efb 2026-02-23T08:32:59.338 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 03173a7b-f75a-4f42-b605-3a6f08e6579f 2026-02-23T08:32:59.505 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:32:59.533 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:59.531+0000 7f3065c11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:59.534 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:59.533+0000 7f3065c11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:59.535 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:59.533+0000 7f3065c11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:32:59.535 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:59.534+0000 7f3065c11780 -1 bdev(0x564487ec3400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:32:59.535 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:32:59.534+0000 7f3065c11780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:32:59.919 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:33:00.126 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:33:00.141 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:00.139+0000 7fae5354f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:00.142 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:00.140+0000 7fae5354f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:00.142 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:00.141+0000 7fae5354f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:00.292 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:00.333 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:00.331+0000 7fae5354f780 -1 Falling back to public interface 2026-02-23T08:33:00.654 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:00.652+0000 7fae5354f780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:33:01.457 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:01.625 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/426701608,v1:127.0.0.1:6819/426701608] [v2:127.0.0.1:6820/426701608,v1:127.0.0.1:6821/426701608] exists,up 03173a7b-f75a-4f42-b605-3a6f08e6579f 2026-02-23T08:33:01.869 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:33:03.359 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:33:05.856 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705669 2026-02-23T08:33:06.022 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574852 2026-02-23T08:33:07.929 INFO:tasks.workunit.client.0.trial129.stdout:standard_scrub_cluster: dbg: test pool is test 1 2026-02-23T08:33:07.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:470: TEST_just_deep_scrubs: local poolid=1 2026-02-23T08:33:07.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:471: TEST_just_deep_scrubs: local poolname=test 2026-02-23T08:33:07.931 INFO:tasks.workunit.client.0.trial129.stdout:Pool: test : 1 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:472: TEST_just_deep_scrubs: echo 'Pool: test : 1' 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:474: TEST_just_deep_scrubs: TESTDATA=testdata.889699 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:475: TEST_just_deep_scrubs: local objects=90 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:476: TEST_just_deep_scrubs: dd if=/dev/urandom of=testdata.889699 bs=1032 count=1 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 2.2703e-05 s, 45.5 MB/s 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: seq 1 90 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:07.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj1 testdata.889699 2026-02-23T08:33:07.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:07.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj2 testdata.889699 2026-02-23T08:33:07.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:07.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj3 testdata.889699 2026-02-23T08:33:07.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:07.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj4 testdata.889699 2026-02-23T08:33:07.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:07.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj5 testdata.889699 2026-02-23T08:33:08.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj6 testdata.889699 2026-02-23T08:33:08.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj7 testdata.889699 2026-02-23T08:33:08.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj8 testdata.889699 2026-02-23T08:33:08.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj9 testdata.889699 2026-02-23T08:33:08.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj10 testdata.889699 2026-02-23T08:33:08.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj11 testdata.889699 2026-02-23T08:33:08.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj12 testdata.889699 2026-02-23T08:33:08.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj13 testdata.889699 2026-02-23T08:33:08.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj14 testdata.889699 2026-02-23T08:33:08.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj15 testdata.889699 2026-02-23T08:33:08.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj16 testdata.889699 2026-02-23T08:33:08.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj17 testdata.889699 2026-02-23T08:33:08.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj18 testdata.889699 2026-02-23T08:33:08.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj19 testdata.889699 2026-02-23T08:33:08.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj20 testdata.889699 2026-02-23T08:33:08.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj21 testdata.889699 2026-02-23T08:33:08.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.236 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj22 testdata.889699 2026-02-23T08:33:08.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj23 testdata.889699 2026-02-23T08:33:08.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj24 testdata.889699 2026-02-23T08:33:08.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.279 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj25 testdata.889699 2026-02-23T08:33:08.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj26 testdata.889699 2026-02-23T08:33:08.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj27 testdata.889699 2026-02-23T08:33:08.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj28 testdata.889699 2026-02-23T08:33:08.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj29 testdata.889699 2026-02-23T08:33:08.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj30 testdata.889699 2026-02-23T08:33:08.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj31 testdata.889699 2026-02-23T08:33:08.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj32 testdata.889699 2026-02-23T08:33:08.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj33 testdata.889699 2026-02-23T08:33:08.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj34 testdata.889699 2026-02-23T08:33:08.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj35 testdata.889699 2026-02-23T08:33:08.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj36 testdata.889699 2026-02-23T08:33:08.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj37 testdata.889699 2026-02-23T08:33:08.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj38 testdata.889699 2026-02-23T08:33:08.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj39 testdata.889699 2026-02-23T08:33:08.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj40 testdata.889699 2026-02-23T08:33:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj41 testdata.889699 2026-02-23T08:33:08.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj42 testdata.889699 2026-02-23T08:33:08.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj43 testdata.889699 2026-02-23T08:33:08.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj44 testdata.889699 2026-02-23T08:33:08.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj45 testdata.889699 2026-02-23T08:33:08.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj46 testdata.889699 2026-02-23T08:33:08.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj47 testdata.889699 2026-02-23T08:33:08.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj48 testdata.889699 2026-02-23T08:33:08.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj49 testdata.889699 2026-02-23T08:33:08.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj50 testdata.889699 2026-02-23T08:33:08.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj51 testdata.889699 2026-02-23T08:33:08.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj52 testdata.889699 2026-02-23T08:33:08.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj53 testdata.889699 2026-02-23T08:33:08.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj54 testdata.889699 2026-02-23T08:33:08.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj55 testdata.889699 2026-02-23T08:33:08.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj56 testdata.889699 2026-02-23T08:33:08.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj57 testdata.889699 2026-02-23T08:33:08.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj58 testdata.889699 2026-02-23T08:33:08.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj59 testdata.889699 2026-02-23T08:33:08.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj60 testdata.889699 2026-02-23T08:33:08.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj61 testdata.889699 2026-02-23T08:33:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj62 testdata.889699 2026-02-23T08:33:08.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj63 testdata.889699 2026-02-23T08:33:08.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj64 testdata.889699 2026-02-23T08:33:08.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj65 testdata.889699 2026-02-23T08:33:08.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj66 testdata.889699 2026-02-23T08:33:08.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj67 testdata.889699 2026-02-23T08:33:08.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.909 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj68 testdata.889699 2026-02-23T08:33:08.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj69 testdata.889699 2026-02-23T08:33:08.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.938 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj70 testdata.889699 2026-02-23T08:33:08.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj71 testdata.889699 2026-02-23T08:33:08.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj72 testdata.889699 2026-02-23T08:33:08.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj73 testdata.889699 2026-02-23T08:33:08.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:08.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj74 testdata.889699 2026-02-23T08:33:09.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj75 testdata.889699 2026-02-23T08:33:09.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj76 testdata.889699 2026-02-23T08:33:09.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj77 testdata.889699 2026-02-23T08:33:09.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj78 testdata.889699 2026-02-23T08:33:09.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj79 testdata.889699 2026-02-23T08:33:09.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj80 testdata.889699 2026-02-23T08:33:09.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj81 testdata.889699 2026-02-23T08:33:09.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj82 testdata.889699 2026-02-23T08:33:09.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj83 testdata.889699 2026-02-23T08:33:09.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj84 testdata.889699 2026-02-23T08:33:09.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj85 testdata.889699 2026-02-23T08:33:09.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj86 testdata.889699 2026-02-23T08:33:09.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj87 testdata.889699 2026-02-23T08:33:09.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj88 testdata.889699 2026-02-23T08:33:09.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj89 testdata.889699 2026-02-23T08:33:09.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:477: TEST_just_deep_scrubs: for i in `seq 1 $objects` 2026-02-23T08:33:09.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:479: TEST_just_deep_scrubs: rados -p test put obj90 testdata.889699 2026-02-23T08:33:09.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:481: TEST_just_deep_scrubs: rm -f testdata.889699 2026-02-23T08:33:09.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:486: TEST_just_deep_scrubs: ceph tell 'osd.*' config set osd_scrub_retry_after_noscrub 2 2026-02-23T08:33:09.315 INFO:tasks.workunit.client.0.trial129.stdout:osd.0: { 2026-02-23T08:33:09.315 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_retry_after_noscrub = '' (not observed, change may require restart) " 2026-02-23T08:33:09.315 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:09.322 INFO:tasks.workunit.client.0.trial129.stdout:osd.1: { 2026-02-23T08:33:09.322 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_retry_after_noscrub = '' (not observed, change may require restart) " 2026-02-23T08:33:09.322 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:09.329 INFO:tasks.workunit.client.0.trial129.stdout:osd.2: { 2026-02-23T08:33:09.329 INFO:tasks.workunit.client.0.trial129.stdout: "success": "osd_scrub_retry_after_noscrub = '' (not observed, change may require restart) " 2026-02-23T08:33:09.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:09.337 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:487: TEST_just_deep_scrubs: ceph osd set noscrub 2026-02-23T08:33:09.546 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:33:09.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:488: TEST_just_deep_scrubs: ceph osd set nodeep-scrub 2026-02-23T08:33:09.752 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is set 2026-02-23T08:33:09.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:489: TEST_just_deep_scrubs: sleep 6 2026-02-23T08:33:15.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:490: TEST_just_deep_scrubs: date -Ins 2026-02-23T08:33:15.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:490: TEST_just_deep_scrubs: local now_is=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:15.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:491: TEST_just_deep_scrubs: declare -A sched_data 2026-02-23T08:33:15.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:492: TEST_just_deep_scrubs: local pgid=1.2 2026-02-23T08:33:15.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:495: TEST_just_deep_scrubs: set_query_debug 1.2 2026-02-23T08:33:15.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:420: set_query_debug: local pgid=1.2 2026-02-23T08:33:15.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: ceph pg dump pgs_brief 2026-02-23T08:33:15.771 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: awk -v 'pg=^1.2' -n -e '$0 ~ pg { print(gensub(/[^0-9]*([0-9]+).*/,"\\1","g",$5)); }' 2026-02-23T08:33:15.923 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs_brief 2026-02-23T08:33:15.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:422: set_query_debug: local prim_osd=0 2026-02-23T08:33:15.934 INFO:tasks.workunit.client.0.trial129.stdout:Setting scrub debug data. Primary for 1.2 is 0 2026-02-23T08:33:15.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:423: set_query_debug: echo 'Setting scrub debug data. Primary for 1.2 is 0' 2026-02-23T08:33:15.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: get_asok_path osd.0 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-osd.0.asok 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: CEPH_ARGS= 2026-02-23T08:33:15.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:424: set_query_debug: ceph --format=json daemon /tmp/ceph-asok.889699/ceph-osd.0.asok scrubdebug 1.2 set sessions 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:497: TEST_just_deep_scrubs: extract_published_sch 1.2 2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:15,769178119+00:00 sched_data 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.2 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sched_data 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-23T08:33:16.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-23T08:33:16.151 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:33:16.162 INFO:tasks.workunit.client.0.trial129.stdout:{"success":true}from pg dump pg: { 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 0, 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-24T08:33:01.866720+0000", 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:33:16.163 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 19, 2026-02-23T08:33:16.164 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 39 2026-02-23T08:33:16.164 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:16.164 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:33:16.235 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:01.866720+0000", 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-24T08:33:01.866 (2026-02-24T08:33:01.866)", 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "test_sequence": 12914688, 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:16.236 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:01.866720+0000", 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:33:01.866720+0000", 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:33:16.237 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-03-04T05:19:52.780435+0000", 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-03-04T05:19:52.780435+0000", 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:16.238 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:33:16.309 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=40 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-24T08:33:01.866' 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-24T08:33:01.866' 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=0 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:33:01.866720+0000' 2026-02-23T08:33:16.310 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='0x0' 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=true 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=12914688 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=0 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-24T08:33:01.866720+0000' 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=19 2026-02-23T08:33:16.311 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=39 2026-02-23T08:33:16.312 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:33:16.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:498: TEST_just_deep_scrubs: local saved_last_stamp=2026-02-23T08:33:01.866720+0000 2026-02-23T08:33:16.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:499: TEST_just_deep_scrubs: local dbg_counter_at_start=12914688 2026-02-23T08:33:16.313 INFO:tasks.workunit.client.0.trial129.stdout:test counter @ start: 12914688 2026-02-23T08:33:16.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:500: TEST_just_deep_scrubs: echo 'test counter @ start: 12914688' 2026-02-23T08:33:16.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:502: TEST_just_deep_scrubs: ceph tell 1.2 schedule-deep-scrub 2026-02-23T08:33:16.377 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:16.377 INFO:tasks.workunit.client.0.trial129.stdout: "deep": true, 2026-02-23T08:33:16.378 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:33:16.378 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-12T03:45:06.377374+0000" 2026-02-23T08:33:16.378 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:16.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:504: TEST_just_deep_scrubs: sleep 5 2026-02-23T08:33:21.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:506: TEST_just_deep_scrubs: ceph pg dump pgs --format=json-pretty 2026-02-23T08:33:21.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:506: TEST_just_deep_scrubs: jq -r '.pg_stats[] | "\(.pgid) \(.stat_sum.num_objects)"' 2026-02-23T08:33:21.537 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:33:21.548 INFO:tasks.workunit.client.0.trial129.stdout:1.3 20 2026-02-23T08:33:21.548 INFO:tasks.workunit.client.0.trial129.stdout:1.2 20 2026-02-23T08:33:21.548 INFO:tasks.workunit.client.0.trial129.stdout:1.1 25 2026-02-23T08:33:21.548 INFO:tasks.workunit.client.0.trial129.stdout:1.0 25 2026-02-23T08:33:21.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:507: TEST_just_deep_scrubs: ceph pg 1.2 query --format=json-pretty 2026-02-23T08:33:21.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:507: TEST_just_deep_scrubs: jq -r .info.stats.stat_sum.num_objects 2026-02-23T08:33:21.621 INFO:tasks.workunit.client.0.trial129.stdout:Objects # in pg 1.2: 20 2026-02-23T08:33:21.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:507: TEST_just_deep_scrubs: echo 'Objects # in pg 1.2: ' 20 2026-02-23T08:33:21.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:509: TEST_just_deep_scrubs: declare -A sc_data_2 2026-02-23T08:33:21.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:510: TEST_just_deep_scrubs: extract_published_sch 1.2 2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:15,769178119+00:00 sc_data_2 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.2 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sc_data_2 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-23T08:33:21.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-23T08:33:21.772 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 0, 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic deep scrub scheduled", 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-23T08:33:18.456502+0000", 2026-02-23T08:33:21.783 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:33:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:33:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 19, 2026-02-23T08:33:21.784 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 44 2026-02-23T08:33:21.784 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:21.784 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:33:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:33:21.854 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-23T08:33:22.565989+0000", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "deep scrub scheduled @ 2026-02-23T08:33:22.565 (2026-02-20T12:20:22.207)", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "test_sequence": 12914688, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:01.866720+0000", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:33:01.866720+0000", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-23T08:33:22.565989+0000", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-20T12:20:22.207980+0000", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "noscrub", 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:21.855 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:33:21.931 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:33:21.931 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=19 2026-02-23T08:33:21.931 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=45 2026-02-23T08:33:21.931 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:33:21.931 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='deep scrub scheduled' 2026-02-23T08:33:21.931 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-23T08:33:22.565' 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-20T12:20:22.207' 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=0 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:33:01.866720+0000' 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='0x0' 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=false 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=12914688 2026-02-23T08:33:21.932 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=0 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic deep scrub scheduled' 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-23T08:33:18.456502+0000' 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=19 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=44 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:511: TEST_just_deep_scrubs: echo 'test counter @ should show no change: ' 12914688 2026-02-23T08:33:21.933 INFO:tasks.workunit.client.0.trial129.stdout:test counter @ should show no change: 12914688 2026-02-23T08:33:21.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:512: TEST_just_deep_scrubs: (( 0 == 0 )) 2026-02-23T08:33:21.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:513: TEST_just_deep_scrubs: (( 12914688 == 12914688 )) 2026-02-23T08:33:21.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:516: TEST_just_deep_scrubs: ceph osd unset nodeep-scrub 2026-02-23T08:33:22.140 INFO:tasks.workunit.client.0.trial129.stderr:nodeep-scrub is unset 2026-02-23T08:33:22.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:517: TEST_just_deep_scrubs: sleep 8 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:518: TEST_just_deep_scrubs: expct_qry_duration=(['query_last_duration']='0' ['query_last_duration_neg']='not0') 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:518: TEST_just_deep_scrubs: declare -A expct_qry_duration 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:519: TEST_just_deep_scrubs: sc_data_2=() 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:520: TEST_just_deep_scrubs: extract_published_sch 1.2 2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:15,769178119+00:00 sc_data_2 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:17: extract_published_sch: local pgn=1.2 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:18: extract_published_sch: local -n dict=sc_data_2 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:19: extract_published_sch: local current_time=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:20: extract_published_sch: local extra_time=2026-02-23T08:33:15,769178119+00:00 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:21: extract_published_sch: local extr_dbg=2 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:24: extract_published_sch: local saved_echo_flag=x 2026-02-23T08:33:30.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:25: extract_published_sch: set +x 2026-02-23T08:33:30.307 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:33:30.318 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:33:30.318 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 20, 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 57 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:30.319 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:33:30.391 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-24T08:33:23.620 (2026-02-24T08:33:23.620)", 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "test_sequence": 12914691, 2026-02-23T08:33:30.392 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:30.393 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-03-01T22:06:47.284744+0000", 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-03-01T22:06:47.284744+0000", 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:30.394 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:30.395 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:30.395 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:30.395 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:30.395 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=20 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=58 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-24T08:33:23.620' 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-24T08:33:23.620' 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:33:23.620610+0000' 2026-02-23T08:33:30.467 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x20' 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=true 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=12914691 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-24T08:33:23.620610+0000' 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=20 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=57 2026-02-23T08:33:30.468 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:33:30.470 INFO:tasks.workunit.client.0.trial129.stdout:test counter @ should be higher than before the unset: 12914691 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:521: TEST_just_deep_scrubs: echo 'test counter @ should be higher than before the unset: ' 12914691 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:523: TEST_just_deep_scrubs: expct_qry_duration=(['query_last_duration']='0' ['query_last_duration_neg']='not0') 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:523: TEST_just_deep_scrubs: declare -A expct_qry_duration 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:524: TEST_just_deep_scrubs: sc_data_2=() 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:525: TEST_just_deep_scrubs: wait_any_cond 1.2 10 2026-02-23T08:33:01.866720+0000 expct_qry_duration 'WaitingAfterScrub ' sc_data_2 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:106: wait_any_cond: local pgid=1.2 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:107: wait_any_cond: local retries=10 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:108: wait_any_cond: local cmp_date=2026-02-23T08:33:01.866720+0000 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:109: wait_any_cond: local -n ep=expct_qry_duration 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:110: wait_any_cond: local -n out_array=sc_data_2 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:111: wait_any_cond: local -A sc_data 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:112: wait_any_cond: local extr_dbg=2 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:115: wait_any_cond: local saved_echo_flag=x 2026-02-23T08:33:30.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:116: wait_any_cond: set +x 2026-02-23T08:33:30.472 INFO:tasks.workunit.client.0.trial129.stdout:waiting for any condition (WaitingAfterScrub ): pg:1.2 dt:2026-02-23T08:33:01.866720+0000 (10 retries) 2026-02-23T08:33:31.128 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:33:31.139 INFO:tasks.workunit.client.0.trial129.stdout:from pg dump pg: { 2026-02-23T08:33:31.139 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_pg_state": "active+clean", 2026-02-23T08:33:31.139 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_state_has_scrubbing": false, 2026-02-23T08:33:31.139 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_last_duration": 1, 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule": "periodic scrub scheduled", 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_schedule_at": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_is_future": true, 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_vs_date": true, 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_reported_epoch": 20, 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout: "dmp_seq": 57 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:31.140 INFO:tasks.workunit.client.0.trial129.stdout:query output: 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "scrubber": { 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "active": false, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "must_scrub": false, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "must_deep_scrub": false, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "must_repair": false, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "schedule": "scrub scheduled @ 2026-02-24T08:33:23.620 (2026-02-24T08:33:23.620)", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "test_sequence": 12914691, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "shallow-target": { 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-02-24T08:33:23.620610+0000", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "deep-target": { 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "pgid": "1.2", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.212 INFO:tasks.workunit.client.0.trial129.stdout: "urgency": "periodic-regular", 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "sched_time": "2026-03-01T22:06:47.284744+0000", 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "orig_sched_time": "2026-03-01T22:06:47.284744+0000", 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "last_issue": "ok", 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "forced": false, 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "eligible": false, 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "queued": true, 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "active": false 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.213 INFO:tasks.workunit.client.0.trial129.stdout: "agent_state": {} 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:( 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_epoch]=20 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_seq]=58 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_active]=false 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule]='scrub scheduled' 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_schedule_at]='2026-02-24T08:33:23.620' 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_target_at]='2026-02-24T08:33:23.620' 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_duration]=1 2026-02-23T08:33:31.288 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_stamp]='2026-02-23T08:33:23.620610+0000' 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_last_scrub]='17x20' 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_is_future]=true 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_vs_date]=true 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[query_scrub_seq]=12914691 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_pg_state]='active+clean' 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_state_has_scrubbing]=false 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_last_duration]=1 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule]='periodic scrub scheduled' 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_schedule_at]='2026-02-24T08:33:23.620610+0000' 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_is_future]=true 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_vs_date]=true 2026-02-23T08:33:31.289 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_reported_epoch]=20 2026-02-23T08:33:31.290 INFO:tasks.workunit.client.0.trial129.stdout:[dmp_seq]=57 2026-02-23T08:33:31.290 INFO:tasks.workunit.client.0.trial129.stdout:) 2026-02-23T08:33:31.290 INFO:tasks.workunit.client.0.trial129.stdout:--> loop: 1 ~ false / 58 / 57 / true / 2026-02-23T08:33:23.620610+0000 / scrub scheduled %%% query_last_duration_neg query_last_duration 2026-02-23T08:33:31.291 INFO:tasks.workunit.client.0.trial129.stdout:key is query_last_duration: negation:1 # expected: 0 # in actual: 1 2026-02-23T08:33:31.291 INFO:tasks.workunit.client.0.trial129.stdout:WaitingAfterScrub - 'query_last_duration' actual value (1) matches expected (0) (negation: 1) 2026-02-23T08:33:31.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh:157: wait_any_cond: return 0 2026-02-23T08:33:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:526: TEST_just_deep_scrubs: perf_counters td/osd-scrub-test 3 2026-02-23T08:33:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:33:31.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:33:31.292 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:33:31.292 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:33:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:33:31.293 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:33:31.364 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:31.364 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.365 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 2, 2026-02-23T08:33:31.366 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.367 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.368 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:33:31.369 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:31.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:31.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:33:31.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:33:31.437 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:31.437 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:33:31.437 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.438 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.439 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.440 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:31.441 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:33:31.442 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:31.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:31.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:33:31.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.511 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:31.512 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.513 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:31.514 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:31.515 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.516 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:31.516 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:33:31.516 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:31.516 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_just_deep_scrubs ------------------ 2026-02-23T08:33:31.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_just_deep_scrubs ------------------' 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:33:31.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:33:31.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:33:31.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:33:31.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:33:31.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:33:31.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:33:31.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:33:31.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:33:31.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:31.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:33:31.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:33:31.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:31.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:33:31.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:33:31.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:33:31.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:33:31.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:33:31.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:33:31.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:33:31.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_just_deep_scrubs ------------------' 2026-02-23T08:33:31.636 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_just_deep_scrubs ------------------ 2026-02-23T08:33:31.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:33:31.637 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_pg_dump_objects_scrubbed ------------------- 2026-02-23T08:33:31.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_pg_dump_objects_scrubbed -------------------' 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:33:31.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:33:31.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:33:31.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:33:31.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:33:31.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:33:31.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:33:31.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:33:31.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:33:31.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:31.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:33:31.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:33:31.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:31.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:33:31.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:33:31.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:33:31.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:33:31.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:33:31.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:33:31.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:33:31.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:33:31.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:33:31.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:33:31.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:33:31.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:33:31.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:33:31.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:33:31.651 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_pg_dump_objects_scrubbed ----------------------- 2026-02-23T08:33:31.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_pg_dump_objects_scrubbed -----------------------' 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_pg_dump_objects_scrubbed td/osd-scrub-test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:653: TEST_pg_dump_objects_scrubbed: local dir=td/osd-scrub-test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:654: TEST_pg_dump_objects_scrubbed: local poolname=test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:655: TEST_pg_dump_objects_scrubbed: local OSDS=3 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:656: TEST_pg_dump_objects_scrubbed: local objects=15 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:657: TEST_pg_dump_objects_scrubbed: local timeout=10 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:659: TEST_pg_dump_objects_scrubbed: TESTDATA=testdata.889699 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:661: TEST_pg_dump_objects_scrubbed: setup td/osd-scrub-test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:33:31.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:33:31.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:33:31.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:33:31.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:33:31.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:33:31.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:33:31.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:33:31.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:33:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:33:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:33:31.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:31.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:33:31.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:33:31.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:33:31.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:33:31.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:33:31.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:33:31.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:33:31.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:33:31.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:33:31.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.662 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:33:31.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:33:31.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:33:31.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:33:31.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:662: TEST_pg_dump_objects_scrubbed: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:33:31.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-23T08:33:31.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:33:31.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:31.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:31.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:31.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.682 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:31.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-23T08:33:31.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:33:31.704 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:33:31.705 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:33:31.705 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.706 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.706 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:33:31.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:33:31.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:33:31.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:33:31.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:33:31.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:33:31.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:33:31.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:33:31.764 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:33:31.764 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:33:31.765 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:33:31.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:663: TEST_pg_dump_objects_scrubbed: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:33:31.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:33:31.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:33:31.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:33:31.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:33:31.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:33:31.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.911 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:31.912 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:33:31.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:33:31.926 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: expr 3 - 1 2026-02-23T08:33:31.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: seq 0 2 2026-02-23T08:33:31.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:31.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:666: TEST_pg_dump_objects_scrubbed: run_osd td/osd-scrub-test 0 2026-02-23T08:33:31.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:33:31.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:33:31.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:31.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:33:31.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:33:31.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:33:31.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5902178c-017a-46df-bddc-2f46010b1ba3 2026-02-23T08:33:31.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5902178c-017a-46df-bddc-2f46010b1ba3' 2026-02-23T08:33:31.936 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 5902178c-017a-46df-bddc-2f46010b1ba3 2026-02-23T08:33:31.936 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:33:31.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDbEJxpfswFOBAAj6JMDCmqpZfl+oAMIBAStg== 2026-02-23T08:33:31.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDbEJxpfswFOBAAj6JMDCmqpZfl+oAMIBAStg=="}' 2026-02-23T08:33:31.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5902178c-017a-46df-bddc-2f46010b1ba3 -i td/osd-scrub-test/0/new.json 2026-02-23T08:33:32.029 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:32.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:33:32.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDbEJxpfswFOBAAj6JMDCmqpZfl+oAMIBAStg== --osd-uuid 5902178c-017a-46df-bddc-2f46010b1ba3 2026-02-23T08:33:32.052 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.051+0000 7f9cac206780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:32.053 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.052+0000 7f9cac206780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:32.054 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.053+0000 7f9cac206780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:32.055 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.053+0000 7f9cac206780 -1 bdev(0x561f502dd400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:33:32.055 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.053+0000 7f9cac206780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:33:32.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:33:32.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:33:32.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:33:32.444 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:33:32.444 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:33:32.538 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:33:32.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:33:32.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:33:32.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:33:32.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:33:32.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:33:32.550 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.548+0000 7fcd98151780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:32.551 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.550+0000 7fcd98151780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:32.552 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.550+0000 7fcd98151780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:32.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:33:32.629 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:32.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:32.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:33:32.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:33:32.776 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:32.775+0000 7fcd98151780 -1 Falling back to public interface 2026-02-23T08:33:33.076 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:33.074+0000 7fcd98151780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:33:33.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:33:33.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:33.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:33:33.720 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:33.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:33.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:33:33.809 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4043167181,v1:127.0.0.1:6801/4043167181] [v2:127.0.0.1:6802/4043167181,v1:127.0.0.1:6803/4043167181] exists,up 5902178c-017a-46df-bddc-2f46010b1ba3 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:666: TEST_pg_dump_objects_scrubbed: run_osd td/osd-scrub-test 1 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:33:33.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:33:33.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6a25eca8-739e-46ba-b40a-b1ff630e0dc7 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 6a25eca8-739e-46ba-b40a-b1ff630e0dc7 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 6a25eca8-739e-46ba-b40a-b1ff630e0dc7' 2026-02-23T08:33:33.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:33:33.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDdEJxp1BbpMBAAMFX9v3dY7zHtDI/CDGzyGA== 2026-02-23T08:33:33.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDdEJxp1BbpMBAAMFX9v3dY7zHtDI/CDGzyGA=="}' 2026-02-23T08:33:33.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6a25eca8-739e-46ba-b40a-b1ff630e0dc7 -i td/osd-scrub-test/1/new.json 2026-02-23T08:33:33.913 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:33.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:33:33.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDdEJxp1BbpMBAAMFX9v3dY7zHtDI/CDGzyGA== --osd-uuid 6a25eca8-739e-46ba-b40a-b1ff630e0dc7 2026-02-23T08:33:33.938 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:33.936+0000 7fe90360a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:33.939 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:33.938+0000 7fe90360a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:33.940 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:33.938+0000 7fe90360a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:33.940 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:33.939+0000 7fe90360a780 -1 bdev(0x55ef79099400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:33:33.940 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:33.939+0000 7fe90360a780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:33:34.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:33:34.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:33:34.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:33:34.357 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:33:34.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:33:34.562 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:33:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:33:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:33:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:33:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:33:34.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:33:34.573 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:34.572+0000 7ff68b571780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:34.574 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:34.573+0000 7ff68b571780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:34.575 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:34.574+0000 7ff68b571780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:34.727 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:33:34.728 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:34.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:34.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:33:34.744 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:34.742+0000 7ff68b571780 -1 Falling back to public interface 2026-02-23T08:33:34.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:33:35.007 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:35.005+0000 7ff68b571780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:33:35.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:33:35.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:35.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:33:35.897 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:35.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:35.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:33:36.061 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1997940916,v1:127.0.0.1:6811/1997940916] [v2:127.0.0.1:6812/1997940916,v1:127.0.0.1:6813/1997940916] exists,up 6a25eca8-739e-46ba-b40a-b1ff630e0dc7 2026-02-23T08:33:36.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:33:36.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:33:36.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:664: TEST_pg_dump_objects_scrubbed: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:666: TEST_pg_dump_objects_scrubbed: run_osd td/osd-scrub-test 2 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:33:36.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:36.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:33:36.068 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:33:36.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=726780d6-b5d0-4e2f-927d-8ff0c7475ca4 2026-02-23T08:33:36.069 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 726780d6-b5d0-4e2f-927d-8ff0c7475ca4 2026-02-23T08:33:36.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 726780d6-b5d0-4e2f-927d-8ff0c7475ca4' 2026-02-23T08:33:36.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:33:36.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDgEJxpcjphBBAATMdwJ7V80VGU5ydU3dSCbw== 2026-02-23T08:33:36.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDgEJxpcjphBBAATMdwJ7V80VGU5ydU3dSCbw=="}' 2026-02-23T08:33:36.074 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 726780d6-b5d0-4e2f-927d-8ff0c7475ca4 -i td/osd-scrub-test/2/new.json 2026-02-23T08:33:36.233 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:33:36.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-23T08:33:36.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDgEJxpcjphBBAATMdwJ7V80VGU5ydU3dSCbw== --osd-uuid 726780d6-b5d0-4e2f-927d-8ff0c7475ca4 2026-02-23T08:33:36.258 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.257+0000 7f81aa67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:36.260 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.258+0000 7f81aa67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:36.261 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.259+0000 7f81aa67e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:36.261 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.260+0000 7f81aa67e780 -1 bdev(0x56088a573400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:33:36.261 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.260+0000 7f81aa67e780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:33:36.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-23T08:33:36.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:33:36.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:33:36.674 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:33:36.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:33:36.882 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:33:36.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:33:36.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:33:36.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:33:36.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:33:36.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:33:36.893 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.892+0000 7fecfc8bd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:36.895 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.893+0000 7fecfc8bd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:36.895 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:36.894+0000 7fecfc8bd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:37.048 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:37.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:33:37.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:37.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:33:37.088 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:37.086+0000 7fecfc8bd780 -1 Falling back to public interface 2026-02-23T08:33:37.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:33:37.442 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:37.440+0000 7fecfc8bd780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:33:38.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:33:38.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:38.213 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:38.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:33:38.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:38.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:33:38.379 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3352971648,v1:127.0.0.1:6819/3352971648] [v2:127.0.0.1:6820/3352971648,v1:127.0.0.1:6821/3352971648] exists,up 726780d6-b5d0-4e2f-927d-8ff0c7475ca4 2026-02-23T08:33:38.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:33:38.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:33:38.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:33:38.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:670: TEST_pg_dump_objects_scrubbed: create_pool test 1 1 2026-02-23T08:33:38.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:33:38.622 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:33:38.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:33:39.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:671: TEST_pg_dump_objects_scrubbed: wait_for_clean 2026-02-23T08:33:39.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:33:39.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:33:39.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:33:39.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:33:39.637 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:33:39.637 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:33:39.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:33:39.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:33:39.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:33:39.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:33:39.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:33:39.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:33:39.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:33:39.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:33:39.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:33:39.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:33:39.884 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:33:39.884 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:33:39.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:33:39.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:39.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:33:39.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:33:39.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:33:39.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:33:39.958 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:39.958 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:33:40.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-23T08:33:40.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-23T08:33:40.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-23T08:33:40.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:40.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:33:40.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542148 2026-02-23T08:33:40.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542148 2026-02-23T08:33:40.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542148' 2026-02-23T08:33:40.107 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:40.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:33:40.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:40.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:33:40.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:33:40.109 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:40.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:33:40.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:33:40.110 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:33:40.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:40.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:33:40.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:33:41.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:33:41.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:41.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:33:41.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:33:42.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:33:42.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:42.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836487 2026-02-23T08:33:42.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:42.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-23T08:33:42.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:42.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:33:42.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-23T08:33:42.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:42.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-23T08:33:42.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-23T08:33:42.617 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672966 2026-02-23T08:33:42.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:33:42.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672968 -lt 42949672966 2026-02-23T08:33:42.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:42.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542148 2026-02-23T08:33:42.783 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:42.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:33:42.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542148 2026-02-23T08:33:42.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542148 2026-02-23T08:33:42.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542148' 2026-02-23T08:33:42.785 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542148 2026-02-23T08:33:42.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:33:42.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542148 2026-02-23T08:33:42.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:33:42.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:33:42.953 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:33:43.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:33:43.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:33:43.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:33:43.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:33:43.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:33:43.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:33:43.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:33:43.154 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:33:43.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:33:43.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:33:43.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:33:43.316 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:33:43.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:33:43.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:33:43.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:33:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: ceph osd dump 2026-02-23T08:33:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: grep '^pool.*['\'']test['\'']' 2026-02-23T08:33:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: awk '{ print $2 }' 2026-02-23T08:33:43.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:672: TEST_pg_dump_objects_scrubbed: poolid=1 2026-02-23T08:33:43.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:674: TEST_pg_dump_objects_scrubbed: dd if=/dev/urandom of=testdata.889699 bs=1032 count=1 2026-02-23T08:33:43.683 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:33:43.683 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:33:43.683 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 2.0408e-05 s, 50.6 MB/s 2026-02-23T08:33:43.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: seq 1 15 2026-02-23T08:33:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj1 testdata.889699 2026-02-23T08:33:43.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj2 testdata.889699 2026-02-23T08:33:43.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj3 testdata.889699 2026-02-23T08:33:43.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj4 testdata.889699 2026-02-23T08:33:43.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj5 testdata.889699 2026-02-23T08:33:43.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj6 testdata.889699 2026-02-23T08:33:43.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj7 testdata.889699 2026-02-23T08:33:43.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj8 testdata.889699 2026-02-23T08:33:43.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj9 testdata.889699 2026-02-23T08:33:43.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj10 testdata.889699 2026-02-23T08:33:43.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj11 testdata.889699 2026-02-23T08:33:43.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.839 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj12 testdata.889699 2026-02-23T08:33:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj13 testdata.889699 2026-02-23T08:33:43.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj14 testdata.889699 2026-02-23T08:33:43.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:675: TEST_pg_dump_objects_scrubbed: for i in `seq 1 $objects` 2026-02-23T08:33:43.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:677: TEST_pg_dump_objects_scrubbed: rados -p test put obj15 testdata.889699 2026-02-23T08:33:43.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:679: TEST_pg_dump_objects_scrubbed: rm -f testdata.889699 2026-02-23T08:33:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:681: TEST_pg_dump_objects_scrubbed: local pgid=1.0 2026-02-23T08:33:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:683: TEST_pg_dump_objects_scrubbed: pg_scrub 1.0 2026-02-23T08:33:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1923: pg_scrub: local pgid=1.0 2026-02-23T08:33:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1925: pg_scrub: wait_for_pg_clean 1.0 2026-02-23T08:33:43.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-23T08:33:43.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:33:43.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:33:43.898 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:33:43.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:33:43.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:33:43.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:33:44.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:33:44.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:33:44.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:33:44.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:33:44.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:33:44.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:33:44.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:33:44.252 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:33:44.252 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:33:44.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:33:44.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:44.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:33:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-23T08:33:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-23T08:33:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-23T08:33:44.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:44.324 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:33:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672972 2026-02-23T08:33:44.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672972 2026-02-23T08:33:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-42949672972' 2026-02-23T08:33:44.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:44.396 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:33:44.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-23T08:33:44.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-23T08:33:44.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-42949672972 2-60129542153' 2026-02-23T08:33:44.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:44.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-23T08:33:44.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:33:44.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-23T08:33:44.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-23T08:33:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-23T08:33:44.476 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836493 2026-02-23T08:33:44.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:44.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-23T08:33:44.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:33:45.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:33:45.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:45.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836493 2026-02-23T08:33:45.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:33:46.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:33:46.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:46.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836494 -lt 21474836493 2026-02-23T08:33:46.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:46.971 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672972 2026-02-23T08:33:46.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:46.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:33:46.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672972 2026-02-23T08:33:46.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:46.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672972 2026-02-23T08:33:46.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672972' 2026-02-23T08:33:46.975 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672972 2026-02-23T08:33:46.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:33:47.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672973 -lt 42949672972 2026-02-23T08:33:47.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:47.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-23T08:33:47.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:47.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:33:47.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-23T08:33:47.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:47.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-23T08:33:47.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-23T08:33:47.142 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 60129542153 2026-02-23T08:33:47.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:33:47.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542155 -lt 60129542153 2026-02-23T08:33:47.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:33:47.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-23T08:33:47.306 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 1.0 loop 0 2026-02-23T08:33:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-23T08:33:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-23T08:33:47.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:33:47.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-23T08:33:47.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:33:47.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: get_last_scrub_stamp 1.0 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:33:47.379 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:33:47.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1926: pg_scrub: local last_scrub=2026-02-23T08:33:38.620073+0000 2026-02-23T08:33:47.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1927: pg_scrub: ceph pg scrub 1.0 2026-02-23T08:33:47.694 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to scrub 2026-02-23T08:33:47.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1928: pg_scrub: wait_for_scrub 1.0 2026-02-23T08:33:38.620073+0000 2026-02-23T08:33:47.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:33:47.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:33:38.620073+0000 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:33:47.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:33:47.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:33:38.620073+0000 '>' 2026-02-23T08:33:38.620073+0000 2026-02-23T08:33:47.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:33:48.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:33:48.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:33:48.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:33:48.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:33:48.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:33:48.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:33:48.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:33:49.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:33:38.620073+0000 '>' 2026-02-23T08:33:38.620073+0000 2026-02-23T08:33:49.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:33:50.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:33:50.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:33:50.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:33:50.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:33:50.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:33:50.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:33:50.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:33:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:33:48.180985+0000 '>' 2026-02-23T08:33:38.620073+0000 2026-02-23T08:33:50.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:33:50.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:684: TEST_pg_dump_objects_scrubbed: ceph pg 1.0 query 2026-02-23T08:33:50.202 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:684: TEST_pg_dump_objects_scrubbed: jq .info.stats.objects_scrubbed 2026-02-23T08:33:50.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:684: TEST_pg_dump_objects_scrubbed: test 15 = 15 2026-02-23T08:33:50.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:685: TEST_pg_dump_objects_scrubbed: perf_counters td/osd-scrub-test 3 2026-02-23T08:33:50.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:33:50.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:33:50.275 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:33:50.276 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:33:50.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:50.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:33:50.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:33:50.351 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:50.351 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:33:50.351 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.351 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.352 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.353 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.354 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:50.355 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:33:50.356 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:50.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:50.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:33:50.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:33:50.422 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.423 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.424 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:50.425 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.426 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 1, 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.427 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:33:50.428 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:50.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:50.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:33:50.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:33:50.494 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:33:50.494 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:33:50.494 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.494 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.495 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.496 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.497 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.498 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:33:50.499 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:33:50.499 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:687: TEST_pg_dump_objects_scrubbed: teardown td/osd-scrub-test 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:33:50.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:33:50.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:33:50.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:33:50.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:33:50.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:33:50.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:33:50.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:33:50.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:33:50.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:50.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:33:50.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:33:50.606 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:50.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:33:50.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:33:50.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:33:50.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:33:50.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:33:50.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:33:50.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:33:50.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_pg_dump_objects_scrubbed ------------------' 2026-02-23T08:33:50.617 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_pg_dump_objects_scrubbed ------------------ 2026-02-23T08:33:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:33:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:33:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:33:50.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:33:50.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:33:50.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:33:50.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:33:50.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:33:50.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:33:50.619 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:33:50.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:33:50.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:33:50.620 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:33:50.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:33:50.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:33:50.622 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:33:50.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:50.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:33:50.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:33:50.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:50.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:33:50.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:33:50.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:33:50.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:33:50.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.626 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:33:50.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:33:50.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:33:50.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_pg_dump_objects_scrubbed ------------------' 2026-02-23T08:33:50.627 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_pg_dump_objects_scrubbed ------------------ 2026-02-23T08:33:50.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:33:50.628 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_scrub_abort ------------------- 2026-02-23T08:33:50.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_scrub_abort -------------------' 2026-02-23T08:33:50.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:33:50.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:33:50.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:33:50.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:33:50.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:33:50.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:33:50.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:33:50.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:33:50.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:50.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:33:50.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:33:50.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:33:50.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:33:50.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:33:50.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:33:50.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:33:50.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:33:50.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:33:50.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:33:50.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:33:50.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:33:50.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:33:50.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:33:50.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:33:50.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:33:50.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:33:50.642 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_scrub_abort ----------------------- 2026-02-23T08:33:50.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_scrub_abort -----------------------' 2026-02-23T08:33:50.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_scrub_abort td/osd-scrub-test 2026-02-23T08:33:50.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:404: TEST_scrub_abort: local dir=td/osd-scrub-test 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:405: TEST_scrub_abort: _scrub_abort td/osd-scrub-test scrub 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:293: _scrub_abort: local dir=td/osd-scrub-test 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:294: _scrub_abort: local poolname=test 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:295: _scrub_abort: local OSDS=3 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:296: _scrub_abort: local objects=1000 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:297: _scrub_abort: local type=scrub 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:299: _scrub_abort: TESTDATA=testdata.889699 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:300: _scrub_abort: test scrub = scrub 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:302: _scrub_abort: stopscrub=noscrub 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:303: _scrub_abort: check=noscrub 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:309: _scrub_abort: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-23T08:33:50.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:33:50.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:33:50.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:33:50.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:33:50.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:33:50.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-23T08:33:50.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:50.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-23T08:33:50.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:33:50.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:33:50.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:33:50.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:33:50.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:33:50.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:33:50.684 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:33:50.684 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:33:50.684 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:33:50.685 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:33:50.685 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.685 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.685 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:33:50.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:33:50.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:33:50.745 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:33:50.746 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.746 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.746 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:33:50.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:33:50.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:33:50.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:310: _scrub_abort: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:33:50.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:33:50.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:33:50.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:33:50.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:33:50.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:33:50.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:33:50.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:33:50.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:50.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:50.900 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:50.901 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.901 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:50.901 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:33:50.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:33:50.916 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: expr 3 - 1 2026-02-23T08:33:50.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: seq 0 2 2026-02-23T08:33:50.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:50.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 0 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:33:50.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:33:50.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:33:50.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:33:50.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:33:50.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:33:50.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5771f8a2-0731-471a-9c91-9a10eac3c4ad 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 5771f8a2-0731-471a-9c91-9a10eac3c4ad' 2026-02-23T08:33:50.924 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 5771f8a2-0731-471a-9c91-9a10eac3c4ad 2026-02-23T08:33:50.925 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:33:50.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDuEJxpnrZcNxAAtVSQ5aJd4ArlPiMMa0fxbA== 2026-02-23T08:33:50.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDuEJxpnrZcNxAAtVSQ5aJd4ArlPiMMa0fxbA=="}' 2026-02-23T08:33:50.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5771f8a2-0731-471a-9c91-9a10eac3c4ad -i td/osd-scrub-test/0/new.json 2026-02-23T08:33:51.015 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:51.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:33:51.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQDuEJxpnrZcNxAAtVSQ5aJd4ArlPiMMa0fxbA== --osd-uuid 5771f8a2-0731-471a-9c91-9a10eac3c4ad 2026-02-23T08:33:51.039 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.038+0000 7f7b46566780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:51.040 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.039+0000 7f7b46566780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:51.041 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.040+0000 7f7b46566780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:51.042 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.040+0000 7f7b46566780 -1 bdev(0x564ef15f1400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:33:51.042 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.040+0000 7f7b46566780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:33:51.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:33:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:33:51.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:33:51.493 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:33:51.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:33:51.586 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:33:51.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:33:51.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:33:51.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:33:51.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:33:51.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:33:51.599 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.597+0000 7f5f8e750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:51.600 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.599+0000 7f5f8e750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:51.601 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.600+0000 7f5f8e750780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:51.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:33:51.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:33:51.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:33:51.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:33:51.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:33:51.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:51.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:33:51.681 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:51.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:51.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:33:51.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:33:51.844 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:51.843+0000 7f5f8e750780 -1 Falling back to public interface 2026-02-23T08:33:52.237 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:52.235+0000 7f5f8e750780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:33:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:33:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:52.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:33:52.771 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:52.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:52.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:33:52.863 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/70350551,v1:127.0.0.1:6801/70350551] [v2:127.0.0.1:6802/70350551,v1:127.0.0.1:6803/70350551] exists,up 5771f8a2-0731-471a-9c91-9a10eac3c4ad 2026-02-23T08:33:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:33:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:33:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:33:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 1 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:33:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:33:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:33:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=98487aa9-10b0-4be2-8fc4-b52e81019017 2026-02-23T08:33:52.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 98487aa9-10b0-4be2-8fc4-b52e81019017' 2026-02-23T08:33:52.871 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 98487aa9-10b0-4be2-8fc4-b52e81019017 2026-02-23T08:33:52.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:33:52.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDwEJxpSiAjNBAALUoI16XokktrhoQbSmm4JQ== 2026-02-23T08:33:52.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDwEJxpSiAjNBAALUoI16XokktrhoQbSmm4JQ=="}' 2026-02-23T08:33:52.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 98487aa9-10b0-4be2-8fc4-b52e81019017 -i td/osd-scrub-test/1/new.json 2026-02-23T08:33:52.964 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:52.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:33:52.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQDwEJxpSiAjNBAALUoI16XokktrhoQbSmm4JQ== --osd-uuid 98487aa9-10b0-4be2-8fc4-b52e81019017 2026-02-23T08:33:52.987 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:52.985+0000 7f8b09681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:52.988 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:52.986+0000 7f8b09681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:52.989 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:52.987+0000 7f8b09681780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:52.989 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:52.988+0000 7f8b09681780 -1 bdev(0x556a26787400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:33:52.989 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:52.988+0000 7f8b09681780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:33:53.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:33:53.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:33:53.415 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:33:53.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:33:53.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:33:53.625 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:33:53.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:33:53.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:33:53.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:33:53.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:33:53.627 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:33:53.637 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:53.636+0000 7f6e54955780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:53.639 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:53.637+0000 7f6e54955780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:53.639 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:53.638+0000 7f6e54955780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:53.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:33:53.789 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:53.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:33:53.795 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:53.793+0000 7f6e54955780 -1 Falling back to public interface 2026-02-23T08:33:53.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:33:54.175 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:54.174+0000 7f6e54955780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:33:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:33:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:33:54.953 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:54.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:54.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:33:55.115 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2526989740,v1:127.0.0.1:6811/2526989740] [v2:127.0.0.1:6812/2526989740,v1:127.0.0.1:6813/2526989740] exists,up 98487aa9-10b0-4be2-8fc4-b52e81019017 2026-02-23T08:33:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:33:55.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:311: _scrub_abort: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:317: _scrub_abort: run_osd td/osd-scrub-test 2 --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:33:55.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:33:55.121 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:33:55.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq' 2026-02-23T08:33:55.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:33:55.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:33:55.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=10a5788a-87cf-43a5-9e05-d1f7a30acec2 2026-02-23T08:33:55.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 10a5788a-87cf-43a5-9e05-d1f7a30acec2' 2026-02-23T08:33:55.123 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 10a5788a-87cf-43a5-9e05-d1f7a30acec2 2026-02-23T08:33:55.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:33:55.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDzEJxp/qWXBxAAE1UwYl5RKsoV2kg2tJDpeA== 2026-02-23T08:33:55.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDzEJxp/qWXBxAAE1UwYl5RKsoV2kg2tJDpeA=="}' 2026-02-23T08:33:55.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 10a5788a-87cf-43a5-9e05-d1f7a30acec2 -i td/osd-scrub-test/2/new.json 2026-02-23T08:33:55.285 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:33:55.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-23T08:33:55.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq --mkfs --key AQDzEJxp/qWXBxAAE1UwYl5RKsoV2kg2tJDpeA== --osd-uuid 10a5788a-87cf-43a5-9e05-d1f7a30acec2 2026-02-23T08:33:55.310 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.309+0000 7fd3f4d49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:55.312 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.310+0000 7fd3f4d49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:55.312 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.311+0000 7fd3f4d49780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:55.313 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.311+0000 7fd3f4d49780 -1 bdev(0x55cdc74e1400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:33:55.313 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.311+0000 7fd3f4d49780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:33:55.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-23T08:33:55.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:33:55.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:33:55.707 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:33:55.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:33:55.912 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:33:55.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:33:55.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd_pool_default_pg_autoscale_mode=off --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_sleep=5.0 --osd_scrub_interval_randomize_ratio=0 --osd_op_queue=wpq 2026-02-23T08:33:55.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:33:55.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:33:55.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:33:55.926 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.924+0000 7f2a53b4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:55.927 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.926+0000 7f2a53b4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:55.928 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:55.926+0000 7f2a53b4a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:33:56.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:33:56.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:33:56.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:33:56.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:33:56.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:33:56.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:56.078 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:33:56.078 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:33:56.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:56.079 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:33:56.150 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:56.149+0000 7f2a53b4a780 -1 Falling back to public interface 2026-02-23T08:33:56.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:33:56.417 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:33:56.416+0000 7f2a53b4a780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:33:57.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:33:57.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:33:57.243 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:33:57.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:33:57.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:33:57.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:33:57.411 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/399665734,v1:127.0.0.1:6819/399665734] [v2:127.0.0.1:6820/399665734,v1:127.0.0.1:6821/399665734] exists,up 10a5788a-87cf-43a5-9e05-d1f7a30acec2 2026-02-23T08:33:57.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:33:57.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:33:57.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:33:57.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:325: _scrub_abort: create_pool test 1 1 2026-02-23T08:33:57.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:33:57.651 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:33:57.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:33:58.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:326: _scrub_abort: wait_for_clean 2026-02-23T08:33:58.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:33:58.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:33:58.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:33:58.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:33:58.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:33:58.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:33:58.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:33:58.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:33:58.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:33:58.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:33:58.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:33:58.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:33:58.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:33:58.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:33:58.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:33:58.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:33:58.914 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:33:58.914 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:33:58.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:33:58.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:58.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:33:58.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:33:58.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:33:58.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:33:58.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:58.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:33:59.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-23T08:33:59.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-23T08:33:59.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-23T08:33:59.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:33:59.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:33:59.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-23T08:33:59.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-23T08:33:59.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-55834574851' 2026-02-23T08:33:59.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:33:59.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:33:59.130 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:33:59.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:33:59.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:33:59.131 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:33:59.132 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:33:59.132 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:33:59.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:33:59.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:33:59.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:33:59.294 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:00.295 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:00.296 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:00.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:34:00.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:01.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:34:01.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:01.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836487 2026-02-23T08:34:01.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:01.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-23T08:34:01.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:01.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:01.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-23T08:34:01.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:01.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-23T08:34:01.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-23T08:34:01.639 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705669 2026-02-23T08:34:01.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:01.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705669 2026-02-23T08:34:01.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:01.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-23T08:34:01.810 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:01.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:01.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-23T08:34:01.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:01.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-23T08:34:01.813 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574851 2026-02-23T08:34:01.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-23T08:34:01.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:01.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574853 -lt 55834574851 2026-02-23T08:34:01.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:34:01.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:34:01.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:34:02.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:34:02.188 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:34:02.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:34:02.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:34:02.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:34:02.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:34:02.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:34:02.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:34:02.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:34:02.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: ceph osd dump 2026-02-23T08:34:02.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: grep '^pool.*['\'']test['\'']' 2026-02-23T08:34:02.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: awk '{ print $2 }' 2026-02-23T08:34:02.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:327: _scrub_abort: poolid=1 2026-02-23T08:34:02.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:329: _scrub_abort: dd if=/dev/urandom of=testdata.889699 bs=1032 count=1 2026-02-23T08:34:02.716 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:34:02.717 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:34:02.717 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 2.0739e-05 s, 49.8 MB/s 2026-02-23T08:34:02.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: seq 1 1000 2026-02-23T08:34:02.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1 testdata.889699 2026-02-23T08:34:02.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj2 testdata.889699 2026-02-23T08:34:02.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.747 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj3 testdata.889699 2026-02-23T08:34:02.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj4 testdata.889699 2026-02-23T08:34:02.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj5 testdata.889699 2026-02-23T08:34:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj6 testdata.889699 2026-02-23T08:34:02.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj7 testdata.889699 2026-02-23T08:34:02.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj8 testdata.889699 2026-02-23T08:34:02.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.829 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj9 testdata.889699 2026-02-23T08:34:02.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj10 testdata.889699 2026-02-23T08:34:02.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj11 testdata.889699 2026-02-23T08:34:02.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj12 testdata.889699 2026-02-23T08:34:02.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj13 testdata.889699 2026-02-23T08:34:02.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj14 testdata.889699 2026-02-23T08:34:02.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj15 testdata.889699 2026-02-23T08:34:02.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj16 testdata.889699 2026-02-23T08:34:02.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj17 testdata.889699 2026-02-23T08:34:02.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj18 testdata.889699 2026-02-23T08:34:02.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj19 testdata.889699 2026-02-23T08:34:02.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj20 testdata.889699 2026-02-23T08:34:02.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:02.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj21 testdata.889699 2026-02-23T08:34:03.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj22 testdata.889699 2026-02-23T08:34:03.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj23 testdata.889699 2026-02-23T08:34:03.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj24 testdata.889699 2026-02-23T08:34:03.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj25 testdata.889699 2026-02-23T08:34:03.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj26 testdata.889699 2026-02-23T08:34:03.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj27 testdata.889699 2026-02-23T08:34:03.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj28 testdata.889699 2026-02-23T08:34:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj29 testdata.889699 2026-02-23T08:34:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj30 testdata.889699 2026-02-23T08:34:03.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj31 testdata.889699 2026-02-23T08:34:03.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj32 testdata.889699 2026-02-23T08:34:03.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj33 testdata.889699 2026-02-23T08:34:03.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj34 testdata.889699 2026-02-23T08:34:03.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj35 testdata.889699 2026-02-23T08:34:03.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj36 testdata.889699 2026-02-23T08:34:03.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj37 testdata.889699 2026-02-23T08:34:03.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj38 testdata.889699 2026-02-23T08:34:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj39 testdata.889699 2026-02-23T08:34:03.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj40 testdata.889699 2026-02-23T08:34:03.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj41 testdata.889699 2026-02-23T08:34:03.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj42 testdata.889699 2026-02-23T08:34:03.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj43 testdata.889699 2026-02-23T08:34:03.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj44 testdata.889699 2026-02-23T08:34:03.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj45 testdata.889699 2026-02-23T08:34:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj46 testdata.889699 2026-02-23T08:34:03.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj47 testdata.889699 2026-02-23T08:34:03.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj48 testdata.889699 2026-02-23T08:34:03.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj49 testdata.889699 2026-02-23T08:34:03.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj50 testdata.889699 2026-02-23T08:34:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj51 testdata.889699 2026-02-23T08:34:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.442 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj52 testdata.889699 2026-02-23T08:34:03.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj53 testdata.889699 2026-02-23T08:34:03.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj54 testdata.889699 2026-02-23T08:34:03.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj55 testdata.889699 2026-02-23T08:34:03.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj56 testdata.889699 2026-02-23T08:34:03.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj57 testdata.889699 2026-02-23T08:34:03.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj58 testdata.889699 2026-02-23T08:34:03.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj59 testdata.889699 2026-02-23T08:34:03.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj60 testdata.889699 2026-02-23T08:34:03.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj61 testdata.889699 2026-02-23T08:34:03.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj62 testdata.889699 2026-02-23T08:34:03.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj63 testdata.889699 2026-02-23T08:34:03.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj64 testdata.889699 2026-02-23T08:34:03.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.629 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj65 testdata.889699 2026-02-23T08:34:03.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj66 testdata.889699 2026-02-23T08:34:03.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj67 testdata.889699 2026-02-23T08:34:03.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj68 testdata.889699 2026-02-23T08:34:03.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj69 testdata.889699 2026-02-23T08:34:03.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj70 testdata.889699 2026-02-23T08:34:03.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj71 testdata.889699 2026-02-23T08:34:03.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj72 testdata.889699 2026-02-23T08:34:03.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj73 testdata.889699 2026-02-23T08:34:03.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj74 testdata.889699 2026-02-23T08:34:03.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj75 testdata.889699 2026-02-23T08:34:03.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.790 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj76 testdata.889699 2026-02-23T08:34:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj77 testdata.889699 2026-02-23T08:34:03.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj78 testdata.889699 2026-02-23T08:34:03.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj79 testdata.889699 2026-02-23T08:34:03.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj80 testdata.889699 2026-02-23T08:34:03.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj81 testdata.889699 2026-02-23T08:34:03.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj82 testdata.889699 2026-02-23T08:34:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj83 testdata.889699 2026-02-23T08:34:03.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj84 testdata.889699 2026-02-23T08:34:03.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj85 testdata.889699 2026-02-23T08:34:03.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj86 testdata.889699 2026-02-23T08:34:03.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj87 testdata.889699 2026-02-23T08:34:03.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj88 testdata.889699 2026-02-23T08:34:03.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj89 testdata.889699 2026-02-23T08:34:03.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:03.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj90 testdata.889699 2026-02-23T08:34:04.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj91 testdata.889699 2026-02-23T08:34:04.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj92 testdata.889699 2026-02-23T08:34:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj93 testdata.889699 2026-02-23T08:34:04.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj94 testdata.889699 2026-02-23T08:34:04.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj95 testdata.889699 2026-02-23T08:34:04.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj96 testdata.889699 2026-02-23T08:34:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj97 testdata.889699 2026-02-23T08:34:04.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj98 testdata.889699 2026-02-23T08:34:04.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj99 testdata.889699 2026-02-23T08:34:04.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj100 testdata.889699 2026-02-23T08:34:04.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj101 testdata.889699 2026-02-23T08:34:04.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj102 testdata.889699 2026-02-23T08:34:04.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj103 testdata.889699 2026-02-23T08:34:04.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj104 testdata.889699 2026-02-23T08:34:04.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj105 testdata.889699 2026-02-23T08:34:04.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj106 testdata.889699 2026-02-23T08:34:04.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj107 testdata.889699 2026-02-23T08:34:04.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj108 testdata.889699 2026-02-23T08:34:04.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj109 testdata.889699 2026-02-23T08:34:04.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj110 testdata.889699 2026-02-23T08:34:04.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj111 testdata.889699 2026-02-23T08:34:04.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj112 testdata.889699 2026-02-23T08:34:04.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj113 testdata.889699 2026-02-23T08:34:04.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj114 testdata.889699 2026-02-23T08:34:04.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj115 testdata.889699 2026-02-23T08:34:04.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj116 testdata.889699 2026-02-23T08:34:04.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj117 testdata.889699 2026-02-23T08:34:04.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj118 testdata.889699 2026-02-23T08:34:04.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj119 testdata.889699 2026-02-23T08:34:04.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj120 testdata.889699 2026-02-23T08:34:04.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj121 testdata.889699 2026-02-23T08:34:04.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj122 testdata.889699 2026-02-23T08:34:04.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj123 testdata.889699 2026-02-23T08:34:04.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj124 testdata.889699 2026-02-23T08:34:04.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj125 testdata.889699 2026-02-23T08:34:04.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj126 testdata.889699 2026-02-23T08:34:04.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj127 testdata.889699 2026-02-23T08:34:04.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj128 testdata.889699 2026-02-23T08:34:04.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj129 testdata.889699 2026-02-23T08:34:04.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj130 testdata.889699 2026-02-23T08:34:04.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj131 testdata.889699 2026-02-23T08:34:04.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj132 testdata.889699 2026-02-23T08:34:04.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj133 testdata.889699 2026-02-23T08:34:04.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj134 testdata.889699 2026-02-23T08:34:04.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj135 testdata.889699 2026-02-23T08:34:04.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj136 testdata.889699 2026-02-23T08:34:04.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.678 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj137 testdata.889699 2026-02-23T08:34:04.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj138 testdata.889699 2026-02-23T08:34:04.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj139 testdata.889699 2026-02-23T08:34:04.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj140 testdata.889699 2026-02-23T08:34:04.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj141 testdata.889699 2026-02-23T08:34:04.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj142 testdata.889699 2026-02-23T08:34:04.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj143 testdata.889699 2026-02-23T08:34:04.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.782 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj144 testdata.889699 2026-02-23T08:34:04.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj145 testdata.889699 2026-02-23T08:34:04.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj146 testdata.889699 2026-02-23T08:34:04.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj147 testdata.889699 2026-02-23T08:34:04.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj148 testdata.889699 2026-02-23T08:34:04.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj149 testdata.889699 2026-02-23T08:34:04.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj150 testdata.889699 2026-02-23T08:34:04.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj151 testdata.889699 2026-02-23T08:34:04.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj152 testdata.889699 2026-02-23T08:34:04.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj153 testdata.889699 2026-02-23T08:34:04.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj154 testdata.889699 2026-02-23T08:34:04.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj155 testdata.889699 2026-02-23T08:34:04.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj156 testdata.889699 2026-02-23T08:34:04.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj157 testdata.889699 2026-02-23T08:34:04.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:04.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj158 testdata.889699 2026-02-23T08:34:05.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.001 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj159 testdata.889699 2026-02-23T08:34:05.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj160 testdata.889699 2026-02-23T08:34:05.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj161 testdata.889699 2026-02-23T08:34:05.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj162 testdata.889699 2026-02-23T08:34:05.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.058 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj163 testdata.889699 2026-02-23T08:34:05.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj164 testdata.889699 2026-02-23T08:34:05.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj165 testdata.889699 2026-02-23T08:34:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj166 testdata.889699 2026-02-23T08:34:05.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj167 testdata.889699 2026-02-23T08:34:05.130 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj168 testdata.889699 2026-02-23T08:34:05.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj169 testdata.889699 2026-02-23T08:34:05.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj170 testdata.889699 2026-02-23T08:34:05.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj171 testdata.889699 2026-02-23T08:34:05.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj172 testdata.889699 2026-02-23T08:34:05.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj173 testdata.889699 2026-02-23T08:34:05.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj174 testdata.889699 2026-02-23T08:34:05.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj175 testdata.889699 2026-02-23T08:34:05.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj176 testdata.889699 2026-02-23T08:34:05.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj177 testdata.889699 2026-02-23T08:34:05.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj178 testdata.889699 2026-02-23T08:34:05.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj179 testdata.889699 2026-02-23T08:34:05.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj180 testdata.889699 2026-02-23T08:34:05.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.321 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj181 testdata.889699 2026-02-23T08:34:05.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.336 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj182 testdata.889699 2026-02-23T08:34:05.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj183 testdata.889699 2026-02-23T08:34:05.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj184 testdata.889699 2026-02-23T08:34:05.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj185 testdata.889699 2026-02-23T08:34:05.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj186 testdata.889699 2026-02-23T08:34:05.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj187 testdata.889699 2026-02-23T08:34:05.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj188 testdata.889699 2026-02-23T08:34:05.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj189 testdata.889699 2026-02-23T08:34:05.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj190 testdata.889699 2026-02-23T08:34:05.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj191 testdata.889699 2026-02-23T08:34:05.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj192 testdata.889699 2026-02-23T08:34:05.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.500 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj193 testdata.889699 2026-02-23T08:34:05.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj194 testdata.889699 2026-02-23T08:34:05.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj195 testdata.889699 2026-02-23T08:34:05.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj196 testdata.889699 2026-02-23T08:34:05.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj197 testdata.889699 2026-02-23T08:34:05.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj198 testdata.889699 2026-02-23T08:34:05.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj199 testdata.889699 2026-02-23T08:34:05.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj200 testdata.889699 2026-02-23T08:34:05.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj201 testdata.889699 2026-02-23T08:34:05.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj202 testdata.889699 2026-02-23T08:34:05.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj203 testdata.889699 2026-02-23T08:34:05.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj204 testdata.889699 2026-02-23T08:34:05.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj205 testdata.889699 2026-02-23T08:34:05.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj206 testdata.889699 2026-02-23T08:34:05.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj207 testdata.889699 2026-02-23T08:34:05.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj208 testdata.889699 2026-02-23T08:34:05.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj209 testdata.889699 2026-02-23T08:34:05.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj210 testdata.889699 2026-02-23T08:34:05.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj211 testdata.889699 2026-02-23T08:34:05.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj212 testdata.889699 2026-02-23T08:34:05.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj213 testdata.889699 2026-02-23T08:34:05.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj214 testdata.889699 2026-02-23T08:34:05.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj215 testdata.889699 2026-02-23T08:34:05.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj216 testdata.889699 2026-02-23T08:34:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj217 testdata.889699 2026-02-23T08:34:05.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj218 testdata.889699 2026-02-23T08:34:05.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj219 testdata.889699 2026-02-23T08:34:05.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj220 testdata.889699 2026-02-23T08:34:05.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj221 testdata.889699 2026-02-23T08:34:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj222 testdata.889699 2026-02-23T08:34:05.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.939 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj223 testdata.889699 2026-02-23T08:34:05.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj224 testdata.889699 2026-02-23T08:34:05.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj225 testdata.889699 2026-02-23T08:34:05.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj226 testdata.889699 2026-02-23T08:34:05.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:05.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj227 testdata.889699 2026-02-23T08:34:06.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj228 testdata.889699 2026-02-23T08:34:06.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj229 testdata.889699 2026-02-23T08:34:06.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj230 testdata.889699 2026-02-23T08:34:06.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj231 testdata.889699 2026-02-23T08:34:06.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj232 testdata.889699 2026-02-23T08:34:06.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj233 testdata.889699 2026-02-23T08:34:06.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj234 testdata.889699 2026-02-23T08:34:06.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj235 testdata.889699 2026-02-23T08:34:06.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj236 testdata.889699 2026-02-23T08:34:06.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj237 testdata.889699 2026-02-23T08:34:06.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj238 testdata.889699 2026-02-23T08:34:06.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj239 testdata.889699 2026-02-23T08:34:06.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj240 testdata.889699 2026-02-23T08:34:06.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj241 testdata.889699 2026-02-23T08:34:06.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj242 testdata.889699 2026-02-23T08:34:06.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj243 testdata.889699 2026-02-23T08:34:06.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj244 testdata.889699 2026-02-23T08:34:06.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj245 testdata.889699 2026-02-23T08:34:06.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj246 testdata.889699 2026-02-23T08:34:06.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj247 testdata.889699 2026-02-23T08:34:06.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj248 testdata.889699 2026-02-23T08:34:06.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj249 testdata.889699 2026-02-23T08:34:06.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj250 testdata.889699 2026-02-23T08:34:06.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj251 testdata.889699 2026-02-23T08:34:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.365 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj252 testdata.889699 2026-02-23T08:34:06.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj253 testdata.889699 2026-02-23T08:34:06.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj254 testdata.889699 2026-02-23T08:34:06.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj255 testdata.889699 2026-02-23T08:34:06.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj256 testdata.889699 2026-02-23T08:34:06.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj257 testdata.889699 2026-02-23T08:34:06.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj258 testdata.889699 2026-02-23T08:34:06.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.469 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj259 testdata.889699 2026-02-23T08:34:06.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj260 testdata.889699 2026-02-23T08:34:06.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj261 testdata.889699 2026-02-23T08:34:06.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj262 testdata.889699 2026-02-23T08:34:06.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj263 testdata.889699 2026-02-23T08:34:06.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj264 testdata.889699 2026-02-23T08:34:06.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj265 testdata.889699 2026-02-23T08:34:06.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj266 testdata.889699 2026-02-23T08:34:06.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj267 testdata.889699 2026-02-23T08:34:06.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj268 testdata.889699 2026-02-23T08:34:06.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.617 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj269 testdata.889699 2026-02-23T08:34:06.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.632 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj270 testdata.889699 2026-02-23T08:34:06.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj271 testdata.889699 2026-02-23T08:34:06.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj272 testdata.889699 2026-02-23T08:34:06.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj273 testdata.889699 2026-02-23T08:34:06.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.689 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj274 testdata.889699 2026-02-23T08:34:06.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj275 testdata.889699 2026-02-23T08:34:06.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj276 testdata.889699 2026-02-23T08:34:06.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj277 testdata.889699 2026-02-23T08:34:06.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj278 testdata.889699 2026-02-23T08:34:06.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj279 testdata.889699 2026-02-23T08:34:06.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj280 testdata.889699 2026-02-23T08:34:06.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj281 testdata.889699 2026-02-23T08:34:06.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj282 testdata.889699 2026-02-23T08:34:06.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj283 testdata.889699 2026-02-23T08:34:06.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj284 testdata.889699 2026-02-23T08:34:06.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj285 testdata.889699 2026-02-23T08:34:06.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj286 testdata.889699 2026-02-23T08:34:06.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj287 testdata.889699 2026-02-23T08:34:06.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.897 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj288 testdata.889699 2026-02-23T08:34:06.911 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.912 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj289 testdata.889699 2026-02-23T08:34:06.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj290 testdata.889699 2026-02-23T08:34:06.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj291 testdata.889699 2026-02-23T08:34:06.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.957 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj292 testdata.889699 2026-02-23T08:34:06.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj293 testdata.889699 2026-02-23T08:34:06.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:06.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj294 testdata.889699 2026-02-23T08:34:07.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj295 testdata.889699 2026-02-23T08:34:07.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj296 testdata.889699 2026-02-23T08:34:07.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj297 testdata.889699 2026-02-23T08:34:07.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj298 testdata.889699 2026-02-23T08:34:07.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj299 testdata.889699 2026-02-23T08:34:07.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj300 testdata.889699 2026-02-23T08:34:07.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj301 testdata.889699 2026-02-23T08:34:07.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj302 testdata.889699 2026-02-23T08:34:07.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj303 testdata.889699 2026-02-23T08:34:07.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj304 testdata.889699 2026-02-23T08:34:07.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj305 testdata.889699 2026-02-23T08:34:07.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj306 testdata.889699 2026-02-23T08:34:07.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj307 testdata.889699 2026-02-23T08:34:07.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj308 testdata.889699 2026-02-23T08:34:07.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj309 testdata.889699 2026-02-23T08:34:07.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj310 testdata.889699 2026-02-23T08:34:07.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj311 testdata.889699 2026-02-23T08:34:07.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj312 testdata.889699 2026-02-23T08:34:07.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj313 testdata.889699 2026-02-23T08:34:07.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj314 testdata.889699 2026-02-23T08:34:07.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj315 testdata.889699 2026-02-23T08:34:07.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj316 testdata.889699 2026-02-23T08:34:07.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj317 testdata.889699 2026-02-23T08:34:07.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj318 testdata.889699 2026-02-23T08:34:07.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.358 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj319 testdata.889699 2026-02-23T08:34:07.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj320 testdata.889699 2026-02-23T08:34:07.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj321 testdata.889699 2026-02-23T08:34:07.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj322 testdata.889699 2026-02-23T08:34:07.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj323 testdata.889699 2026-02-23T08:34:07.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj324 testdata.889699 2026-02-23T08:34:07.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj325 testdata.889699 2026-02-23T08:34:07.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj326 testdata.889699 2026-02-23T08:34:07.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj327 testdata.889699 2026-02-23T08:34:07.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj328 testdata.889699 2026-02-23T08:34:07.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj329 testdata.889699 2026-02-23T08:34:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj330 testdata.889699 2026-02-23T08:34:07.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj331 testdata.889699 2026-02-23T08:34:07.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj332 testdata.889699 2026-02-23T08:34:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj333 testdata.889699 2026-02-23T08:34:07.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj334 testdata.889699 2026-02-23T08:34:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj335 testdata.889699 2026-02-23T08:34:07.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj336 testdata.889699 2026-02-23T08:34:07.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj337 testdata.889699 2026-02-23T08:34:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj338 testdata.889699 2026-02-23T08:34:07.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj339 testdata.889699 2026-02-23T08:34:07.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj340 testdata.889699 2026-02-23T08:34:07.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj341 testdata.889699 2026-02-23T08:34:07.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj342 testdata.889699 2026-02-23T08:34:07.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj343 testdata.889699 2026-02-23T08:34:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj344 testdata.889699 2026-02-23T08:34:07.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj345 testdata.889699 2026-02-23T08:34:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj346 testdata.889699 2026-02-23T08:34:07.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj347 testdata.889699 2026-02-23T08:34:07.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.788 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj348 testdata.889699 2026-02-23T08:34:07.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj349 testdata.889699 2026-02-23T08:34:07.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj350 testdata.889699 2026-02-23T08:34:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj351 testdata.889699 2026-02-23T08:34:07.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj352 testdata.889699 2026-02-23T08:34:07.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj353 testdata.889699 2026-02-23T08:34:07.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj354 testdata.889699 2026-02-23T08:34:07.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj355 testdata.889699 2026-02-23T08:34:07.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj356 testdata.889699 2026-02-23T08:34:07.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj357 testdata.889699 2026-02-23T08:34:07.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj358 testdata.889699 2026-02-23T08:34:07.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj359 testdata.889699 2026-02-23T08:34:07.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj360 testdata.889699 2026-02-23T08:34:07.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj361 testdata.889699 2026-02-23T08:34:07.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:07.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj362 testdata.889699 2026-02-23T08:34:08.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj363 testdata.889699 2026-02-23T08:34:08.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj364 testdata.889699 2026-02-23T08:34:08.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj365 testdata.889699 2026-02-23T08:34:08.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj366 testdata.889699 2026-02-23T08:34:08.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj367 testdata.889699 2026-02-23T08:34:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj368 testdata.889699 2026-02-23T08:34:08.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj369 testdata.889699 2026-02-23T08:34:08.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj370 testdata.889699 2026-02-23T08:34:08.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj371 testdata.889699 2026-02-23T08:34:08.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj372 testdata.889699 2026-02-23T08:34:08.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj373 testdata.889699 2026-02-23T08:34:08.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj374 testdata.889699 2026-02-23T08:34:08.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj375 testdata.889699 2026-02-23T08:34:08.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj376 testdata.889699 2026-02-23T08:34:08.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj377 testdata.889699 2026-02-23T08:34:08.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj378 testdata.889699 2026-02-23T08:34:08.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.245 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj379 testdata.889699 2026-02-23T08:34:08.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj380 testdata.889699 2026-02-23T08:34:08.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.275 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj381 testdata.889699 2026-02-23T08:34:08.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj382 testdata.889699 2026-02-23T08:34:08.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj383 testdata.889699 2026-02-23T08:34:08.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj384 testdata.889699 2026-02-23T08:34:08.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj385 testdata.889699 2026-02-23T08:34:08.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj386 testdata.889699 2026-02-23T08:34:08.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj387 testdata.889699 2026-02-23T08:34:08.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj388 testdata.889699 2026-02-23T08:34:08.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj389 testdata.889699 2026-02-23T08:34:08.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj390 testdata.889699 2026-02-23T08:34:08.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj391 testdata.889699 2026-02-23T08:34:08.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj392 testdata.889699 2026-02-23T08:34:08.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj393 testdata.889699 2026-02-23T08:34:08.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj394 testdata.889699 2026-02-23T08:34:08.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj395 testdata.889699 2026-02-23T08:34:08.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj396 testdata.889699 2026-02-23T08:34:08.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj397 testdata.889699 2026-02-23T08:34:08.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj398 testdata.889699 2026-02-23T08:34:08.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj399 testdata.889699 2026-02-23T08:34:08.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj400 testdata.889699 2026-02-23T08:34:08.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj401 testdata.889699 2026-02-23T08:34:08.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj402 testdata.889699 2026-02-23T08:34:08.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj403 testdata.889699 2026-02-23T08:34:08.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj404 testdata.889699 2026-02-23T08:34:08.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj405 testdata.889699 2026-02-23T08:34:08.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj406 testdata.889699 2026-02-23T08:34:08.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj407 testdata.889699 2026-02-23T08:34:08.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj408 testdata.889699 2026-02-23T08:34:08.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj409 testdata.889699 2026-02-23T08:34:08.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj410 testdata.889699 2026-02-23T08:34:08.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj411 testdata.889699 2026-02-23T08:34:08.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj412 testdata.889699 2026-02-23T08:34:08.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj413 testdata.889699 2026-02-23T08:34:08.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj414 testdata.889699 2026-02-23T08:34:08.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj415 testdata.889699 2026-02-23T08:34:08.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj416 testdata.889699 2026-02-23T08:34:08.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj417 testdata.889699 2026-02-23T08:34:08.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj418 testdata.889699 2026-02-23T08:34:08.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj419 testdata.889699 2026-02-23T08:34:08.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj420 testdata.889699 2026-02-23T08:34:08.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj421 testdata.889699 2026-02-23T08:34:08.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj422 testdata.889699 2026-02-23T08:34:08.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj423 testdata.889699 2026-02-23T08:34:08.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj424 testdata.889699 2026-02-23T08:34:08.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj425 testdata.889699 2026-02-23T08:34:08.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj426 testdata.889699 2026-02-23T08:34:08.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj427 testdata.889699 2026-02-23T08:34:08.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj428 testdata.889699 2026-02-23T08:34:08.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj429 testdata.889699 2026-02-23T08:34:08.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:08.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj430 testdata.889699 2026-02-23T08:34:09.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj431 testdata.889699 2026-02-23T08:34:09.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj432 testdata.889699 2026-02-23T08:34:09.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj433 testdata.889699 2026-02-23T08:34:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj434 testdata.889699 2026-02-23T08:34:09.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj435 testdata.889699 2026-02-23T08:34:09.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj436 testdata.889699 2026-02-23T08:34:09.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.099 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj437 testdata.889699 2026-02-23T08:34:09.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.114 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj438 testdata.889699 2026-02-23T08:34:09.128 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj439 testdata.889699 2026-02-23T08:34:09.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj440 testdata.889699 2026-02-23T08:34:09.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj441 testdata.889699 2026-02-23T08:34:09.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj442 testdata.889699 2026-02-23T08:34:09.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj443 testdata.889699 2026-02-23T08:34:09.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj444 testdata.889699 2026-02-23T08:34:09.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj445 testdata.889699 2026-02-23T08:34:09.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj446 testdata.889699 2026-02-23T08:34:09.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.246 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj447 testdata.889699 2026-02-23T08:34:09.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj448 testdata.889699 2026-02-23T08:34:09.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.276 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj449 testdata.889699 2026-02-23T08:34:09.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj450 testdata.889699 2026-02-23T08:34:09.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj451 testdata.889699 2026-02-23T08:34:09.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj452 testdata.889699 2026-02-23T08:34:09.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj453 testdata.889699 2026-02-23T08:34:09.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj454 testdata.889699 2026-02-23T08:34:09.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj455 testdata.889699 2026-02-23T08:34:09.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj456 testdata.889699 2026-02-23T08:34:09.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj457 testdata.889699 2026-02-23T08:34:09.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj458 testdata.889699 2026-02-23T08:34:09.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj459 testdata.889699 2026-02-23T08:34:09.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj460 testdata.889699 2026-02-23T08:34:09.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj461 testdata.889699 2026-02-23T08:34:09.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.466 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj462 testdata.889699 2026-02-23T08:34:09.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj463 testdata.889699 2026-02-23T08:34:09.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj464 testdata.889699 2026-02-23T08:34:09.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj465 testdata.889699 2026-02-23T08:34:09.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj466 testdata.889699 2026-02-23T08:34:09.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj467 testdata.889699 2026-02-23T08:34:09.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj468 testdata.889699 2026-02-23T08:34:09.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj469 testdata.889699 2026-02-23T08:34:09.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj470 testdata.889699 2026-02-23T08:34:09.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj471 testdata.889699 2026-02-23T08:34:09.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj472 testdata.889699 2026-02-23T08:34:09.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj473 testdata.889699 2026-02-23T08:34:09.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj474 testdata.889699 2026-02-23T08:34:09.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj475 testdata.889699 2026-02-23T08:34:09.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj476 testdata.889699 2026-02-23T08:34:09.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj477 testdata.889699 2026-02-23T08:34:09.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj478 testdata.889699 2026-02-23T08:34:09.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj479 testdata.889699 2026-02-23T08:34:09.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.728 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj480 testdata.889699 2026-02-23T08:34:09.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj481 testdata.889699 2026-02-23T08:34:09.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj482 testdata.889699 2026-02-23T08:34:09.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj483 testdata.889699 2026-02-23T08:34:09.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj484 testdata.889699 2026-02-23T08:34:09.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj485 testdata.889699 2026-02-23T08:34:09.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj486 testdata.889699 2026-02-23T08:34:09.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj487 testdata.889699 2026-02-23T08:34:09.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj488 testdata.889699 2026-02-23T08:34:09.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj489 testdata.889699 2026-02-23T08:34:09.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj490 testdata.889699 2026-02-23T08:34:09.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj491 testdata.889699 2026-02-23T08:34:09.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.903 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj492 testdata.889699 2026-02-23T08:34:09.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj493 testdata.889699 2026-02-23T08:34:09.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj494 testdata.889699 2026-02-23T08:34:09.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj495 testdata.889699 2026-02-23T08:34:09.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj496 testdata.889699 2026-02-23T08:34:09.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj497 testdata.889699 2026-02-23T08:34:09.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:09.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj498 testdata.889699 2026-02-23T08:34:10.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj499 testdata.889699 2026-02-23T08:34:10.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj500 testdata.889699 2026-02-23T08:34:10.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj501 testdata.889699 2026-02-23T08:34:10.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj502 testdata.889699 2026-02-23T08:34:10.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj503 testdata.889699 2026-02-23T08:34:10.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj504 testdata.889699 2026-02-23T08:34:10.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj505 testdata.889699 2026-02-23T08:34:10.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj506 testdata.889699 2026-02-23T08:34:10.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj507 testdata.889699 2026-02-23T08:34:10.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj508 testdata.889699 2026-02-23T08:34:10.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj509 testdata.889699 2026-02-23T08:34:10.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.171 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj510 testdata.889699 2026-02-23T08:34:10.186 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.187 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj511 testdata.889699 2026-02-23T08:34:10.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj512 testdata.889699 2026-02-23T08:34:10.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj513 testdata.889699 2026-02-23T08:34:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj514 testdata.889699 2026-02-23T08:34:10.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.244 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj515 testdata.889699 2026-02-23T08:34:10.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj516 testdata.889699 2026-02-23T08:34:10.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj517 testdata.889699 2026-02-23T08:34:10.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj518 testdata.889699 2026-02-23T08:34:10.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj519 testdata.889699 2026-02-23T08:34:10.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj520 testdata.889699 2026-02-23T08:34:10.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj521 testdata.889699 2026-02-23T08:34:10.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj522 testdata.889699 2026-02-23T08:34:10.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj523 testdata.889699 2026-02-23T08:34:10.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj524 testdata.889699 2026-02-23T08:34:10.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj525 testdata.889699 2026-02-23T08:34:10.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj526 testdata.889699 2026-02-23T08:34:10.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj527 testdata.889699 2026-02-23T08:34:10.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj528 testdata.889699 2026-02-23T08:34:10.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj529 testdata.889699 2026-02-23T08:34:10.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj530 testdata.889699 2026-02-23T08:34:10.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj531 testdata.889699 2026-02-23T08:34:10.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj532 testdata.889699 2026-02-23T08:34:10.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj533 testdata.889699 2026-02-23T08:34:10.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj534 testdata.889699 2026-02-23T08:34:10.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj535 testdata.889699 2026-02-23T08:34:10.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj536 testdata.889699 2026-02-23T08:34:10.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj537 testdata.889699 2026-02-23T08:34:10.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj538 testdata.889699 2026-02-23T08:34:10.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj539 testdata.889699 2026-02-23T08:34:10.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj540 testdata.889699 2026-02-23T08:34:10.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj541 testdata.889699 2026-02-23T08:34:10.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj542 testdata.889699 2026-02-23T08:34:10.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj543 testdata.889699 2026-02-23T08:34:10.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj544 testdata.889699 2026-02-23T08:34:10.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj545 testdata.889699 2026-02-23T08:34:10.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj546 testdata.889699 2026-02-23T08:34:10.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj547 testdata.889699 2026-02-23T08:34:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj548 testdata.889699 2026-02-23T08:34:10.740 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj549 testdata.889699 2026-02-23T08:34:10.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj550 testdata.889699 2026-02-23T08:34:10.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj551 testdata.889699 2026-02-23T08:34:10.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj552 testdata.889699 2026-02-23T08:34:10.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj553 testdata.889699 2026-02-23T08:34:10.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj554 testdata.889699 2026-02-23T08:34:10.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj555 testdata.889699 2026-02-23T08:34:10.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj556 testdata.889699 2026-02-23T08:34:10.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj557 testdata.889699 2026-02-23T08:34:10.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj558 testdata.889699 2026-02-23T08:34:10.890 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj559 testdata.889699 2026-02-23T08:34:10.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.904 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj560 testdata.889699 2026-02-23T08:34:10.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj561 testdata.889699 2026-02-23T08:34:10.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj562 testdata.889699 2026-02-23T08:34:10.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj563 testdata.889699 2026-02-23T08:34:10.963 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj564 testdata.889699 2026-02-23T08:34:10.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj565 testdata.889699 2026-02-23T08:34:10.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:10.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj566 testdata.889699 2026-02-23T08:34:11.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.006 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj567 testdata.889699 2026-02-23T08:34:11.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj568 testdata.889699 2026-02-23T08:34:11.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj569 testdata.889699 2026-02-23T08:34:11.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj570 testdata.889699 2026-02-23T08:34:11.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj571 testdata.889699 2026-02-23T08:34:11.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj572 testdata.889699 2026-02-23T08:34:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj573 testdata.889699 2026-02-23T08:34:11.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj574 testdata.889699 2026-02-23T08:34:11.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj575 testdata.889699 2026-02-23T08:34:11.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj576 testdata.889699 2026-02-23T08:34:11.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj577 testdata.889699 2026-02-23T08:34:11.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj578 testdata.889699 2026-02-23T08:34:11.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj579 testdata.889699 2026-02-23T08:34:11.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj580 testdata.889699 2026-02-23T08:34:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj581 testdata.889699 2026-02-23T08:34:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj582 testdata.889699 2026-02-23T08:34:11.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj583 testdata.889699 2026-02-23T08:34:11.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj584 testdata.889699 2026-02-23T08:34:11.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj585 testdata.889699 2026-02-23T08:34:11.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj586 testdata.889699 2026-02-23T08:34:11.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj587 testdata.889699 2026-02-23T08:34:11.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj588 testdata.889699 2026-02-23T08:34:11.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj589 testdata.889699 2026-02-23T08:34:11.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj590 testdata.889699 2026-02-23T08:34:11.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.357 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj591 testdata.889699 2026-02-23T08:34:11.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj592 testdata.889699 2026-02-23T08:34:11.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj593 testdata.889699 2026-02-23T08:34:11.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj594 testdata.889699 2026-02-23T08:34:11.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj595 testdata.889699 2026-02-23T08:34:11.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj596 testdata.889699 2026-02-23T08:34:11.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.446 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj597 testdata.889699 2026-02-23T08:34:11.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj598 testdata.889699 2026-02-23T08:34:11.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj599 testdata.889699 2026-02-23T08:34:11.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj600 testdata.889699 2026-02-23T08:34:11.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj601 testdata.889699 2026-02-23T08:34:11.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj602 testdata.889699 2026-02-23T08:34:11.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj603 testdata.889699 2026-02-23T08:34:11.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj604 testdata.889699 2026-02-23T08:34:11.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj605 testdata.889699 2026-02-23T08:34:11.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj606 testdata.889699 2026-02-23T08:34:11.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj607 testdata.889699 2026-02-23T08:34:11.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj608 testdata.889699 2026-02-23T08:34:11.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj609 testdata.889699 2026-02-23T08:34:11.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj610 testdata.889699 2026-02-23T08:34:11.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj611 testdata.889699 2026-02-23T08:34:11.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj612 testdata.889699 2026-02-23T08:34:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj613 testdata.889699 2026-02-23T08:34:11.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj614 testdata.889699 2026-02-23T08:34:11.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj615 testdata.889699 2026-02-23T08:34:11.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj616 testdata.889699 2026-02-23T08:34:11.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj617 testdata.889699 2026-02-23T08:34:11.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj618 testdata.889699 2026-02-23T08:34:11.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj619 testdata.889699 2026-02-23T08:34:11.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj620 testdata.889699 2026-02-23T08:34:11.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj621 testdata.889699 2026-02-23T08:34:11.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj622 testdata.889699 2026-02-23T08:34:11.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj623 testdata.889699 2026-02-23T08:34:11.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj624 testdata.889699 2026-02-23T08:34:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj625 testdata.889699 2026-02-23T08:34:11.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj626 testdata.889699 2026-02-23T08:34:11.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj627 testdata.889699 2026-02-23T08:34:11.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj628 testdata.889699 2026-02-23T08:34:11.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj629 testdata.889699 2026-02-23T08:34:11.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj630 testdata.889699 2026-02-23T08:34:11.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj631 testdata.889699 2026-02-23T08:34:11.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj632 testdata.889699 2026-02-23T08:34:11.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj633 testdata.889699 2026-02-23T08:34:11.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:11.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj634 testdata.889699 2026-02-23T08:34:12.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj635 testdata.889699 2026-02-23T08:34:12.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj636 testdata.889699 2026-02-23T08:34:12.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj637 testdata.889699 2026-02-23T08:34:12.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj638 testdata.889699 2026-02-23T08:34:12.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj639 testdata.889699 2026-02-23T08:34:12.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj640 testdata.889699 2026-02-23T08:34:12.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj641 testdata.889699 2026-02-23T08:34:12.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj642 testdata.889699 2026-02-23T08:34:12.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.120 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj643 testdata.889699 2026-02-23T08:34:12.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj644 testdata.889699 2026-02-23T08:34:12.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj645 testdata.889699 2026-02-23T08:34:12.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj646 testdata.889699 2026-02-23T08:34:12.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj647 testdata.889699 2026-02-23T08:34:12.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj648 testdata.889699 2026-02-23T08:34:12.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj649 testdata.889699 2026-02-23T08:34:12.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.226 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj650 testdata.889699 2026-02-23T08:34:12.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj651 testdata.889699 2026-02-23T08:34:12.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj652 testdata.889699 2026-02-23T08:34:12.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj653 testdata.889699 2026-02-23T08:34:12.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj654 testdata.889699 2026-02-23T08:34:12.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj655 testdata.889699 2026-02-23T08:34:12.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj656 testdata.889699 2026-02-23T08:34:12.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj657 testdata.889699 2026-02-23T08:34:12.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj658 testdata.889699 2026-02-23T08:34:12.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj659 testdata.889699 2026-02-23T08:34:12.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj660 testdata.889699 2026-02-23T08:34:12.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj661 testdata.889699 2026-02-23T08:34:12.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj662 testdata.889699 2026-02-23T08:34:12.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj663 testdata.889699 2026-02-23T08:34:12.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj664 testdata.889699 2026-02-23T08:34:12.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj665 testdata.889699 2026-02-23T08:34:12.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.465 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj666 testdata.889699 2026-02-23T08:34:12.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj667 testdata.889699 2026-02-23T08:34:12.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj668 testdata.889699 2026-02-23T08:34:12.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj669 testdata.889699 2026-02-23T08:34:12.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj670 testdata.889699 2026-02-23T08:34:12.538 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj671 testdata.889699 2026-02-23T08:34:12.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj672 testdata.889699 2026-02-23T08:34:12.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj673 testdata.889699 2026-02-23T08:34:12.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj674 testdata.889699 2026-02-23T08:34:12.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj675 testdata.889699 2026-02-23T08:34:12.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.612 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj676 testdata.889699 2026-02-23T08:34:12.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj677 testdata.889699 2026-02-23T08:34:12.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj678 testdata.889699 2026-02-23T08:34:12.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj679 testdata.889699 2026-02-23T08:34:12.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj680 testdata.889699 2026-02-23T08:34:12.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj681 testdata.889699 2026-02-23T08:34:12.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj682 testdata.889699 2026-02-23T08:34:12.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj683 testdata.889699 2026-02-23T08:34:12.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj684 testdata.889699 2026-02-23T08:34:12.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj685 testdata.889699 2026-02-23T08:34:12.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj686 testdata.889699 2026-02-23T08:34:12.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj687 testdata.889699 2026-02-23T08:34:12.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj688 testdata.889699 2026-02-23T08:34:12.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj689 testdata.889699 2026-02-23T08:34:12.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj690 testdata.889699 2026-02-23T08:34:12.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj691 testdata.889699 2026-02-23T08:34:12.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj692 testdata.889699 2026-02-23T08:34:12.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj693 testdata.889699 2026-02-23T08:34:12.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj694 testdata.889699 2026-02-23T08:34:12.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj695 testdata.889699 2026-02-23T08:34:12.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj696 testdata.889699 2026-02-23T08:34:12.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj697 testdata.889699 2026-02-23T08:34:12.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj698 testdata.889699 2026-02-23T08:34:12.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.951 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj699 testdata.889699 2026-02-23T08:34:12.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj700 testdata.889699 2026-02-23T08:34:12.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj701 testdata.889699 2026-02-23T08:34:12.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:12.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj702 testdata.889699 2026-02-23T08:34:13.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj703 testdata.889699 2026-02-23T08:34:13.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj704 testdata.889699 2026-02-23T08:34:13.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj705 testdata.889699 2026-02-23T08:34:13.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj706 testdata.889699 2026-02-23T08:34:13.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.069 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj707 testdata.889699 2026-02-23T08:34:13.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj708 testdata.889699 2026-02-23T08:34:13.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.097 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj709 testdata.889699 2026-02-23T08:34:13.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj710 testdata.889699 2026-02-23T08:34:13.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj711 testdata.889699 2026-02-23T08:34:13.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj712 testdata.889699 2026-02-23T08:34:13.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj713 testdata.889699 2026-02-23T08:34:13.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj714 testdata.889699 2026-02-23T08:34:13.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj715 testdata.889699 2026-02-23T08:34:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj716 testdata.889699 2026-02-23T08:34:13.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj717 testdata.889699 2026-02-23T08:34:13.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj718 testdata.889699 2026-02-23T08:34:13.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.243 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj719 testdata.889699 2026-02-23T08:34:13.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj720 testdata.889699 2026-02-23T08:34:13.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj721 testdata.889699 2026-02-23T08:34:13.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.289 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj722 testdata.889699 2026-02-23T08:34:13.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj723 testdata.889699 2026-02-23T08:34:13.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj724 testdata.889699 2026-02-23T08:34:13.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj725 testdata.889699 2026-02-23T08:34:13.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj726 testdata.889699 2026-02-23T08:34:13.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj727 testdata.889699 2026-02-23T08:34:13.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj728 testdata.889699 2026-02-23T08:34:13.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj729 testdata.889699 2026-02-23T08:34:13.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj730 testdata.889699 2026-02-23T08:34:13.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj731 testdata.889699 2026-02-23T08:34:13.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj732 testdata.889699 2026-02-23T08:34:13.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj733 testdata.889699 2026-02-23T08:34:13.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj734 testdata.889699 2026-02-23T08:34:13.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj735 testdata.889699 2026-02-23T08:34:13.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj736 testdata.889699 2026-02-23T08:34:13.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj737 testdata.889699 2026-02-23T08:34:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj738 testdata.889699 2026-02-23T08:34:13.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj739 testdata.889699 2026-02-23T08:34:13.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj740 testdata.889699 2026-02-23T08:34:13.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj741 testdata.889699 2026-02-23T08:34:13.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj742 testdata.889699 2026-02-23T08:34:13.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.597 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj743 testdata.889699 2026-02-23T08:34:13.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj744 testdata.889699 2026-02-23T08:34:13.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.626 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj745 testdata.889699 2026-02-23T08:34:13.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj746 testdata.889699 2026-02-23T08:34:13.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj747 testdata.889699 2026-02-23T08:34:13.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj748 testdata.889699 2026-02-23T08:34:13.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj749 testdata.889699 2026-02-23T08:34:13.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj750 testdata.889699 2026-02-23T08:34:13.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj751 testdata.889699 2026-02-23T08:34:13.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj752 testdata.889699 2026-02-23T08:34:13.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj753 testdata.889699 2026-02-23T08:34:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj754 testdata.889699 2026-02-23T08:34:13.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj755 testdata.889699 2026-02-23T08:34:13.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.789 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj756 testdata.889699 2026-02-23T08:34:13.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj757 testdata.889699 2026-02-23T08:34:13.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj758 testdata.889699 2026-02-23T08:34:13.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj759 testdata.889699 2026-02-23T08:34:13.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj760 testdata.889699 2026-02-23T08:34:13.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj761 testdata.889699 2026-02-23T08:34:13.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj762 testdata.889699 2026-02-23T08:34:13.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.892 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj763 testdata.889699 2026-02-23T08:34:13.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj764 testdata.889699 2026-02-23T08:34:13.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj765 testdata.889699 2026-02-23T08:34:13.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.937 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj766 testdata.889699 2026-02-23T08:34:13.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj767 testdata.889699 2026-02-23T08:34:13.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj768 testdata.889699 2026-02-23T08:34:13.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj769 testdata.889699 2026-02-23T08:34:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj770 testdata.889699 2026-02-23T08:34:14.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj771 testdata.889699 2026-02-23T08:34:14.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj772 testdata.889699 2026-02-23T08:34:14.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj773 testdata.889699 2026-02-23T08:34:14.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj774 testdata.889699 2026-02-23T08:34:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj775 testdata.889699 2026-02-23T08:34:14.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj776 testdata.889699 2026-02-23T08:34:14.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj777 testdata.889699 2026-02-23T08:34:14.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj778 testdata.889699 2026-02-23T08:34:14.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.131 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj779 testdata.889699 2026-02-23T08:34:14.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj780 testdata.889699 2026-02-23T08:34:14.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj781 testdata.889699 2026-02-23T08:34:14.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.178 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj782 testdata.889699 2026-02-23T08:34:14.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj783 testdata.889699 2026-02-23T08:34:14.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj784 testdata.889699 2026-02-23T08:34:14.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.223 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj785 testdata.889699 2026-02-23T08:34:14.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj786 testdata.889699 2026-02-23T08:34:14.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj787 testdata.889699 2026-02-23T08:34:14.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj788 testdata.889699 2026-02-23T08:34:14.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj789 testdata.889699 2026-02-23T08:34:14.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj790 testdata.889699 2026-02-23T08:34:14.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj791 testdata.889699 2026-02-23T08:34:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj792 testdata.889699 2026-02-23T08:34:14.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj793 testdata.889699 2026-02-23T08:34:14.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj794 testdata.889699 2026-02-23T08:34:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj795 testdata.889699 2026-02-23T08:34:14.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj796 testdata.889699 2026-02-23T08:34:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj797 testdata.889699 2026-02-23T08:34:14.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj798 testdata.889699 2026-02-23T08:34:14.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj799 testdata.889699 2026-02-23T08:34:14.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.447 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj800 testdata.889699 2026-02-23T08:34:14.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj801 testdata.889699 2026-02-23T08:34:14.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj802 testdata.889699 2026-02-23T08:34:14.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj803 testdata.889699 2026-02-23T08:34:14.503 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.504 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj804 testdata.889699 2026-02-23T08:34:14.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj805 testdata.889699 2026-02-23T08:34:14.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj806 testdata.889699 2026-02-23T08:34:14.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj807 testdata.889699 2026-02-23T08:34:14.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj808 testdata.889699 2026-02-23T08:34:14.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj809 testdata.889699 2026-02-23T08:34:14.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj810 testdata.889699 2026-02-23T08:34:14.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.605 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj811 testdata.889699 2026-02-23T08:34:14.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj812 testdata.889699 2026-02-23T08:34:14.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj813 testdata.889699 2026-02-23T08:34:14.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj814 testdata.889699 2026-02-23T08:34:14.664 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.665 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj815 testdata.889699 2026-02-23T08:34:14.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj816 testdata.889699 2026-02-23T08:34:14.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj817 testdata.889699 2026-02-23T08:34:14.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj818 testdata.889699 2026-02-23T08:34:14.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj819 testdata.889699 2026-02-23T08:34:14.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.737 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj820 testdata.889699 2026-02-23T08:34:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj821 testdata.889699 2026-02-23T08:34:14.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj822 testdata.889699 2026-02-23T08:34:14.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj823 testdata.889699 2026-02-23T08:34:14.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj824 testdata.889699 2026-02-23T08:34:14.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.812 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj825 testdata.889699 2026-02-23T08:34:14.826 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj826 testdata.889699 2026-02-23T08:34:14.841 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj827 testdata.889699 2026-02-23T08:34:14.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj828 testdata.889699 2026-02-23T08:34:14.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj829 testdata.889699 2026-02-23T08:34:14.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj830 testdata.889699 2026-02-23T08:34:14.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj831 testdata.889699 2026-02-23T08:34:14.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj832 testdata.889699 2026-02-23T08:34:14.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj833 testdata.889699 2026-02-23T08:34:14.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj834 testdata.889699 2026-02-23T08:34:14.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj835 testdata.889699 2026-02-23T08:34:14.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj836 testdata.889699 2026-02-23T08:34:14.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:14.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj837 testdata.889699 2026-02-23T08:34:15.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.005 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj838 testdata.889699 2026-02-23T08:34:15.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj839 testdata.889699 2026-02-23T08:34:15.034 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj840 testdata.889699 2026-02-23T08:34:15.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj841 testdata.889699 2026-02-23T08:34:15.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj842 testdata.889699 2026-02-23T08:34:15.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj843 testdata.889699 2026-02-23T08:34:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj844 testdata.889699 2026-02-23T08:34:15.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj845 testdata.889699 2026-02-23T08:34:15.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj846 testdata.889699 2026-02-23T08:34:15.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj847 testdata.889699 2026-02-23T08:34:15.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.153 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj848 testdata.889699 2026-02-23T08:34:15.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj849 testdata.889699 2026-02-23T08:34:15.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj850 testdata.889699 2026-02-23T08:34:15.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj851 testdata.889699 2026-02-23T08:34:15.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj852 testdata.889699 2026-02-23T08:34:15.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj853 testdata.889699 2026-02-23T08:34:15.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj854 testdata.889699 2026-02-23T08:34:15.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj855 testdata.889699 2026-02-23T08:34:15.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj856 testdata.889699 2026-02-23T08:34:15.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj857 testdata.889699 2026-02-23T08:34:15.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj858 testdata.889699 2026-02-23T08:34:15.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj859 testdata.889699 2026-02-23T08:34:15.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj860 testdata.889699 2026-02-23T08:34:15.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj861 testdata.889699 2026-02-23T08:34:15.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj862 testdata.889699 2026-02-23T08:34:15.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj863 testdata.889699 2026-02-23T08:34:15.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj864 testdata.889699 2026-02-23T08:34:15.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.404 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj865 testdata.889699 2026-02-23T08:34:15.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj866 testdata.889699 2026-02-23T08:34:15.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj867 testdata.889699 2026-02-23T08:34:15.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj868 testdata.889699 2026-02-23T08:34:15.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj869 testdata.889699 2026-02-23T08:34:15.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj870 testdata.889699 2026-02-23T08:34:15.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj871 testdata.889699 2026-02-23T08:34:15.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj872 testdata.889699 2026-02-23T08:34:15.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj873 testdata.889699 2026-02-23T08:34:15.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj874 testdata.889699 2026-02-23T08:34:15.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj875 testdata.889699 2026-02-23T08:34:15.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj876 testdata.889699 2026-02-23T08:34:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj877 testdata.889699 2026-02-23T08:34:15.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj878 testdata.889699 2026-02-23T08:34:15.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj879 testdata.889699 2026-02-23T08:34:15.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj880 testdata.889699 2026-02-23T08:34:15.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj881 testdata.889699 2026-02-23T08:34:15.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj882 testdata.889699 2026-02-23T08:34:15.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj883 testdata.889699 2026-02-23T08:34:15.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj884 testdata.889699 2026-02-23T08:34:15.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj885 testdata.889699 2026-02-23T08:34:15.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj886 testdata.889699 2026-02-23T08:34:15.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj887 testdata.889699 2026-02-23T08:34:15.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.741 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj888 testdata.889699 2026-02-23T08:34:15.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj889 testdata.889699 2026-02-23T08:34:15.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj890 testdata.889699 2026-02-23T08:34:15.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.785 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj891 testdata.889699 2026-02-23T08:34:15.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj892 testdata.889699 2026-02-23T08:34:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj893 testdata.889699 2026-02-23T08:34:15.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj894 testdata.889699 2026-02-23T08:34:15.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj895 testdata.889699 2026-02-23T08:34:15.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj896 testdata.889699 2026-02-23T08:34:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj897 testdata.889699 2026-02-23T08:34:15.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj898 testdata.889699 2026-02-23T08:34:15.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj899 testdata.889699 2026-02-23T08:34:15.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj900 testdata.889699 2026-02-23T08:34:15.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj901 testdata.889699 2026-02-23T08:34:15.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj902 testdata.889699 2026-02-23T08:34:15.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj903 testdata.889699 2026-02-23T08:34:15.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj904 testdata.889699 2026-02-23T08:34:15.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:15.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj905 testdata.889699 2026-02-23T08:34:16.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.002 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj906 testdata.889699 2026-02-23T08:34:16.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj907 testdata.889699 2026-02-23T08:34:16.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj908 testdata.889699 2026-02-23T08:34:16.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj909 testdata.889699 2026-02-23T08:34:16.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.061 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj910 testdata.889699 2026-02-23T08:34:16.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.075 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj911 testdata.889699 2026-02-23T08:34:16.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj912 testdata.889699 2026-02-23T08:34:16.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj913 testdata.889699 2026-02-23T08:34:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.118 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj914 testdata.889699 2026-02-23T08:34:16.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj915 testdata.889699 2026-02-23T08:34:16.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj916 testdata.889699 2026-02-23T08:34:16.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj917 testdata.889699 2026-02-23T08:34:16.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj918 testdata.889699 2026-02-23T08:34:16.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj919 testdata.889699 2026-02-23T08:34:16.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj920 testdata.889699 2026-02-23T08:34:16.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.219 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj921 testdata.889699 2026-02-23T08:34:16.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj922 testdata.889699 2026-02-23T08:34:16.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.248 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj923 testdata.889699 2026-02-23T08:34:16.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj924 testdata.889699 2026-02-23T08:34:16.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.277 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj925 testdata.889699 2026-02-23T08:34:16.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj926 testdata.889699 2026-02-23T08:34:16.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj927 testdata.889699 2026-02-23T08:34:16.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.322 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj928 testdata.889699 2026-02-23T08:34:16.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj929 testdata.889699 2026-02-23T08:34:16.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj930 testdata.889699 2026-02-23T08:34:16.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj931 testdata.889699 2026-02-23T08:34:16.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj932 testdata.889699 2026-02-23T08:34:16.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj933 testdata.889699 2026-02-23T08:34:16.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.408 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj934 testdata.889699 2026-02-23T08:34:16.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj935 testdata.889699 2026-02-23T08:34:16.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj936 testdata.889699 2026-02-23T08:34:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj937 testdata.889699 2026-02-23T08:34:16.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj938 testdata.889699 2026-02-23T08:34:16.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj939 testdata.889699 2026-02-23T08:34:16.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj940 testdata.889699 2026-02-23T08:34:16.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj941 testdata.889699 2026-02-23T08:34:16.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj942 testdata.889699 2026-02-23T08:34:16.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj943 testdata.889699 2026-02-23T08:34:16.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj944 testdata.889699 2026-02-23T08:34:16.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj945 testdata.889699 2026-02-23T08:34:16.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj946 testdata.889699 2026-02-23T08:34:16.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj947 testdata.889699 2026-02-23T08:34:16.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj948 testdata.889699 2026-02-23T08:34:16.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj949 testdata.889699 2026-02-23T08:34:16.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj950 testdata.889699 2026-02-23T08:34:16.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.661 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj951 testdata.889699 2026-02-23T08:34:16.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj952 testdata.889699 2026-02-23T08:34:16.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj953 testdata.889699 2026-02-23T08:34:16.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj954 testdata.889699 2026-02-23T08:34:16.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj955 testdata.889699 2026-02-23T08:34:16.734 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.735 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj956 testdata.889699 2026-02-23T08:34:16.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj957 testdata.889699 2026-02-23T08:34:16.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj958 testdata.889699 2026-02-23T08:34:16.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj959 testdata.889699 2026-02-23T08:34:16.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj960 testdata.889699 2026-02-23T08:34:16.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj961 testdata.889699 2026-02-23T08:34:16.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj962 testdata.889699 2026-02-23T08:34:16.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.840 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj963 testdata.889699 2026-02-23T08:34:16.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj964 testdata.889699 2026-02-23T08:34:16.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj965 testdata.889699 2026-02-23T08:34:16.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj966 testdata.889699 2026-02-23T08:34:16.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.899 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj967 testdata.889699 2026-02-23T08:34:16.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj968 testdata.889699 2026-02-23T08:34:16.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj969 testdata.889699 2026-02-23T08:34:16.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj970 testdata.889699 2026-02-23T08:34:16.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj971 testdata.889699 2026-02-23T08:34:16.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj972 testdata.889699 2026-02-23T08:34:16.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:16.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj973 testdata.889699 2026-02-23T08:34:17.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.003 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj974 testdata.889699 2026-02-23T08:34:17.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj975 testdata.889699 2026-02-23T08:34:17.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj976 testdata.889699 2026-02-23T08:34:17.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj977 testdata.889699 2026-02-23T08:34:17.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj978 testdata.889699 2026-02-23T08:34:17.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.077 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj979 testdata.889699 2026-02-23T08:34:17.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj980 testdata.889699 2026-02-23T08:34:17.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.105 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj981 testdata.889699 2026-02-23T08:34:17.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj982 testdata.889699 2026-02-23T08:34:17.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj983 testdata.889699 2026-02-23T08:34:17.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj984 testdata.889699 2026-02-23T08:34:17.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj985 testdata.889699 2026-02-23T08:34:17.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj986 testdata.889699 2026-02-23T08:34:17.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj987 testdata.889699 2026-02-23T08:34:17.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj988 testdata.889699 2026-02-23T08:34:17.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.224 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj989 testdata.889699 2026-02-23T08:34:17.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj990 testdata.889699 2026-02-23T08:34:17.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj991 testdata.889699 2026-02-23T08:34:17.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj992 testdata.889699 2026-02-23T08:34:17.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.283 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj993 testdata.889699 2026-02-23T08:34:17.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj994 testdata.889699 2026-02-23T08:34:17.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj995 testdata.889699 2026-02-23T08:34:17.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj996 testdata.889699 2026-02-23T08:34:17.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.343 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj997 testdata.889699 2026-02-23T08:34:17.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj998 testdata.889699 2026-02-23T08:34:17.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj999 testdata.889699 2026-02-23T08:34:17.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:330: _scrub_abort: for i in `seq 1 $objects` 2026-02-23T08:34:17.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:332: _scrub_abort: rados -p test put obj1000 testdata.889699 2026-02-23T08:34:17.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:334: _scrub_abort: rm -f testdata.889699 2026-02-23T08:34:17.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: get_primary test obj1 2026-02-23T08:34:17.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:34:17.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:34:17.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:34:17.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:34:17.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:336: _scrub_abort: local primary=1 2026-02-23T08:34:17.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:337: _scrub_abort: local pgid=1.0 2026-02-23T08:34:17.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:339: _scrub_abort: ceph tell 1.0 schedule-scrub 2026-02-23T08:34:17.632 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:34:17.632 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:34:17.632 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:34:17.632 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-21T08:34:17.631982+0000" 2026-02-23T08:34:17.632 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:34:17.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:342: _scrub_abort: set -o pipefail 2026-02-23T08:34:17.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:343: _scrub_abort: found=no 2026-02-23T08:34:17.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: seq 0 200 2026-02-23T08:34:17.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:17.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:34:17.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:17.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:17.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:17.805 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:17.805 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:17.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:17.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:17.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836507 2026-02-23T08:34:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836507 2026-02-23T08:34:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507' 2026-02-23T08:34:17.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:17.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:17.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705689 2026-02-23T08:34:17.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705689 2026-02-23T08:34:17.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705689' 2026-02-23T08:34:17.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:17.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:18.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574871 2026-02-23T08:34:18.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574871 2026-02-23T08:34:18.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836507 1-38654705689 2-55834574871' 2026-02-23T08:34:18.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:18.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836507 2026-02-23T08:34:18.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:18.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:18.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836507 2026-02-23T08:34:18.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:18.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836507 2026-02-23T08:34:18.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836507' 2026-02-23T08:34:18.027 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836507 2026-02-23T08:34:18.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:18.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836505 -lt 21474836507 2026-02-23T08:34:18.191 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:19.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:19.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:19.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836507 2026-02-23T08:34:19.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:19.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705689 2026-02-23T08:34:19.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:19.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:19.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705689 2026-02-23T08:34:19.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:19.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705689 2026-02-23T08:34:19.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705689' 2026-02-23T08:34:19.363 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705689 2026-02-23T08:34:19.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:19.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705690 -lt 38654705689 2026-02-23T08:34:19.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:19.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574871 2026-02-23T08:34:19.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:19.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:19.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574871 2026-02-23T08:34:19.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:19.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574871 2026-02-23T08:34:19.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574871' 2026-02-23T08:34:19.532 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574871 2026-02-23T08:34:19.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:19.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574872 -lt 55834574871 2026-02-23T08:34:19.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:19.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:34:19.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:19.852 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:19.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:19.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:34:19.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:19.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:20.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:20.030 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:20.030 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:20.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:20.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:20.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:20.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836511 2026-02-23T08:34:20.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836511 2026-02-23T08:34:20.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511' 2026-02-23T08:34:20.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:20.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:20.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705692 2026-02-23T08:34:20.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705692 2026-02-23T08:34:20.175 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705692' 2026-02-23T08:34:20.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:20.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:20.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574874 2026-02-23T08:34:20.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574874 2026-02-23T08:34:20.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836511 1-38654705692 2-55834574874' 2026-02-23T08:34:20.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:20.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836511 2026-02-23T08:34:20.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:20.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:20.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836511 2026-02-23T08:34:20.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:20.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836511 2026-02-23T08:34:20.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836511' 2026-02-23T08:34:20.253 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836511 2026-02-23T08:34:20.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:20.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836508 -lt 21474836511 2026-02-23T08:34:20.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:21.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:21.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:21.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836511 2026-02-23T08:34:21.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:21.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705692 2026-02-23T08:34:21.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:21.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:21.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705692 2026-02-23T08:34:21.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:21.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705692 2026-02-23T08:34:21.592 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705692 2026-02-23T08:34:21.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705692' 2026-02-23T08:34:21.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:21.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705693 -lt 38654705692 2026-02-23T08:34:21.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:21.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574874 2026-02-23T08:34:21.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:21.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:21.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574874 2026-02-23T08:34:21.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:21.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574874 2026-02-23T08:34:21.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574874' 2026-02-23T08:34:21.758 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574874 2026-02-23T08:34:21.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:21.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574875 -lt 55834574874 2026-02-23T08:34:21.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:21.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:34:21.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:22.078 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:22.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:22.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:34:22.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:22.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:22.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:22.257 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:22.257 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:22.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:22.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:22.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:22.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836514 2026-02-23T08:34:22.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836514 2026-02-23T08:34:22.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514' 2026-02-23T08:34:22.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:22.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:22.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705696 2026-02-23T08:34:22.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705696 2026-02-23T08:34:22.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705696' 2026-02-23T08:34:22.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:22.402 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:22.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574877 2026-02-23T08:34:22.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574877 2026-02-23T08:34:22.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836514 1-38654705696 2-55834574877' 2026-02-23T08:34:22.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:22.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836514 2026-02-23T08:34:22.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:22.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:22.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836514 2026-02-23T08:34:22.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:22.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836514 2026-02-23T08:34:22.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836514' 2026-02-23T08:34:22.476 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836514 2026-02-23T08:34:22.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:22.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836511 -lt 21474836514 2026-02-23T08:34:22.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:23.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:23.647 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:23.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836514 2026-02-23T08:34:23.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:23.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705696 2026-02-23T08:34:23.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:23.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:23.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705696 2026-02-23T08:34:23.812 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:23.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705696 2026-02-23T08:34:23.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705696' 2026-02-23T08:34:23.813 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705696 2026-02-23T08:34:23.814 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:23.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705696 -lt 38654705696 2026-02-23T08:34:23.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:23.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574877 2026-02-23T08:34:23.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:23.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:23.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574877 2026-02-23T08:34:23.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:23.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574877 2026-02-23T08:34:23.982 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574877 2026-02-23T08:34:23.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574877' 2026-02-23T08:34:23.983 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:24.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574878 -lt 55834574877 2026-02-23T08:34:24.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:24.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:34:24.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:24.298 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:24.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:344: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:24.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:346: _scrub_abort: flush_pg_stats 2026-02-23T08:34:24.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:24.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:24.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:24.475 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:24.475 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:24.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:24.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:24.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:24.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836517 2026-02-23T08:34:24.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836517 2026-02-23T08:34:24.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517' 2026-02-23T08:34:24.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:24.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:24.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705699 2026-02-23T08:34:24.622 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705699 2026-02-23T08:34:24.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-38654705699' 2026-02-23T08:34:24.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:24.623 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:24.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574881 2026-02-23T08:34:24.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574881 2026-02-23T08:34:24.694 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836517 1-38654705699 2-55834574881' 2026-02-23T08:34:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:24.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836517 2026-02-23T08:34:24.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:24.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836517 2026-02-23T08:34:24.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:24.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836517 2026-02-23T08:34:24.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836517' 2026-02-23T08:34:24.698 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836517 2026-02-23T08:34:24.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:24.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836514 -lt 21474836517 2026-02-23T08:34:24.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:25.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:25.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:26.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836517 -lt 21474836517 2026-02-23T08:34:26.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:26.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705699 2026-02-23T08:34:26.032 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:26.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:26.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705699 2026-02-23T08:34:26.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:26.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705699 2026-02-23T08:34:26.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705699' 2026-02-23T08:34:26.035 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705699 2026-02-23T08:34:26.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:26.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705699 -lt 38654705699 2026-02-23T08:34:26.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:26.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574881 2026-02-23T08:34:26.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:26.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:26.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574881 2026-02-23T08:34:26.209 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:26.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574881 2026-02-23T08:34:26.210 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574881 2026-02-23T08:34:26.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574881' 2026-02-23T08:34:26.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:26.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574881 -lt 55834574881 2026-02-23T08:34:26.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:26.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep '^1.0' 2026-02-23T08:34:26.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:347: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:26.528 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:26.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:349: _scrub_abort: found=yes 2026-02-23T08:34:26.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:351: _scrub_abort: break 2026-02-23T08:34:26.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:354: _scrub_abort: set +o pipefail 2026-02-23T08:34:26.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:356: _scrub_abort: test yes = no 2026-02-23T08:34:26.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:362: _scrub_abort: ceph osd set noscrub 2026-02-23T08:34:26.747 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is set 2026-02-23T08:34:26.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:363: _scrub_abort: '[' scrub = deep-scrub ']' 2026-02-23T08:34:26.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:369: _scrub_abort: set -o pipefail 2026-02-23T08:34:26.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: seq 0 200 2026-02-23T08:34:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:26.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:26.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:26.923 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:26.923 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:26.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:26.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:26.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836520 2026-02-23T08:34:26.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836520 2026-02-23T08:34:26.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836520' 2026-02-23T08:34:26.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:26.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:27.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705702 2026-02-23T08:34:27.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705702 2026-02-23T08:34:27.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836520 1-38654705702' 2026-02-23T08:34:27.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:27.071 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:27.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574884 2026-02-23T08:34:27.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574884 2026-02-23T08:34:27.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836520 1-38654705702 2-55834574884' 2026-02-23T08:34:27.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:27.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836520 2026-02-23T08:34:27.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:27.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:27.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836520 2026-02-23T08:34:27.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:27.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836520 2026-02-23T08:34:27.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836520' 2026-02-23T08:34:27.148 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836520 2026-02-23T08:34:27.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:27.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836519 -lt 21474836520 2026-02-23T08:34:27.314 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:28.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:28.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:28.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836519 -lt 21474836520 2026-02-23T08:34:28.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:29.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:34:29.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:29.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836522 -lt 21474836520 2026-02-23T08:34:29.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:29.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705702 2026-02-23T08:34:29.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:29.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:29.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705702 2026-02-23T08:34:29.650 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:29.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705702 2026-02-23T08:34:29.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705702' 2026-02-23T08:34:29.651 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705702 2026-02-23T08:34:29.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:29.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705704 -lt 38654705702 2026-02-23T08:34:29.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:29.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574884 2026-02-23T08:34:29.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:29.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:29.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574884 2026-02-23T08:34:29.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:29.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574884 2026-02-23T08:34:29.818 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574884 2026-02-23T08:34:29.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574884' 2026-02-23T08:34:29.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:29.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574886 -lt 55834574884 2026-02-23T08:34:29.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:29.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:29.985 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:30.139 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:30.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:30.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:30.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:30.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:30.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:30.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:30.317 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:30.317 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:30.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:30.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:30.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:30.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836525 2026-02-23T08:34:30.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836525 2026-02-23T08:34:30.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836525' 2026-02-23T08:34:30.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:30.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:30.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705707 2026-02-23T08:34:30.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705707 2026-02-23T08:34:30.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836525 1-38654705707' 2026-02-23T08:34:30.464 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:30.465 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:30.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574888 2026-02-23T08:34:30.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574888 2026-02-23T08:34:30.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836525 1-38654705707 2-55834574888' 2026-02-23T08:34:30.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:30.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836525 2026-02-23T08:34:30.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:30.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:30.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836525 2026-02-23T08:34:30.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:30.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836525 2026-02-23T08:34:30.543 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836525 2026-02-23T08:34:30.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2026-02-23T08:34:30.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836522 -lt 21474836525 2026-02-23T08:34:30.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:31.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:31.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:31.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836525 -lt 21474836525 2026-02-23T08:34:31.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:31.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705707 2026-02-23T08:34:31.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:31.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:31.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705707 2026-02-23T08:34:31.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:31.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705707 2026-02-23T08:34:31.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705707' 2026-02-23T08:34:31.882 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705707 2026-02-23T08:34:31.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:32.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705707 -lt 38654705707 2026-02-23T08:34:32.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:32.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574888 2026-02-23T08:34:32.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:32.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:32.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574888 2026-02-23T08:34:32.049 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:32.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574888 2026-02-23T08:34:32.050 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574888 2026-02-23T08:34:32.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574888' 2026-02-23T08:34:32.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:32.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574889 -lt 55834574888 2026-02-23T08:34:32.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:32.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:32.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:32.365 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:32.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:32.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:32.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:32.539 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:32.539 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:32.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:32.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:32.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:32.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836528 2026-02-23T08:34:32.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836528 2026-02-23T08:34:32.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836528' 2026-02-23T08:34:32.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:32.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:32.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705710 2026-02-23T08:34:32.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705710 2026-02-23T08:34:32.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836528 1-38654705710' 2026-02-23T08:34:32.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:32.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:32.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574892 2026-02-23T08:34:32.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574892 2026-02-23T08:34:32.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836528 1-38654705710 2-55834574892' 2026-02-23T08:34:32.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:32.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836528 2026-02-23T08:34:32.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:32.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:32.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836528 2026-02-23T08:34:32.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:32.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836528 2026-02-23T08:34:32.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836528' 2026-02-23T08:34:32.760 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836528 2026-02-23T08:34:32.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:32.925 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836525 -lt 21474836528 2026-02-23T08:34:32.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:33.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:33.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:34.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836528 -lt 21474836528 2026-02-23T08:34:34.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:34.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705710 2026-02-23T08:34:34.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:34.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:34.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705710 2026-02-23T08:34:34.097 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:34.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705710 2026-02-23T08:34:34.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705710' 2026-02-23T08:34:34.099 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705710 2026-02-23T08:34:34.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:34.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705710 -lt 38654705710 2026-02-23T08:34:34.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:34.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574892 2026-02-23T08:34:34.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:34.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:34.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574892 2026-02-23T08:34:34.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:34.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574892 2026-02-23T08:34:34.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574892' 2026-02-23T08:34:34.267 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574892 2026-02-23T08:34:34.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:34.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574892 -lt 55834574892 2026-02-23T08:34:34.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:34.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:34.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:34.584 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:34.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:34.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:34.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:34.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:34.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:34.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:34.759 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:34.759 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:34.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:34.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:34.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:34.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836531 2026-02-23T08:34:34.833 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836531 2026-02-23T08:34:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836531' 2026-02-23T08:34:34.834 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:34.834 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:34.907 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705713 2026-02-23T08:34:34.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705713 2026-02-23T08:34:34.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836531 1-38654705713' 2026-02-23T08:34:34.908 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:34.908 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574895 2026-02-23T08:34:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574895 2026-02-23T08:34:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836531 1-38654705713 2-55834574895' 2026-02-23T08:34:34.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:34.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836531 2026-02-23T08:34:34.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:34.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:34.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836531 2026-02-23T08:34:34.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836531 2026-02-23T08:34:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836531' 2026-02-23T08:34:34.984 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836531 2026-02-23T08:34:34.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836531 -lt 21474836531 2026-02-23T08:34:35.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:35.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705713 2026-02-23T08:34:35.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:35.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:35.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705713 2026-02-23T08:34:35.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:35.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705713 2026-02-23T08:34:35.152 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705713 2026-02-23T08:34:35.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705713' 2026-02-23T08:34:35.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:35.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705713 -lt 38654705713 2026-02-23T08:34:35.315 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:35.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574895 2026-02-23T08:34:35.315 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:35.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:35.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574895 2026-02-23T08:34:35.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:35.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574895 2026-02-23T08:34:35.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574895' 2026-02-23T08:34:35.318 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574895 2026-02-23T08:34:35.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:35.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574894 -lt 55834574895 2026-02-23T08:34:35.481 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:36.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:36.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:36.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574894 -lt 55834574895 2026-02-23T08:34:36.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:37.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:34:37.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:37.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574897 -lt 55834574895 2026-02-23T08:34:37.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:37.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:37.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:37.967 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:37.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:37.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:37.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:37.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:37.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:38.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:38.141 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:38.141 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:38.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:38.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:38.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:38.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836536 2026-02-23T08:34:38.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836536 2026-02-23T08:34:38.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836536' 2026-02-23T08:34:38.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:38.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:38.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705717 2026-02-23T08:34:38.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705717 2026-02-23T08:34:38.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836536 1-38654705717' 2026-02-23T08:34:38.292 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:38.292 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:38.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574899 2026-02-23T08:34:38.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574899 2026-02-23T08:34:38.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836536 1-38654705717 2-55834574899' 2026-02-23T08:34:38.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:38.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836536 2026-02-23T08:34:38.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:38.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:38.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836536 2026-02-23T08:34:38.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:38.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836536 2026-02-23T08:34:38.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836536' 2026-02-23T08:34:38.370 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836536 2026-02-23T08:34:38.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:38.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836533 -lt 21474836536 2026-02-23T08:34:38.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:39.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:39.536 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:39.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836536 -lt 21474836536 2026-02-23T08:34:39.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:39.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705717 2026-02-23T08:34:39.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:39.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:39.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705717 2026-02-23T08:34:39.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:39.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705717 2026-02-23T08:34:39.703 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705717 2026-02-23T08:34:39.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705717' 2026-02-23T08:34:39.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705718 -lt 38654705717 2026-02-23T08:34:39.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574899 2026-02-23T08:34:39.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:39.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:39.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574899 2026-02-23T08:34:39.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:39.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574899 2026-02-23T08:34:39.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574899' 2026-02-23T08:34:39.868 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574899 2026-02-23T08:34:39.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:40.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574900 -lt 55834574899 2026-02-23T08:34:40.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:40.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:40.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:40.184 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:40.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:40.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:40.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:40.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:40.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:40.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:40.360 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:40.360 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:40.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:40.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:40.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:40.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836539 2026-02-23T08:34:40.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836539 2026-02-23T08:34:40.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836539' 2026-02-23T08:34:40.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:40.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:40.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705721 2026-02-23T08:34:40.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705721 2026-02-23T08:34:40.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836539 1-38654705721' 2026-02-23T08:34:40.508 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:40.508 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:40.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574902 2026-02-23T08:34:40.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574902 2026-02-23T08:34:40.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836539 1-38654705721 2-55834574902' 2026-02-23T08:34:40.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:40.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836539 2026-02-23T08:34:40.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:40.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:40.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836539 2026-02-23T08:34:40.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:40.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836539 2026-02-23T08:34:40.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836539' 2026-02-23T08:34:40.586 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836539 2026-02-23T08:34:40.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:40.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836536 -lt 21474836539 2026-02-23T08:34:40.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:41.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:41.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:41.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836539 -lt 21474836539 2026-02-23T08:34:41.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:41.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705721 2026-02-23T08:34:41.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:41.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:41.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705721 2026-02-23T08:34:41.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:41.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705721 2026-02-23T08:34:41.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705721' 2026-02-23T08:34:41.920 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705721 2026-02-23T08:34:41.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:42.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705721 -lt 38654705721 2026-02-23T08:34:42.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:42.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574902 2026-02-23T08:34:42.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:42.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:42.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574902 2026-02-23T08:34:42.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:42.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574902 2026-02-23T08:34:42.087 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574902 2026-02-23T08:34:42.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574902' 2026-02-23T08:34:42.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:42.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574903 -lt 55834574902 2026-02-23T08:34:42.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:42.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:42.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:42.402 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:42.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:42.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:42.413 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:42.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:42.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:42.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:42.579 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:42.579 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:42.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:42.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:42.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:42.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836542 2026-02-23T08:34:42.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836542 2026-02-23T08:34:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836542' 2026-02-23T08:34:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:42.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705724 2026-02-23T08:34:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705724 2026-02-23T08:34:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836542 1-38654705724' 2026-02-23T08:34:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:42.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:42.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574906 2026-02-23T08:34:42.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574906 2026-02-23T08:34:42.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836542 1-38654705724 2-55834574906' 2026-02-23T08:34:42.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:42.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836542 2026-02-23T08:34:42.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:42.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:42.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836542 2026-02-23T08:34:42.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:42.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836542 2026-02-23T08:34:42.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836542' 2026-02-23T08:34:42.803 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836542 2026-02-23T08:34:42.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:42.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836539 -lt 21474836542 2026-02-23T08:34:42.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:43.966 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:43.967 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:44.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836542 -lt 21474836542 2026-02-23T08:34:44.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:44.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705724 2026-02-23T08:34:44.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:44.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:44.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705724 2026-02-23T08:34:44.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:44.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705724 2026-02-23T08:34:44.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705724' 2026-02-23T08:34:44.142 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705724 2026-02-23T08:34:44.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705724 -lt 38654705724 2026-02-23T08:34:44.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:44.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574906 2026-02-23T08:34:44.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:44.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:44.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574906 2026-02-23T08:34:44.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:44.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574906 2026-02-23T08:34:44.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574906' 2026-02-23T08:34:44.310 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574906 2026-02-23T08:34:44.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574906 -lt 55834574906 2026-02-23T08:34:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:44.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:44.627 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:44.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:44.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:44.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:44.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:44.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:44.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:44.805 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:44.806 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:44.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:44.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:44.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:44.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836545 2026-02-23T08:34:44.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836545 2026-02-23T08:34:44.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836545' 2026-02-23T08:34:44.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:44.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705727 2026-02-23T08:34:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705727 2026-02-23T08:34:44.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836545 1-38654705727' 2026-02-23T08:34:44.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:44.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574909 2026-02-23T08:34:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574909 2026-02-23T08:34:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836545 1-38654705727 2-55834574909' 2026-02-23T08:34:45.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:45.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836545 2026-02-23T08:34:45.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:45.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:45.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836545 2026-02-23T08:34:45.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836545 2026-02-23T08:34:45.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836545' 2026-02-23T08:34:45.030 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836545 2026-02-23T08:34:45.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:45.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836545 -lt 21474836545 2026-02-23T08:34:45.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:45.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705727 2026-02-23T08:34:45.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:45.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:45.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705727 2026-02-23T08:34:45.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:45.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705727 2026-02-23T08:34:45.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705727' 2026-02-23T08:34:45.197 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705727 2026-02-23T08:34:45.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:45.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705726 -lt 38654705727 2026-02-23T08:34:45.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:46.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:46.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:46.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705726 -lt 38654705727 2026-02-23T08:34:46.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:47.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:34:47.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:47.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705729 -lt 38654705727 2026-02-23T08:34:47.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:47.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574909 2026-02-23T08:34:47.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:47.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:47.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574909 2026-02-23T08:34:47.694 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:47.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574909 2026-02-23T08:34:47.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574909' 2026-02-23T08:34:47.696 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574909 2026-02-23T08:34:47.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:47.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574911 -lt 55834574909 2026-02-23T08:34:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:47.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:48.016 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:48.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:48.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:48.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:48.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:48.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:48.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:48.192 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:48.192 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:48.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:48.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:48.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836550 2026-02-23T08:34:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836550 2026-02-23T08:34:48.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836550' 2026-02-23T08:34:48.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:48.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:48.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705731 2026-02-23T08:34:48.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705731 2026-02-23T08:34:48.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836550 1-38654705731' 2026-02-23T08:34:48.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:48.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:48.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574913 2026-02-23T08:34:48.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574913 2026-02-23T08:34:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836550 1-38654705731 2-55834574913' 2026-02-23T08:34:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:48.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836550 2026-02-23T08:34:48.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:48.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:48.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836550 2026-02-23T08:34:48.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836550 2026-02-23T08:34:48.419 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836550 2026-02-23T08:34:48.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836550' 2026-02-23T08:34:48.420 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:48.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836547 -lt 21474836550 2026-02-23T08:34:48.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:49.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:49.586 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:49.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836550 -lt 21474836550 2026-02-23T08:34:49.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:49.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705731 2026-02-23T08:34:49.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:49.752 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:49.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705731 2026-02-23T08:34:49.753 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:49.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705731 2026-02-23T08:34:49.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705731' 2026-02-23T08:34:49.755 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705731 2026-02-23T08:34:49.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705732 -lt 38654705731 2026-02-23T08:34:49.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:49.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574913 2026-02-23T08:34:49.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:49.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:49.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574913 2026-02-23T08:34:49.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:49.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574913 2026-02-23T08:34:49.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574913' 2026-02-23T08:34:49.920 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574913 2026-02-23T08:34:49.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:50.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574914 -lt 55834574913 2026-02-23T08:34:50.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:50.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:50.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:50.240 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:50.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:50.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:50.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:50.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:50.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:50.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:50.415 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:50.416 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:50.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:50.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836553 2026-02-23T08:34:50.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836553 2026-02-23T08:34:50.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836553' 2026-02-23T08:34:50.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:50.491 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:50.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705735 2026-02-23T08:34:50.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705735 2026-02-23T08:34:50.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836553 1-38654705735' 2026-02-23T08:34:50.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:50.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:50.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574917 2026-02-23T08:34:50.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574917 2026-02-23T08:34:50.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836553 1-38654705735 2-55834574917' 2026-02-23T08:34:50.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:50.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836553 2026-02-23T08:34:50.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:50.635 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:50.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836553 2026-02-23T08:34:50.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:50.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836553 2026-02-23T08:34:50.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836553' 2026-02-23T08:34:50.637 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836553 2026-02-23T08:34:50.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:50.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836550 -lt 21474836553 2026-02-23T08:34:50.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:51.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:51.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:51.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836553 -lt 21474836553 2026-02-23T08:34:51.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:51.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705735 2026-02-23T08:34:51.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:51.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:51.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705735 2026-02-23T08:34:51.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:51.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705735 2026-02-23T08:34:51.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705735' 2026-02-23T08:34:51.978 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705735 2026-02-23T08:34:51.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:52.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705735 -lt 38654705735 2026-02-23T08:34:52.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:52.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574917 2026-02-23T08:34:52.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:52.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:52.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574917 2026-02-23T08:34:52.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:52.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574917 2026-02-23T08:34:52.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574917' 2026-02-23T08:34:52.146 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574917 2026-02-23T08:34:52.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:52.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574917 -lt 55834574917 2026-02-23T08:34:52.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:52.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:52.312 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:52.466 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:52.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:52.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:52.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:52.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:52.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:52.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:52.643 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:52.643 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:52.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:52.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:52.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:52.716 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836556 2026-02-23T08:34:52.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836556 2026-02-23T08:34:52.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836556' 2026-02-23T08:34:52.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:52.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:52.791 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705738 2026-02-23T08:34:52.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705738 2026-02-23T08:34:52.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836556 1-38654705738' 2026-02-23T08:34:52.792 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:52.792 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:52.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574920 2026-02-23T08:34:52.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574920 2026-02-23T08:34:52.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836556 1-38654705738 2-55834574920' 2026-02-23T08:34:52.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:52.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836556 2026-02-23T08:34:52.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:52.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:52.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836556 2026-02-23T08:34:52.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:52.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836556 2026-02-23T08:34:52.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836556' 2026-02-23T08:34:52.869 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836556 2026-02-23T08:34:52.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:53.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836556 -lt 21474836556 2026-02-23T08:34:53.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:53.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705738 2026-02-23T08:34:53.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:53.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:53.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705738 2026-02-23T08:34:53.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:53.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705738 2026-02-23T08:34:53.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705738' 2026-02-23T08:34:53.041 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705738 2026-02-23T08:34:53.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:53.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705738 -lt 38654705738 2026-02-23T08:34:53.206 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:53.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574920 2026-02-23T08:34:53.207 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:53.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:53.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574920 2026-02-23T08:34:53.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:53.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574920 2026-02-23T08:34:53.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574920' 2026-02-23T08:34:53.210 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574920 2026-02-23T08:34:53.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:53.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574920 -lt 55834574920 2026-02-23T08:34:53.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:53.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:53.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:53.522 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:53.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:53.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:53.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:53.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:53.533 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:53.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:53.699 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:53.699 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:53.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:53.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:53.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:53.771 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836558 2026-02-23T08:34:53.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836558 2026-02-23T08:34:53.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836558' 2026-02-23T08:34:53.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:53.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:53.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705740 2026-02-23T08:34:53.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705740 2026-02-23T08:34:53.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836558 1-38654705740' 2026-02-23T08:34:53.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:53.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:53.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574922 2026-02-23T08:34:53.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574922 2026-02-23T08:34:53.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836558 1-38654705740 2-55834574922' 2026-02-23T08:34:53.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:53.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836558 2026-02-23T08:34:53.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:53.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:53.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836558 2026-02-23T08:34:53.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:53.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836558 2026-02-23T08:34:53.921 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836558 2026-02-23T08:34:53.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836558' 2026-02-23T08:34:53.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:54.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836556 -lt 21474836558 2026-02-23T08:34:54.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:55.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:55.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:55.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836559 -lt 21474836558 2026-02-23T08:34:55.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:55.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705740 2026-02-23T08:34:55.254 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:55.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:55.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705740 2026-02-23T08:34:55.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:55.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705740 2026-02-23T08:34:55.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705740' 2026-02-23T08:34:55.257 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705740 2026-02-23T08:34:55.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:55.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705741 -lt 38654705740 2026-02-23T08:34:55.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:55.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574922 2026-02-23T08:34:55.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:55.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:55.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574922 2026-02-23T08:34:55.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:55.426 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574922 2026-02-23T08:34:55.426 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574922 2026-02-23T08:34:55.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574922' 2026-02-23T08:34:55.427 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:55.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574923 -lt 55834574922 2026-02-23T08:34:55.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:55.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:55.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:55.743 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:55.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:55.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:55.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:55.917 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:55.917 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:55.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:55.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:55.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:55.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836561 2026-02-23T08:34:55.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836561 2026-02-23T08:34:55.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836561' 2026-02-23T08:34:55.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:55.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:56.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705743 2026-02-23T08:34:56.064 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705743 2026-02-23T08:34:56.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836561 1-38654705743' 2026-02-23T08:34:56.065 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:56.065 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:56.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574925 2026-02-23T08:34:56.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574925 2026-02-23T08:34:56.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836561 1-38654705743 2-55834574925' 2026-02-23T08:34:56.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:56.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836561 2026-02-23T08:34:56.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:56.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:56.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836561 2026-02-23T08:34:56.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:56.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836561 2026-02-23T08:34:56.141 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836561 2026-02-23T08:34:56.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836561' 2026-02-23T08:34:56.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:56.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836559 -lt 21474836561 2026-02-23T08:34:56.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:57.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:57.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:57.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836562 -lt 21474836561 2026-02-23T08:34:57.473 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:57.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705743 2026-02-23T08:34:57.473 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:57.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:57.474 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705743 2026-02-23T08:34:57.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:57.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705743 2026-02-23T08:34:57.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705743' 2026-02-23T08:34:57.476 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705743 2026-02-23T08:34:57.476 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:57.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705744 -lt 38654705743 2026-02-23T08:34:57.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:57.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574925 2026-02-23T08:34:57.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:57.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:57.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574925 2026-02-23T08:34:57.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:57.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574925 2026-02-23T08:34:57.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574925' 2026-02-23T08:34:57.645 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574925 2026-02-23T08:34:57.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:34:57.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574926 -lt 55834574925 2026-02-23T08:34:57.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:34:57.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:34:57.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:34:57.963 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:34:57.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:34:57.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:34:57.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:34:57.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:34:57.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:34:58.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:34:58.138 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:34:58.138 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:34:58.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:34:58.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:58.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:34:58.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836565 2026-02-23T08:34:58.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836565 2026-02-23T08:34:58.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836565' 2026-02-23T08:34:58.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:58.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:34:58.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705746 2026-02-23T08:34:58.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705746 2026-02-23T08:34:58.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836565 1-38654705746' 2026-02-23T08:34:58.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:34:58.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:34:58.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574928 2026-02-23T08:34:58.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574928 2026-02-23T08:34:58.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836565 1-38654705746 2-55834574928' 2026-02-23T08:34:58.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:58.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836565 2026-02-23T08:34:58.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:58.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:34:58.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836565 2026-02-23T08:34:58.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:58.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836565 2026-02-23T08:34:58.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836565' 2026-02-23T08:34:58.370 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836565 2026-02-23T08:34:58.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:58.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836562 -lt 21474836565 2026-02-23T08:34:58.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:34:59.534 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:34:59.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:34:59.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836565 -lt 21474836565 2026-02-23T08:34:59.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:59.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705746 2026-02-23T08:34:59.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:59.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:34:59.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705746 2026-02-23T08:34:59.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:59.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705746 2026-02-23T08:34:59.707 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705746 2026-02-23T08:34:59.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705746' 2026-02-23T08:34:59.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:34:59.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705747 -lt 38654705746 2026-02-23T08:34:59.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:34:59.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574928 2026-02-23T08:34:59.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:34:59.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:34:59.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574928 2026-02-23T08:34:59.873 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:34:59.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574928 2026-02-23T08:34:59.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574928' 2026-02-23T08:34:59.875 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574928 2026-02-23T08:34:59.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:00.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574929 -lt 55834574928 2026-02-23T08:35:00.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:00.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:00.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:00.190 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:00.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:00.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:00.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:00.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:00.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:00.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:00.369 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:00.369 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:00.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:00.369 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:00.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:00.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836568 2026-02-23T08:35:00.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836568 2026-02-23T08:35:00.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836568' 2026-02-23T08:35:00.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:00.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:00.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705750 2026-02-23T08:35:00.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705750 2026-02-23T08:35:00.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836568 1-38654705750' 2026-02-23T08:35:00.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:00.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:00.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574931 2026-02-23T08:35:00.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574931 2026-02-23T08:35:00.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836568 1-38654705750 2-55834574931' 2026-02-23T08:35:00.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:00.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836568 2026-02-23T08:35:00.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:00.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:00.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836568 2026-02-23T08:35:00.591 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:00.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836568 2026-02-23T08:35:00.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836568' 2026-02-23T08:35:00.593 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836568 2026-02-23T08:35:00.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:00.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836565 -lt 21474836568 2026-02-23T08:35:00.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:01.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:01.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:01.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836568 -lt 21474836568 2026-02-23T08:35:01.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:01.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705750 2026-02-23T08:35:01.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:01.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:01.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705750 2026-02-23T08:35:01.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:01.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705750 2026-02-23T08:35:01.935 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705750' 2026-02-23T08:35:01.935 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705750 2026-02-23T08:35:01.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:02.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705750 -lt 38654705750 2026-02-23T08:35:02.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:02.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574931 2026-02-23T08:35:02.099 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:02.100 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:02.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574931 2026-02-23T08:35:02.100 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:02.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574931 2026-02-23T08:35:02.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574931' 2026-02-23T08:35:02.102 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574931 2026-02-23T08:35:02.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:02.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574932 -lt 55834574931 2026-02-23T08:35:02.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:02.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:02.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:02.421 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:02.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:02.600 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:02.600 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:02.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:02.600 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836571 2026-02-23T08:35:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836571 2026-02-23T08:35:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836571' 2026-02-23T08:35:02.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:02.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:02.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705753 2026-02-23T08:35:02.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705753 2026-02-23T08:35:02.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836571 1-38654705753' 2026-02-23T08:35:02.746 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:02.746 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:02.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574935 2026-02-23T08:35:02.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574935 2026-02-23T08:35:02.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836571 1-38654705753 2-55834574935' 2026-02-23T08:35:02.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:02.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836571 2026-02-23T08:35:02.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:02.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:02.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836571 2026-02-23T08:35:02.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:02.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836571 2026-02-23T08:35:02.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836571' 2026-02-23T08:35:02.823 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836571 2026-02-23T08:35:02.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:02.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836571 -lt 21474836571 2026-02-23T08:35:02.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:02.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705753 2026-02-23T08:35:02.993 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:02.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:02.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705753 2026-02-23T08:35:02.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:02.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705753 2026-02-23T08:35:02.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705753' 2026-02-23T08:35:02.996 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705753 2026-02-23T08:35:02.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:03.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705753 -lt 38654705753 2026-02-23T08:35:03.165 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:03.165 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574935 2026-02-23T08:35:03.166 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:03.166 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:03.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574935 2026-02-23T08:35:03.167 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:03.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574935 2026-02-23T08:35:03.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574935' 2026-02-23T08:35:03.168 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574935 2026-02-23T08:35:03.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:03.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574935 -lt 55834574935 2026-02-23T08:35:03.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:03.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:03.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:03.481 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:03.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:03.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:03.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:03.654 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:03.654 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:03.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:03.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:03.655 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:03.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836573 2026-02-23T08:35:03.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836573 2026-02-23T08:35:03.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836573' 2026-02-23T08:35:03.730 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:03.730 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705755 2026-02-23T08:35:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705755 2026-02-23T08:35:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836573 1-38654705755' 2026-02-23T08:35:03.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:03.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:03.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574937 2026-02-23T08:35:03.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574937 2026-02-23T08:35:03.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836573 1-38654705755 2-55834574937' 2026-02-23T08:35:03.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:03.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836573 2026-02-23T08:35:03.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:03.877 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:03.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836573 2026-02-23T08:35:03.878 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:03.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836573 2026-02-23T08:35:03.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836573' 2026-02-23T08:35:03.880 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836573 2026-02-23T08:35:03.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:04.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836571 -lt 21474836573 2026-02-23T08:35:04.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:05.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:05.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:05.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836574 -lt 21474836573 2026-02-23T08:35:05.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:05.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705755 2026-02-23T08:35:05.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:05.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:05.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705755 2026-02-23T08:35:05.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:05.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705755 2026-02-23T08:35:05.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705755' 2026-02-23T08:35:05.215 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705755 2026-02-23T08:35:05.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:05.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705756 -lt 38654705755 2026-02-23T08:35:05.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:05.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574937 2026-02-23T08:35:05.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:05.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:05.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574937 2026-02-23T08:35:05.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:05.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574937 2026-02-23T08:35:05.386 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574937 2026-02-23T08:35:05.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574937' 2026-02-23T08:35:05.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:05.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574938 -lt 55834574937 2026-02-23T08:35:05.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:05.548 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:05.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:05.699 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:05.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:05.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:05.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:05.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:05.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:05.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:05.875 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:05.876 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:05.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:05.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:05.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:05.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836576 2026-02-23T08:35:05.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836576 2026-02-23T08:35:05.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836576' 2026-02-23T08:35:05.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:05.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:06.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705758 2026-02-23T08:35:06.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705758 2026-02-23T08:35:06.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836576 1-38654705758' 2026-02-23T08:35:06.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:06.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:06.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574940 2026-02-23T08:35:06.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574940 2026-02-23T08:35:06.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836576 1-38654705758 2-55834574940' 2026-02-23T08:35:06.101 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:06.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836576 2026-02-23T08:35:06.102 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:06.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:06.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836576 2026-02-23T08:35:06.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:06.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836576 2026-02-23T08:35:06.104 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836576' 2026-02-23T08:35:06.104 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836576 2026-02-23T08:35:06.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:06.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836574 -lt 21474836576 2026-02-23T08:35:06.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:07.269 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:07.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:07.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836577 -lt 21474836576 2026-02-23T08:35:07.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:07.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705758 2026-02-23T08:35:07.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:07.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:07.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705758 2026-02-23T08:35:07.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:07.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705758 2026-02-23T08:35:07.437 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705758 2026-02-23T08:35:07.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705758' 2026-02-23T08:35:07.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:07.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705759 -lt 38654705758 2026-02-23T08:35:07.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:07.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574940 2026-02-23T08:35:07.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:07.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:07.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574940 2026-02-23T08:35:07.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:07.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574940 2026-02-23T08:35:07.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574940' 2026-02-23T08:35:07.605 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574940 2026-02-23T08:35:07.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:07.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574941 -lt 55834574940 2026-02-23T08:35:07.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:07.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:07.769 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:07.918 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:07.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:07.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:07.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:07.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:07.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:08.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:08.094 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:08.094 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:08.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:08.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:08.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:08.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836580 2026-02-23T08:35:08.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836580 2026-02-23T08:35:08.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836580' 2026-02-23T08:35:08.170 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:08.170 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:08.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705761 2026-02-23T08:35:08.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705761 2026-02-23T08:35:08.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836580 1-38654705761' 2026-02-23T08:35:08.242 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:08.242 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:08.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574943 2026-02-23T08:35:08.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574943 2026-02-23T08:35:08.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836580 1-38654705761 2-55834574943' 2026-02-23T08:35:08.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:08.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836580 2026-02-23T08:35:08.317 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:08.318 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:08.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836580 2026-02-23T08:35:08.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:08.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836580 2026-02-23T08:35:08.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836580' 2026-02-23T08:35:08.320 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836580 2026-02-23T08:35:08.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:08.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836577 -lt 21474836580 2026-02-23T08:35:08.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:09.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:09.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:09.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836580 -lt 21474836580 2026-02-23T08:35:09.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:09.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705761 2026-02-23T08:35:09.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:09.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:09.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705761 2026-02-23T08:35:09.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:09.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705761 2026-02-23T08:35:09.663 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705761 2026-02-23T08:35:09.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705761' 2026-02-23T08:35:09.663 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:09.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705762 -lt 38654705761 2026-02-23T08:35:09.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:09.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574943 2026-02-23T08:35:09.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:09.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:09.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574943 2026-02-23T08:35:09.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:09.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574943 2026-02-23T08:35:09.830 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574943 2026-02-23T08:35:09.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574943' 2026-02-23T08:35:09.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:09.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574944 -lt 55834574943 2026-02-23T08:35:09.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:09.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:09.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:10.150 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:10.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:10.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:10.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:10.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:10.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:10.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:10.330 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:10.330 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:10.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:10.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:10.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:10.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836583 2026-02-23T08:35:10.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836583 2026-02-23T08:35:10.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836583' 2026-02-23T08:35:10.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:10.407 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:10.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705765 2026-02-23T08:35:10.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705765 2026-02-23T08:35:10.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836583 1-38654705765' 2026-02-23T08:35:10.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:10.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:10.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574946 2026-02-23T08:35:10.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574946 2026-02-23T08:35:10.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836583 1-38654705765 2-55834574946' 2026-02-23T08:35:10.554 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:10.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836583 2026-02-23T08:35:10.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:10.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:10.555 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836583 2026-02-23T08:35:10.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:10.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836583 2026-02-23T08:35:10.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836583' 2026-02-23T08:35:10.557 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836583 2026-02-23T08:35:10.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:10.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836580 -lt 21474836583 2026-02-23T08:35:10.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:11.723 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:11.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:11.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836583 -lt 21474836583 2026-02-23T08:35:11.896 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:11.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705765 2026-02-23T08:35:11.897 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:11.898 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:11.898 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705765 2026-02-23T08:35:11.899 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:11.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705765 2026-02-23T08:35:11.900 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705765 2026-02-23T08:35:11.900 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705765' 2026-02-23T08:35:11.900 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:12.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705765 -lt 38654705765 2026-02-23T08:35:12.066 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:12.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574946 2026-02-23T08:35:12.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:12.068 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:12.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574946 2026-02-23T08:35:12.069 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:12.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574946 2026-02-23T08:35:12.070 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574946' 2026-02-23T08:35:12.070 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574946 2026-02-23T08:35:12.070 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:12.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574947 -lt 55834574946 2026-02-23T08:35:12.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:12.238 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:12.239 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:12.390 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:12.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:12.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:12.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:12.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:12.401 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:12.572 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:12.572 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:12.572 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:12.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:12.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:12.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:12.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836586 2026-02-23T08:35:12.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836586 2026-02-23T08:35:12.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836586' 2026-02-23T08:35:12.645 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:12.645 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705768 2026-02-23T08:35:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705768 2026-02-23T08:35:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836586 1-38654705768' 2026-02-23T08:35:12.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:12.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:12.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574950 2026-02-23T08:35:12.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574950 2026-02-23T08:35:12.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836586 1-38654705768 2-55834574950' 2026-02-23T08:35:12.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:12.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836586 2026-02-23T08:35:12.794 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:12.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:12.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836586 2026-02-23T08:35:12.795 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:12.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836586 2026-02-23T08:35:12.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836586' 2026-02-23T08:35:12.797 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836586 2026-02-23T08:35:12.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:12.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836583 -lt 21474836586 2026-02-23T08:35:12.964 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:13.965 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:13.966 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:14.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836586 -lt 21474836586 2026-02-23T08:35:14.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:14.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705768 2026-02-23T08:35:14.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:14.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:14.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705768 2026-02-23T08:35:14.137 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:14.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705768 2026-02-23T08:35:14.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705768' 2026-02-23T08:35:14.139 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705768 2026-02-23T08:35:14.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:14.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705768 -lt 38654705768 2026-02-23T08:35:14.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:14.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574950 2026-02-23T08:35:14.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:14.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:14.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574950 2026-02-23T08:35:14.306 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:14.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574950 2026-02-23T08:35:14.308 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574950 2026-02-23T08:35:14.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574950' 2026-02-23T08:35:14.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:14.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574950 -lt 55834574950 2026-02-23T08:35:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:14.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:14.629 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:14.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:14.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:14.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:14.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:14.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:14.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:14.806 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:14.806 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:14.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:14.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:14.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:14.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836589 2026-02-23T08:35:14.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836589 2026-02-23T08:35:14.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836589' 2026-02-23T08:35:14.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:14.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:14.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705771 2026-02-23T08:35:14.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705771 2026-02-23T08:35:14.953 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836589 1-38654705771' 2026-02-23T08:35:14.954 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:14.954 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:15.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574953 2026-02-23T08:35:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574953 2026-02-23T08:35:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836589 1-38654705771 2-55834574953' 2026-02-23T08:35:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:15.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836589 2026-02-23T08:35:15.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:15.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:15.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836589 2026-02-23T08:35:15.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:15.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836589 2026-02-23T08:35:15.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836589' 2026-02-23T08:35:15.030 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836589 2026-02-23T08:35:15.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:15.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836589 -lt 21474836589 2026-02-23T08:35:15.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:15.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705771 2026-02-23T08:35:15.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:15.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:15.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705771 2026-02-23T08:35:15.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:15.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705771 2026-02-23T08:35:15.203 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705771 2026-02-23T08:35:15.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705771' 2026-02-23T08:35:15.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:15.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705770 -lt 38654705771 2026-02-23T08:35:15.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:16.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:16.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:16.535 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705770 -lt 38654705771 2026-02-23T08:35:16.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:17.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:35:17.537 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:17.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705773 -lt 38654705771 2026-02-23T08:35:17.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:17.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574953 2026-02-23T08:35:17.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:17.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:17.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574953 2026-02-23T08:35:17.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:17.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574953 2026-02-23T08:35:17.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574953' 2026-02-23T08:35:17.710 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574953 2026-02-23T08:35:17.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:17.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574955 -lt 55834574953 2026-02-23T08:35:17.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:17.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:17.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:18.025 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:18.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:18.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:18.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:18.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:18.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:18.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:18.200 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:18.200 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:18.200 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:18.201 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:18.201 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:18.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836594 2026-02-23T08:35:18.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836594 2026-02-23T08:35:18.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836594' 2026-02-23T08:35:18.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:18.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:18.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705775 2026-02-23T08:35:18.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705775 2026-02-23T08:35:18.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836594 1-38654705775' 2026-02-23T08:35:18.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:18.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:18.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574957 2026-02-23T08:35:18.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574957 2026-02-23T08:35:18.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836594 1-38654705775 2-55834574957' 2026-02-23T08:35:18.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:18.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836594 2026-02-23T08:35:18.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:18.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:18.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836594 2026-02-23T08:35:18.426 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:18.427 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836594 2026-02-23T08:35:18.427 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836594 2026-02-23T08:35:18.428 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836594' 2026-02-23T08:35:18.428 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:18.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836591 -lt 21474836594 2026-02-23T08:35:18.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:19.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:19.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:19.759 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836594 -lt 21474836594 2026-02-23T08:35:19.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:19.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705775 2026-02-23T08:35:19.760 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:19.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:19.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705775 2026-02-23T08:35:19.762 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:19.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705775 2026-02-23T08:35:19.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705775' 2026-02-23T08:35:19.763 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705775 2026-02-23T08:35:19.763 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:19.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705776 -lt 38654705775 2026-02-23T08:35:19.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:19.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574957 2026-02-23T08:35:19.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:19.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:19.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574957 2026-02-23T08:35:19.928 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:19.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574957 2026-02-23T08:35:19.929 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574957 2026-02-23T08:35:19.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574957' 2026-02-23T08:35:19.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:20.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574958 -lt 55834574957 2026-02-23T08:35:20.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:20.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:20.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:20.244 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:20.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:20.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:20.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:20.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:20.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:20.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:20.417 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:20.417 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:20.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:20.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:20.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:20.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836597 2026-02-23T08:35:20.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836597 2026-02-23T08:35:20.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836597' 2026-02-23T08:35:20.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:20.490 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:20.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705779 2026-02-23T08:35:20.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705779 2026-02-23T08:35:20.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836597 1-38654705779' 2026-02-23T08:35:20.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:20.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:20.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574961 2026-02-23T08:35:20.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574961 2026-02-23T08:35:20.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836597 1-38654705779 2-55834574961' 2026-02-23T08:35:20.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:20.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836597 2026-02-23T08:35:20.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:20.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:20.639 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836597 2026-02-23T08:35:20.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:20.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836597 2026-02-23T08:35:20.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836597' 2026-02-23T08:35:20.641 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836597 2026-02-23T08:35:20.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:20.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836594 -lt 21474836597 2026-02-23T08:35:20.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:21.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:21.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:21.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836597 -lt 21474836597 2026-02-23T08:35:21.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:21.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705779 2026-02-23T08:35:21.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:21.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:21.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705779 2026-02-23T08:35:21.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:21.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705779 2026-02-23T08:35:21.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705779' 2026-02-23T08:35:21.976 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705779 2026-02-23T08:35:21.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:22.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705779 -lt 38654705779 2026-02-23T08:35:22.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:22.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574961 2026-02-23T08:35:22.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:22.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:22.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574961 2026-02-23T08:35:22.141 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:22.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574961 2026-02-23T08:35:22.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574961' 2026-02-23T08:35:22.142 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574961 2026-02-23T08:35:22.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:22.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574961 -lt 55834574961 2026-02-23T08:35:22.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:22.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:22.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:22.460 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:22.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:22.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:22.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:22.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:22.472 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:22.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:22.638 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:22.638 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:22.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:22.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:22.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:22.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836600 2026-02-23T08:35:22.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836600 2026-02-23T08:35:22.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836600' 2026-02-23T08:35:22.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:22.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:22.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705782 2026-02-23T08:35:22.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705782 2026-02-23T08:35:22.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836600 1-38654705782' 2026-02-23T08:35:22.786 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:22.786 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:22.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574964 2026-02-23T08:35:22.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574964 2026-02-23T08:35:22.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836600 1-38654705782 2-55834574964' 2026-02-23T08:35:22.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:22.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836600 2026-02-23T08:35:22.859 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:22.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:22.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836600 2026-02-23T08:35:22.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:22.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836600 2026-02-23T08:35:22.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836600' 2026-02-23T08:35:22.862 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836600 2026-02-23T08:35:22.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:23.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836600 -lt 21474836600 2026-02-23T08:35:23.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:23.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705782 2026-02-23T08:35:23.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:23.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:23.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705782 2026-02-23T08:35:23.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:23.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705782 2026-02-23T08:35:23.029 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705782 2026-02-23T08:35:23.029 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705782' 2026-02-23T08:35:23.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:23.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705782 -lt 38654705782 2026-02-23T08:35:23.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:23.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574964 2026-02-23T08:35:23.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:23.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:23.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574964 2026-02-23T08:35:23.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:23.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574964 2026-02-23T08:35:23.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574964' 2026-02-23T08:35:23.199 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574964 2026-02-23T08:35:23.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:23.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574964 -lt 55834574964 2026-02-23T08:35:23.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:23.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:23.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:23.518 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:23.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:23.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:23.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:23.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:23.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:23.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:23.695 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:23.695 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:23.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:23.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:23.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:23.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836602 2026-02-23T08:35:23.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836602 2026-02-23T08:35:23.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836602' 2026-02-23T08:35:23.770 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:23.770 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:23.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705784 2026-02-23T08:35:23.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705784 2026-02-23T08:35:23.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836602 1-38654705784' 2026-02-23T08:35:23.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:23.845 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:23.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574966 2026-02-23T08:35:23.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574966 2026-02-23T08:35:23.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836602 1-38654705784 2-55834574966' 2026-02-23T08:35:23.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:23.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836602 2026-02-23T08:35:23.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:23.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:23.922 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836602 2026-02-23T08:35:23.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:23.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836602 2026-02-23T08:35:23.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836602' 2026-02-23T08:35:23.924 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836602 2026-02-23T08:35:23.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:24.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836600 -lt 21474836602 2026-02-23T08:35:24.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:25.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:25.094 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:25.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836603 -lt 21474836602 2026-02-23T08:35:25.261 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:25.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705784 2026-02-23T08:35:25.261 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:25.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:25.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705784 2026-02-23T08:35:25.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:25.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705784 2026-02-23T08:35:25.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705784' 2026-02-23T08:35:25.264 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705784 2026-02-23T08:35:25.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:25.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705785 -lt 38654705784 2026-02-23T08:35:25.430 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:25.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574966 2026-02-23T08:35:25.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:25.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:25.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574966 2026-02-23T08:35:25.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:25.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574966 2026-02-23T08:35:25.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574966' 2026-02-23T08:35:25.433 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574966 2026-02-23T08:35:25.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:25.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574967 -lt 55834574966 2026-02-23T08:35:25.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:25.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:25.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:25.749 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:25.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:25.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:25.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:25.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:25.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:25.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:25.923 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:25.923 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:25.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:25.923 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:25.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:25.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836605 2026-02-23T08:35:25.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836605 2026-02-23T08:35:25.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836605' 2026-02-23T08:35:25.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:25.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:26.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705787 2026-02-23T08:35:26.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705787 2026-02-23T08:35:26.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836605 1-38654705787' 2026-02-23T08:35:26.067 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:26.067 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:26.137 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574969 2026-02-23T08:35:26.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574969 2026-02-23T08:35:26.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836605 1-38654705787 2-55834574969' 2026-02-23T08:35:26.138 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:26.138 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836605 2026-02-23T08:35:26.139 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:26.139 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:26.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836605 2026-02-23T08:35:26.140 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:26.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836605 2026-02-23T08:35:26.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836605' 2026-02-23T08:35:26.142 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836605 2026-02-23T08:35:26.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:26.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836603 -lt 21474836605 2026-02-23T08:35:26.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:27.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:27.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:27.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836606 -lt 21474836605 2026-02-23T08:35:27.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:27.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705787 2026-02-23T08:35:27.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:27.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:27.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705787 2026-02-23T08:35:27.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:27.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705787 2026-02-23T08:35:27.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705787' 2026-02-23T08:35:27.483 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705787 2026-02-23T08:35:27.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:27.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705788 -lt 38654705787 2026-02-23T08:35:27.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:27.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574969 2026-02-23T08:35:27.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:27.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:27.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574969 2026-02-23T08:35:27.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:27.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574969 2026-02-23T08:35:27.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574969' 2026-02-23T08:35:27.651 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574969 2026-02-23T08:35:27.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:27.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574970 -lt 55834574969 2026-02-23T08:35:27.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:27.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:27.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:27.968 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:27.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:27.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:27.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:27.980 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:27.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:28.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:28.146 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:28.147 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:28.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:28.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:28.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:28.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836609 2026-02-23T08:35:28.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836609 2026-02-23T08:35:28.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836609' 2026-02-23T08:35:28.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:28.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:28.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705790 2026-02-23T08:35:28.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705790 2026-02-23T08:35:28.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836609 1-38654705790' 2026-02-23T08:35:28.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:28.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:28.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574972 2026-02-23T08:35:28.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574972 2026-02-23T08:35:28.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836609 1-38654705790 2-55834574972' 2026-02-23T08:35:28.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:28.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836609 2026-02-23T08:35:28.362 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:28.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836609 2026-02-23T08:35:28.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:28.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836609 2026-02-23T08:35:28.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836609' 2026-02-23T08:35:28.364 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836609 2026-02-23T08:35:28.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:28.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836606 -lt 21474836609 2026-02-23T08:35:28.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:29.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:29.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:29.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836609 -lt 21474836609 2026-02-23T08:35:29.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:29.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705790 2026-02-23T08:35:29.698 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:29.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:29.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705790 2026-02-23T08:35:29.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:29.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705790 2026-02-23T08:35:29.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705790' 2026-02-23T08:35:29.701 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705790 2026-02-23T08:35:29.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:29.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705791 -lt 38654705790 2026-02-23T08:35:29.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:29.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574972 2026-02-23T08:35:29.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:29.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:29.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574972 2026-02-23T08:35:29.868 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:29.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574972 2026-02-23T08:35:29.869 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574972 2026-02-23T08:35:29.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574972' 2026-02-23T08:35:29.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:30.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574973 -lt 55834574972 2026-02-23T08:35:30.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:30.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:30.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:30.181 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:30.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:30.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:30.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:30.192 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:30.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:30.360 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:30.361 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:30.361 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:30.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:30.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:30.361 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:30.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836612 2026-02-23T08:35:30.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836612 2026-02-23T08:35:30.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836612' 2026-02-23T08:35:30.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:30.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:30.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705794 2026-02-23T08:35:30.509 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705794 2026-02-23T08:35:30.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836612 1-38654705794' 2026-02-23T08:35:30.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:30.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:30.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574975 2026-02-23T08:35:30.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574975 2026-02-23T08:35:30.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836612 1-38654705794 2-55834574975' 2026-02-23T08:35:30.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:30.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836612 2026-02-23T08:35:30.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:30.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:30.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836612 2026-02-23T08:35:30.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:30.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836612 2026-02-23T08:35:30.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836612' 2026-02-23T08:35:30.586 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836612 2026-02-23T08:35:30.587 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:30.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836609 -lt 21474836612 2026-02-23T08:35:30.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:31.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:31.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:31.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836612 -lt 21474836612 2026-02-23T08:35:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:31.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705794 2026-02-23T08:35:31.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:31.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:31.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705794 2026-02-23T08:35:31.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:31.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705794 2026-02-23T08:35:31.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705794' 2026-02-23T08:35:31.921 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705794 2026-02-23T08:35:31.921 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:32.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705794 -lt 38654705794 2026-02-23T08:35:32.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:32.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574975 2026-02-23T08:35:32.086 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:32.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:32.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574975 2026-02-23T08:35:32.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:32.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574975 2026-02-23T08:35:32.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574975' 2026-02-23T08:35:32.089 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574975 2026-02-23T08:35:32.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:32.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574976 -lt 55834574975 2026-02-23T08:35:32.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:32.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:32.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:32.406 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:32.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:32.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:32.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:32.419 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:32.419 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:32.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:32.585 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:32.585 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:32.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:32.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:32.585 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:32.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836615 2026-02-23T08:35:32.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836615 2026-02-23T08:35:32.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836615' 2026-02-23T08:35:32.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:32.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:32.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705797 2026-02-23T08:35:32.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705797 2026-02-23T08:35:32.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836615 1-38654705797' 2026-02-23T08:35:32.731 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:32.732 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:32.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574979 2026-02-23T08:35:32.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574979 2026-02-23T08:35:32.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836615 1-38654705797 2-55834574979' 2026-02-23T08:35:32.806 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:32.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836615 2026-02-23T08:35:32.806 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:32.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:32.807 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836615 2026-02-23T08:35:32.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:32.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836615 2026-02-23T08:35:32.809 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836615 2026-02-23T08:35:32.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836615' 2026-02-23T08:35:32.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:32.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836612 -lt 21474836615 2026-02-23T08:35:32.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:33.977 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:33.978 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:34.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836615 -lt 21474836615 2026-02-23T08:35:34.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:34.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705797 2026-02-23T08:35:34.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:34.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:34.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705797 2026-02-23T08:35:34.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:34.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705797 2026-02-23T08:35:34.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705797' 2026-02-23T08:35:34.151 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705797 2026-02-23T08:35:34.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:34.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705797 -lt 38654705797 2026-02-23T08:35:34.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:34.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574979 2026-02-23T08:35:34.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:34.319 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:34.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574979 2026-02-23T08:35:34.319 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:34.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574979 2026-02-23T08:35:34.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574979' 2026-02-23T08:35:34.320 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574979 2026-02-23T08:35:34.321 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:34.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574979 -lt 55834574979 2026-02-23T08:35:34.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:34.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:34.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:34.636 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:34.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:34.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:34.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:34.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:34.815 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:34.815 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:34.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:34.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:34.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:34.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836618 2026-02-23T08:35:34.888 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836618 2026-02-23T08:35:34.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836618' 2026-02-23T08:35:34.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:34.889 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:34.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705800 2026-02-23T08:35:34.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705800 2026-02-23T08:35:34.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836618 1-38654705800' 2026-02-23T08:35:34.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:34.962 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:35.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574982 2026-02-23T08:35:35.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574982 2026-02-23T08:35:35.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836618 1-38654705800 2-55834574982' 2026-02-23T08:35:35.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:35.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836618 2026-02-23T08:35:35.039 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:35.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:35.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836618 2026-02-23T08:35:35.040 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:35.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836618 2026-02-23T08:35:35.041 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836618 2026-02-23T08:35:35.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836618' 2026-02-23T08:35:35.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836618 -lt 21474836618 2026-02-23T08:35:35.204 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:35.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705800 2026-02-23T08:35:35.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:35.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:35.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705800 2026-02-23T08:35:35.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:35.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705800 2026-02-23T08:35:35.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705800' 2026-02-23T08:35:35.207 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705800 2026-02-23T08:35:35.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:35.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705799 -lt 38654705800 2026-02-23T08:35:35.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:36.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:36.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:36.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705799 -lt 38654705800 2026-02-23T08:35:36.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:37.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:35:37.541 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:37.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705802 -lt 38654705800 2026-02-23T08:35:37.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:37.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574982 2026-02-23T08:35:37.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:37.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:37.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574982 2026-02-23T08:35:37.712 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574982 2026-02-23T08:35:37.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574982' 2026-02-23T08:35:37.713 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574982 2026-02-23T08:35:37.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574984 -lt 55834574982 2026-02-23T08:35:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:37.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:38.034 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:38.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:38.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:38.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:38.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:38.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:38.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:38.213 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:38.213 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:38.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:38.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:38.214 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:38.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836623 2026-02-23T08:35:38.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836623 2026-02-23T08:35:38.290 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836623' 2026-02-23T08:35:38.291 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:38.291 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:38.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705804 2026-02-23T08:35:38.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705804 2026-02-23T08:35:38.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836623 1-38654705804' 2026-02-23T08:35:38.364 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:38.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:38.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574986 2026-02-23T08:35:38.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574986 2026-02-23T08:35:38.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836623 1-38654705804 2-55834574986' 2026-02-23T08:35:38.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:38.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836623 2026-02-23T08:35:38.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:38.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:38.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836623 2026-02-23T08:35:38.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:38.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836623 2026-02-23T08:35:38.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836623' 2026-02-23T08:35:38.441 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836623 2026-02-23T08:35:38.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:38.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836620 -lt 21474836623 2026-02-23T08:35:38.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:39.607 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:39.608 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:39.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836623 -lt 21474836623 2026-02-23T08:35:39.773 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:39.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705804 2026-02-23T08:35:39.773 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:39.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:39.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705804 2026-02-23T08:35:39.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:39.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705804 2026-02-23T08:35:39.776 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705804 2026-02-23T08:35:39.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705804' 2026-02-23T08:35:39.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:39.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705805 -lt 38654705804 2026-02-23T08:35:39.942 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:39.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574986 2026-02-23T08:35:39.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:39.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:39.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574986 2026-02-23T08:35:39.944 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:39.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574986 2026-02-23T08:35:39.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574986' 2026-02-23T08:35:39.945 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574986 2026-02-23T08:35:39.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:40.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574987 -lt 55834574986 2026-02-23T08:35:40.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:40.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:40.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:40.262 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:40.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:40.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:40.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:40.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:40.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:40.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:40.439 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:40.439 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:40.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:40.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:40.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:40.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836626 2026-02-23T08:35:40.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836626 2026-02-23T08:35:40.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836626' 2026-02-23T08:35:40.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:40.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:40.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705808 2026-02-23T08:35:40.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705808 2026-02-23T08:35:40.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836626 1-38654705808' 2026-02-23T08:35:40.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:40.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:40.655 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574990 2026-02-23T08:35:40.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574990 2026-02-23T08:35:40.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836626 1-38654705808 2-55834574990' 2026-02-23T08:35:40.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:40.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836626 2026-02-23T08:35:40.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:40.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:40.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836626 2026-02-23T08:35:40.657 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:40.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836626 2026-02-23T08:35:40.658 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836626' 2026-02-23T08:35:40.658 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836626 2026-02-23T08:35:40.659 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:40.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836623 -lt 21474836626 2026-02-23T08:35:40.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:41.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:41.825 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:41.991 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836626 -lt 21474836626 2026-02-23T08:35:41.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:41.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705808 2026-02-23T08:35:41.992 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:41.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:41.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705808 2026-02-23T08:35:41.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:41.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705808 2026-02-23T08:35:41.995 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705808 2026-02-23T08:35:41.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705808' 2026-02-23T08:35:41.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:42.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705808 -lt 38654705808 2026-02-23T08:35:42.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:42.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574990 2026-02-23T08:35:42.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:42.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:42.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574990 2026-02-23T08:35:42.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:42.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574990 2026-02-23T08:35:42.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574990' 2026-02-23T08:35:42.164 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574990 2026-02-23T08:35:42.164 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:42.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574990 -lt 55834574990 2026-02-23T08:35:42.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:42.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:42.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:42.480 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:42.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:42.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:42.491 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:42.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:42.492 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:42.654 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:42.654 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:42.654 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:42.654 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836629 2026-02-23T08:35:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836629 2026-02-23T08:35:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836629' 2026-02-23T08:35:42.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:42.726 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:42.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705811 2026-02-23T08:35:42.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705811 2026-02-23T08:35:42.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836629 1-38654705811' 2026-02-23T08:35:42.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:42.801 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574993 2026-02-23T08:35:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574993 2026-02-23T08:35:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836629 1-38654705811 2-55834574993' 2026-02-23T08:35:42.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:42.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836629 2026-02-23T08:35:42.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:42.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:42.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836629 2026-02-23T08:35:42.877 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:42.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836629 2026-02-23T08:35:42.878 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836629 2026-02-23T08:35:42.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836629' 2026-02-23T08:35:42.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:43.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836629 -lt 21474836629 2026-02-23T08:35:43.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:43.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705811 2026-02-23T08:35:43.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:43.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:43.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705811 2026-02-23T08:35:43.046 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:43.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705811 2026-02-23T08:35:43.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705811' 2026-02-23T08:35:43.047 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705811 2026-02-23T08:35:43.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:43.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705811 -lt 38654705811 2026-02-23T08:35:43.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:43.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574993 2026-02-23T08:35:43.215 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:43.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:43.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574993 2026-02-23T08:35:43.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:43.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574993 2026-02-23T08:35:43.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574993' 2026-02-23T08:35:43.218 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574993 2026-02-23T08:35:43.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574993 -lt 55834574993 2026-02-23T08:35:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:43.533 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:43.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:43.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:43.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:43.545 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:43.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:43.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:43.709 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:43.710 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:43.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:43.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:43.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836631 2026-02-23T08:35:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836631 2026-02-23T08:35:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836631' 2026-02-23T08:35:43.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:43.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705813 2026-02-23T08:35:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705813 2026-02-23T08:35:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836631 1-38654705813' 2026-02-23T08:35:43.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:43.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:43.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574995 2026-02-23T08:35:43.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574995 2026-02-23T08:35:43.929 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836631 1-38654705813 2-55834574995' 2026-02-23T08:35:43.930 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:43.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836631 2026-02-23T08:35:43.930 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:43.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:43.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836631 2026-02-23T08:35:43.931 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:43.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836631 2026-02-23T08:35:43.933 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836631 2026-02-23T08:35:43.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836631' 2026-02-23T08:35:43.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836629 -lt 21474836631 2026-02-23T08:35:44.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:45.096 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:45.096 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:45.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836632 -lt 21474836631 2026-02-23T08:35:45.262 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:45.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705813 2026-02-23T08:35:45.263 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:45.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:45.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705813 2026-02-23T08:35:45.264 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:45.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705813 2026-02-23T08:35:45.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705813' 2026-02-23T08:35:45.266 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705813 2026-02-23T08:35:45.266 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:45.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705814 -lt 38654705813 2026-02-23T08:35:45.431 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:45.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574995 2026-02-23T08:35:45.431 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:45.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:45.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574995 2026-02-23T08:35:45.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:45.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574995 2026-02-23T08:35:45.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574995' 2026-02-23T08:35:45.435 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574995 2026-02-23T08:35:45.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574996 -lt 55834574995 2026-02-23T08:35:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:45.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:45.749 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:45.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:45.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:45.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:45.927 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:45.927 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:45.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:45.927 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:45.927 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:45.999 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836634 2026-02-23T08:35:46.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836634 2026-02-23T08:35:46.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836634' 2026-02-23T08:35:46.000 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:46.000 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:46.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705816 2026-02-23T08:35:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705816 2026-02-23T08:35:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836634 1-38654705816' 2026-02-23T08:35:46.073 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:46.073 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:46.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574998 2026-02-23T08:35:46.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574998 2026-02-23T08:35:46.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836634 1-38654705816 2-55834574998' 2026-02-23T08:35:46.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:46.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836634 2026-02-23T08:35:46.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:46.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:46.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836634 2026-02-23T08:35:46.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:46.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836634 2026-02-23T08:35:46.148 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836634 2026-02-23T08:35:46.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836634' 2026-02-23T08:35:46.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:46.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836632 -lt 21474836634 2026-02-23T08:35:46.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:47.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:47.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836635 -lt 21474836634 2026-02-23T08:35:47.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:47.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705816 2026-02-23T08:35:47.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:47.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:47.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705816 2026-02-23T08:35:47.481 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:47.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705816 2026-02-23T08:35:47.482 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705816' 2026-02-23T08:35:47.483 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705816 2026-02-23T08:35:47.483 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:47.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705817 -lt 38654705816 2026-02-23T08:35:47.646 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:47.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574998 2026-02-23T08:35:47.646 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:47.647 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:47.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574998 2026-02-23T08:35:47.648 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:47.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574998 2026-02-23T08:35:47.649 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834574998 2026-02-23T08:35:47.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574998' 2026-02-23T08:35:47.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:47.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574999 -lt 55834574998 2026-02-23T08:35:47.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:47.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:47.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:47.967 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:47.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:47.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:47.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:47.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:47.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:48.146 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:48.146 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:48.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:48.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:48.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836638 2026-02-23T08:35:48.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836638 2026-02-23T08:35:48.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836638' 2026-02-23T08:35:48.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:48.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:48.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705819 2026-02-23T08:35:48.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705819 2026-02-23T08:35:48.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836638 1-38654705819' 2026-02-23T08:35:48.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:48.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:48.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575001 2026-02-23T08:35:48.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575001 2026-02-23T08:35:48.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836638 1-38654705819 2-55834575001' 2026-02-23T08:35:48.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:48.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836638 2026-02-23T08:35:48.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:48.368 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:48.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836638 2026-02-23T08:35:48.369 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:48.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836638 2026-02-23T08:35:48.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836638' 2026-02-23T08:35:48.370 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836638 2026-02-23T08:35:48.370 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:48.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836635 -lt 21474836638 2026-02-23T08:35:48.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:49.533 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:49.534 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:49.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836638 -lt 21474836638 2026-02-23T08:35:49.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:49.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705819 2026-02-23T08:35:49.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:49.700 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:49.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705819 2026-02-23T08:35:49.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:49.702 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705819 2026-02-23T08:35:49.703 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705819 2026-02-23T08:35:49.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705819' 2026-02-23T08:35:49.703 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:49.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705820 -lt 38654705819 2026-02-23T08:35:49.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:49.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575001 2026-02-23T08:35:49.869 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:49.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:49.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575001 2026-02-23T08:35:49.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:49.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575001 2026-02-23T08:35:49.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575001' 2026-02-23T08:35:49.872 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575001 2026-02-23T08:35:49.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:50.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575002 -lt 55834575001 2026-02-23T08:35:50.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:50.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:50.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:50.185 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:50.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:50.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:50.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:50.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:50.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:50.359 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:50.359 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:50.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:50.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:50.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836641 2026-02-23T08:35:50.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836641 2026-02-23T08:35:50.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836641' 2026-02-23T08:35:50.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:50.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:50.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705823 2026-02-23T08:35:50.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705823 2026-02-23T08:35:50.506 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836641 1-38654705823' 2026-02-23T08:35:50.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:50.507 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575004 2026-02-23T08:35:50.578 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575004 2026-02-23T08:35:50.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836641 1-38654705823 2-55834575004' 2026-02-23T08:35:50.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:50.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836641 2026-02-23T08:35:50.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:50.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:50.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836641 2026-02-23T08:35:50.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:50.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836641 2026-02-23T08:35:50.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836641' 2026-02-23T08:35:50.582 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836641 2026-02-23T08:35:50.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:50.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836638 -lt 21474836641 2026-02-23T08:35:50.743 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:51.744 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:51.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:51.913 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836641 -lt 21474836641 2026-02-23T08:35:51.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:51.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705823 2026-02-23T08:35:51.914 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:51.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:51.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705823 2026-02-23T08:35:51.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:51.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705823 2026-02-23T08:35:51.917 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705823' 2026-02-23T08:35:51.917 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705823 2026-02-23T08:35:51.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:52.080 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705823 -lt 38654705823 2026-02-23T08:35:52.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:52.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575004 2026-02-23T08:35:52.081 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:52.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:52.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575004 2026-02-23T08:35:52.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:52.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575004 2026-02-23T08:35:52.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575004' 2026-02-23T08:35:52.084 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575004 2026-02-23T08:35:52.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:52.250 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575005 -lt 55834575004 2026-02-23T08:35:52.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:52.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:52.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:52.401 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:52.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:52.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:52.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:52.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:52.413 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:52.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:52.579 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:52.579 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:52.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:52.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:52.579 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:52.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836644 2026-02-23T08:35:52.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836644 2026-02-23T08:35:52.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836644' 2026-02-23T08:35:52.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:52.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:52.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705826 2026-02-23T08:35:52.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705826 2026-02-23T08:35:52.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836644 1-38654705826' 2026-02-23T08:35:52.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:52.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:52.798 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575008 2026-02-23T08:35:52.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575008 2026-02-23T08:35:52.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836644 1-38654705826 2-55834575008' 2026-02-23T08:35:52.799 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:52.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836644 2026-02-23T08:35:52.799 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:52.800 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:52.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836644 2026-02-23T08:35:52.800 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:52.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836644 2026-02-23T08:35:52.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836644' 2026-02-23T08:35:52.802 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836644 2026-02-23T08:35:52.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:52.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836641 -lt 21474836644 2026-02-23T08:35:52.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:53.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:53.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:54.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836644 -lt 21474836644 2026-02-23T08:35:54.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:54.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705826 2026-02-23T08:35:54.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:54.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:54.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705826 2026-02-23T08:35:54.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:54.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705826 2026-02-23T08:35:54.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705826' 2026-02-23T08:35:54.145 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705826 2026-02-23T08:35:54.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:54.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705826 -lt 38654705826 2026-02-23T08:35:54.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:54.307 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575008 2026-02-23T08:35:54.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:54.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:54.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575008 2026-02-23T08:35:54.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:54.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575008 2026-02-23T08:35:54.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575008' 2026-02-23T08:35:54.310 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575008 2026-02-23T08:35:54.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:54.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575008 -lt 55834575008 2026-02-23T08:35:54.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:54.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:54.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:54.625 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:54.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:54.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:54.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:54.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:54.636 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:54.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:54.804 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:54.804 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:54.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:54.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:54.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:54.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836647 2026-02-23T08:35:54.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836647 2026-02-23T08:35:54.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836647' 2026-02-23T08:35:54.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:54.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705829 2026-02-23T08:35:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705829 2026-02-23T08:35:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836647 1-38654705829' 2026-02-23T08:35:54.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:54.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:55.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575011 2026-02-23T08:35:55.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575011 2026-02-23T08:35:55.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836647 1-38654705829 2-55834575011' 2026-02-23T08:35:55.025 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:55.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836647 2026-02-23T08:35:55.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:55.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:55.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836647 2026-02-23T08:35:55.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:55.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836647 2026-02-23T08:35:55.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836647' 2026-02-23T08:35:55.028 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836647 2026-02-23T08:35:55.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:55.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836647 -lt 21474836647 2026-02-23T08:35:55.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:55.194 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705829 2026-02-23T08:35:55.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:55.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:55.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705829 2026-02-23T08:35:55.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705829 2026-02-23T08:35:55.197 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705829' 2026-02-23T08:35:55.197 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705829 2026-02-23T08:35:55.198 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:55.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705828 -lt 38654705829 2026-02-23T08:35:55.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:56.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:56.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:56.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705828 -lt 38654705829 2026-02-23T08:35:56.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:57.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:35:57.532 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:57.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705831 -lt 38654705829 2026-02-23T08:35:57.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:57.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575011 2026-02-23T08:35:57.700 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:57.701 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:57.701 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575011 2026-02-23T08:35:57.702 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:57.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575011 2026-02-23T08:35:57.703 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575011' 2026-02-23T08:35:57.703 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575011 2026-02-23T08:35:57.704 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:35:57.868 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575013 -lt 55834575011 2026-02-23T08:35:57.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:35:57.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:35:57.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:35:58.019 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:35:58.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:35:58.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:35:58.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:35:58.031 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:35:58.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:35:58.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:35:58.193 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:35:58.193 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:35:58.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:35:58.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:58.193 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:35:58.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836652 2026-02-23T08:35:58.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836652 2026-02-23T08:35:58.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836652' 2026-02-23T08:35:58.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:58.268 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:35:58.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705833 2026-02-23T08:35:58.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705833 2026-02-23T08:35:58.339 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836652 1-38654705833' 2026-02-23T08:35:58.340 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:35:58.340 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:35:58.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575015 2026-02-23T08:35:58.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575015 2026-02-23T08:35:58.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836652 1-38654705833 2-55834575015' 2026-02-23T08:35:58.414 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:58.414 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836652 2026-02-23T08:35:58.415 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:58.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:35:58.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836652 2026-02-23T08:35:58.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:58.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836652 2026-02-23T08:35:58.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836652' 2026-02-23T08:35:58.417 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836652 2026-02-23T08:35:58.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:58.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836649 -lt 21474836652 2026-02-23T08:35:58.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:35:59.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:35:59.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:35:59.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836652 -lt 21474836652 2026-02-23T08:35:59.750 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:59.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705833 2026-02-23T08:35:59.751 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:59.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:35:59.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705833 2026-02-23T08:35:59.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:59.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705833 2026-02-23T08:35:59.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705833' 2026-02-23T08:35:59.754 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705833 2026-02-23T08:35:59.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:35:59.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705834 -lt 38654705833 2026-02-23T08:35:59.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:35:59.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575015 2026-02-23T08:35:59.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:35:59.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:35:59.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575015 2026-02-23T08:35:59.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:35:59.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575015 2026-02-23T08:35:59.922 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575015' 2026-02-23T08:35:59.922 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575015 2026-02-23T08:35:59.923 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:00.087 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575016 -lt 55834575015 2026-02-23T08:36:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:00.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:00.241 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:00.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:00.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:00.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:00.252 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:00.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:00.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:00.416 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:00.416 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:00.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:00.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:00.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:00.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836655 2026-02-23T08:36:00.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836655 2026-02-23T08:36:00.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836655' 2026-02-23T08:36:00.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:00.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:00.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705837 2026-02-23T08:36:00.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705837 2026-02-23T08:36:00.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836655 1-38654705837' 2026-02-23T08:36:00.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:00.567 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:00.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575019 2026-02-23T08:36:00.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575019 2026-02-23T08:36:00.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836655 1-38654705837 2-55834575019' 2026-02-23T08:36:00.641 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:00.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836655 2026-02-23T08:36:00.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:00.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:00.642 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836655 2026-02-23T08:36:00.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:00.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836655 2026-02-23T08:36:00.643 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836655 2026-02-23T08:36:00.644 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836655' 2026-02-23T08:36:00.644 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:00.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836652 -lt 21474836655 2026-02-23T08:36:00.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:01.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:01.808 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:01.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836655 -lt 21474836655 2026-02-23T08:36:01.973 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:01.973 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705837 2026-02-23T08:36:01.974 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:01.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:01.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705837 2026-02-23T08:36:01.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705837 2026-02-23T08:36:01.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705837' 2026-02-23T08:36:01.976 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705837 2026-02-23T08:36:01.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:02.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705837 -lt 38654705837 2026-02-23T08:36:02.141 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:02.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575019 2026-02-23T08:36:02.142 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:02.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:02.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575019 2026-02-23T08:36:02.143 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:02.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575019 2026-02-23T08:36:02.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575019' 2026-02-23T08:36:02.145 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575019 2026-02-23T08:36:02.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:02.306 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575019 -lt 55834575019 2026-02-23T08:36:02.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:02.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:02.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:02.462 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:02.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:02.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:02.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:02.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:02.475 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:02.637 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:02.637 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:02.638 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:02.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:02.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:02.638 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:02.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836658 2026-02-23T08:36:02.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836658 2026-02-23T08:36:02.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836658' 2026-02-23T08:36:02.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:02.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:02.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705840 2026-02-23T08:36:02.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705840 2026-02-23T08:36:02.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836658 1-38654705840' 2026-02-23T08:36:02.784 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:02.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575022 2026-02-23T08:36:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575022 2026-02-23T08:36:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836658 1-38654705840 2-55834575022' 2026-02-23T08:36:02.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:02.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836658 2026-02-23T08:36:02.858 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:02.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:02.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836658 2026-02-23T08:36:02.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:02.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836658 2026-02-23T08:36:02.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836658' 2026-02-23T08:36:02.861 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836658 2026-02-23T08:36:02.862 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:03.026 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836658 -lt 21474836658 2026-02-23T08:36:03.027 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:03.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705840 2026-02-23T08:36:03.027 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:03.028 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:03.028 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705840 2026-02-23T08:36:03.029 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:03.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705840 2026-02-23T08:36:03.030 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705840' 2026-02-23T08:36:03.030 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705840 2026-02-23T08:36:03.031 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:03.194 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705840 -lt 38654705840 2026-02-23T08:36:03.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:03.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575022 2026-02-23T08:36:03.195 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:03.196 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:03.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575022 2026-02-23T08:36:03.197 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:03.198 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575022 2026-02-23T08:36:03.198 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575022 2026-02-23T08:36:03.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575022' 2026-02-23T08:36:03.199 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:03.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575022 -lt 55834575022 2026-02-23T08:36:03.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:03.366 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:03.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:03.518 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:03.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:03.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:03.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:03.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:03.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:03.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:03.699 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:03.699 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:03.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:03.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:03.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:03.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836660 2026-02-23T08:36:03.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836660 2026-02-23T08:36:03.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836660' 2026-02-23T08:36:03.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:03.772 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:03.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705842 2026-02-23T08:36:03.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705842 2026-02-23T08:36:03.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836660 1-38654705842' 2026-02-23T08:36:03.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:03.844 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:03.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575024 2026-02-23T08:36:03.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575024 2026-02-23T08:36:03.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836660 1-38654705842 2-55834575024' 2026-02-23T08:36:03.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:03.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836660 2026-02-23T08:36:03.916 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:03.916 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:03.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836660 2026-02-23T08:36:03.917 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:03.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836660 2026-02-23T08:36:03.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836660' 2026-02-23T08:36:03.919 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836660 2026-02-23T08:36:03.919 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:04.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836658 -lt 21474836660 2026-02-23T08:36:04.085 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:05.086 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:05.087 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836661 -lt 21474836660 2026-02-23T08:36:05.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:05.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705842 2026-02-23T08:36:05.252 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:05.253 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:05.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705842 2026-02-23T08:36:05.253 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:05.254 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705842 2026-02-23T08:36:05.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705842' 2026-02-23T08:36:05.255 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705842 2026-02-23T08:36:05.255 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:05.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705843 -lt 38654705842 2026-02-23T08:36:05.420 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:05.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575024 2026-02-23T08:36:05.421 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:05.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:05.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575024 2026-02-23T08:36:05.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:05.423 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575024 2026-02-23T08:36:05.424 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575024 2026-02-23T08:36:05.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575024' 2026-02-23T08:36:05.424 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:05.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575025 -lt 55834575024 2026-02-23T08:36:05.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:05.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:05.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:05.742 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:05.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:05.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:05.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:05.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:05.754 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:05.919 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:05.920 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:05.920 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:05.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:05.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:05.920 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:05.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836663 2026-02-23T08:36:05.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836663 2026-02-23T08:36:05.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836663' 2026-02-23T08:36:05.995 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:05.995 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:06.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705845 2026-02-23T08:36:06.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705845 2026-02-23T08:36:06.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836663 1-38654705845' 2026-02-23T08:36:06.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:06.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:06.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575027 2026-02-23T08:36:06.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575027 2026-02-23T08:36:06.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836663 1-38654705845 2-55834575027' 2026-02-23T08:36:06.144 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:06.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836663 2026-02-23T08:36:06.145 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:06.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:06.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836663 2026-02-23T08:36:06.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:06.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836663 2026-02-23T08:36:06.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836663' 2026-02-23T08:36:06.147 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836663 2026-02-23T08:36:06.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:06.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836661 -lt 21474836663 2026-02-23T08:36:06.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:07.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:07.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:07.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836664 -lt 21474836663 2026-02-23T08:36:07.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:07.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705845 2026-02-23T08:36:07.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:07.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:07.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705845 2026-02-23T08:36:07.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:07.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705845 2026-02-23T08:36:07.479 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705845' 2026-02-23T08:36:07.479 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705845 2026-02-23T08:36:07.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:07.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705846 -lt 38654705845 2026-02-23T08:36:07.649 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:07.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575027 2026-02-23T08:36:07.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:07.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:07.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575027 2026-02-23T08:36:07.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:07.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575027 2026-02-23T08:36:07.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575027' 2026-02-23T08:36:07.652 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575027 2026-02-23T08:36:07.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:07.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575028 -lt 55834575027 2026-02-23T08:36:07.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:07.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:07.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:07.970 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:07.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:07.981 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:07.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:07.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:07.982 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:08.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:08.149 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:08.149 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:08.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:08.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:08.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:08.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836667 2026-02-23T08:36:08.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836667 2026-02-23T08:36:08.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836667' 2026-02-23T08:36:08.222 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:08.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:08.296 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705848 2026-02-23T08:36:08.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705848 2026-02-23T08:36:08.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836667 1-38654705848' 2026-02-23T08:36:08.297 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:08.297 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:08.370 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575030 2026-02-23T08:36:08.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575030 2026-02-23T08:36:08.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836667 1-38654705848 2-55834575030' 2026-02-23T08:36:08.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:08.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836667 2026-02-23T08:36:08.371 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:08.371 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:08.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836667 2026-02-23T08:36:08.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:08.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836667 2026-02-23T08:36:08.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836667' 2026-02-23T08:36:08.373 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836667 2026-02-23T08:36:08.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:08.536 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836664 -lt 21474836667 2026-02-23T08:36:08.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:09.537 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:09.538 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:09.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836667 -lt 21474836667 2026-02-23T08:36:09.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:09.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705848 2026-02-23T08:36:09.706 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:09.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:09.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705848 2026-02-23T08:36:09.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:09.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705848 2026-02-23T08:36:09.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705848' 2026-02-23T08:36:09.709 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705848 2026-02-23T08:36:09.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:09.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705849 -lt 38654705848 2026-02-23T08:36:09.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:09.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575030 2026-02-23T08:36:09.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:09.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:09.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575030 2026-02-23T08:36:09.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:09.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575030 2026-02-23T08:36:09.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575030' 2026-02-23T08:36:09.884 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575030 2026-02-23T08:36:09.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:10.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575031 -lt 55834575030 2026-02-23T08:36:10.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:10.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:10.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:10.201 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:10.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:10.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:10.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:10.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:10.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:10.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:10.378 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:10.378 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:10.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:10.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:10.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:10.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836670 2026-02-23T08:36:10.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836670 2026-02-23T08:36:10.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836670' 2026-02-23T08:36:10.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:10.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:10.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705852 2026-02-23T08:36:10.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705852 2026-02-23T08:36:10.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836670 1-38654705852' 2026-02-23T08:36:10.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:10.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:10.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575033 2026-02-23T08:36:10.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575033 2026-02-23T08:36:10.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836670 1-38654705852 2-55834575033' 2026-02-23T08:36:10.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:10.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836670 2026-02-23T08:36:10.596 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:10.596 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:10.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836670 2026-02-23T08:36:10.597 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:10.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836670 2026-02-23T08:36:10.598 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836670 2026-02-23T08:36:10.599 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836670' 2026-02-23T08:36:10.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:10.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836667 -lt 21474836670 2026-02-23T08:36:10.762 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:11.763 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:11.764 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:11.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836670 -lt 21474836670 2026-02-23T08:36:11.933 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:11.933 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705852 2026-02-23T08:36:11.934 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:11.934 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:11.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705852 2026-02-23T08:36:11.935 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:11.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705852 2026-02-23T08:36:11.936 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705852' 2026-02-23T08:36:11.936 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705852 2026-02-23T08:36:11.937 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:12.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705852 -lt 38654705852 2026-02-23T08:36:12.102 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:12.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575033 2026-02-23T08:36:12.103 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:12.103 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:12.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575033 2026-02-23T08:36:12.104 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:12.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575033 2026-02-23T08:36:12.106 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575033' 2026-02-23T08:36:12.106 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575033 2026-02-23T08:36:12.107 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:12.270 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575034 -lt 55834575033 2026-02-23T08:36:12.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:12.271 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:12.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:12.426 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:12.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:12.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:12.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:12.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:12.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:12.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:12.601 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:12.601 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:12.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:12.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:12.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:12.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836673 2026-02-23T08:36:12.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836673 2026-02-23T08:36:12.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836673' 2026-02-23T08:36:12.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:12.672 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:12.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705855 2026-02-23T08:36:12.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705855 2026-02-23T08:36:12.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836673 1-38654705855' 2026-02-23T08:36:12.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:12.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:12.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575037 2026-02-23T08:36:12.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575037 2026-02-23T08:36:12.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836673 1-38654705855 2-55834575037' 2026-02-23T08:36:12.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:12.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836673 2026-02-23T08:36:12.821 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:12.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:12.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836673 2026-02-23T08:36:12.823 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:12.823 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836673 2026-02-23T08:36:12.824 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836673' 2026-02-23T08:36:12.824 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836673 2026-02-23T08:36:12.824 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:12.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836673 -lt 21474836673 2026-02-23T08:36:12.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:12.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705855 2026-02-23T08:36:12.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:12.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:12.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705855 2026-02-23T08:36:12.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:12.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705855 2026-02-23T08:36:12.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705855' 2026-02-23T08:36:12.990 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705855 2026-02-23T08:36:12.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:13.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705855 -lt 38654705855 2026-02-23T08:36:13.155 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:13.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575037 2026-02-23T08:36:13.156 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:13.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:13.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575037 2026-02-23T08:36:13.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:13.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575037 2026-02-23T08:36:13.158 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575037' 2026-02-23T08:36:13.159 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575037 2026-02-23T08:36:13.159 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575037 -lt 55834575037 2026-02-23T08:36:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:13.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:13.477 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:13.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:13.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:13.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:13.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:13.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:13.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:13.650 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:13.650 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:13.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:13.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:13.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:13.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836675 2026-02-23T08:36:13.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836675 2026-02-23T08:36:13.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836675' 2026-02-23T08:36:13.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:13.724 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:13.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705857 2026-02-23T08:36:13.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705857 2026-02-23T08:36:13.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836675 1-38654705857' 2026-02-23T08:36:13.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:13.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:13.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575039 2026-02-23T08:36:13.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575039 2026-02-23T08:36:13.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836675 1-38654705857 2-55834575039' 2026-02-23T08:36:13.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:13.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836675 2026-02-23T08:36:13.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:13.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:13.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836675 2026-02-23T08:36:13.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:13.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836675 2026-02-23T08:36:13.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836675' 2026-02-23T08:36:13.873 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836675 2026-02-23T08:36:13.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:14.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836673 -lt 21474836675 2026-02-23T08:36:14.037 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:15.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:15.038 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:15.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836676 -lt 21474836675 2026-02-23T08:36:15.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:15.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705857 2026-02-23T08:36:15.203 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:15.203 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:15.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705857 2026-02-23T08:36:15.204 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:15.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705857 2026-02-23T08:36:15.205 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705857' 2026-02-23T08:36:15.206 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705857 2026-02-23T08:36:15.206 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:15.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705858 -lt 38654705857 2026-02-23T08:36:15.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:15.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575039 2026-02-23T08:36:15.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:15.373 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:15.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575039 2026-02-23T08:36:15.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:15.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575039 2026-02-23T08:36:15.375 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575039 2026-02-23T08:36:15.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575039' 2026-02-23T08:36:15.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:15.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575040 -lt 55834575039 2026-02-23T08:36:15.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:15.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:15.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:15.693 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:15.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:15.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:15.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:15.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:15.705 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:15.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:15.872 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:15.872 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:15.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:15.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:15.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836678 2026-02-23T08:36:15.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836678 2026-02-23T08:36:15.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836678' 2026-02-23T08:36:15.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:15.945 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:16.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705860 2026-02-23T08:36:16.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705860 2026-02-23T08:36:16.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836678 1-38654705860' 2026-02-23T08:36:16.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:16.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:16.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575042 2026-02-23T08:36:16.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575042 2026-02-23T08:36:16.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836678 1-38654705860 2-55834575042' 2026-02-23T08:36:16.089 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:16.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836678 2026-02-23T08:36:16.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:16.090 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:16.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836678 2026-02-23T08:36:16.090 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:16.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836678 2026-02-23T08:36:16.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836678' 2026-02-23T08:36:16.092 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836678 2026-02-23T08:36:16.092 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:16.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836676 -lt 21474836678 2026-02-23T08:36:16.255 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:17.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:17.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:17.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836679 -lt 21474836678 2026-02-23T08:36:17.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:17.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705860 2026-02-23T08:36:17.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:17.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:17.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705860 2026-02-23T08:36:17.423 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:17.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705860 2026-02-23T08:36:17.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705860' 2026-02-23T08:36:17.425 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705860 2026-02-23T08:36:17.425 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:17.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705861 -lt 38654705860 2026-02-23T08:36:17.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:17.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575042 2026-02-23T08:36:17.588 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:17.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:17.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575042 2026-02-23T08:36:17.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:17.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575042 2026-02-23T08:36:17.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575042' 2026-02-23T08:36:17.592 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575042 2026-02-23T08:36:17.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:17.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575043 -lt 55834575042 2026-02-23T08:36:17.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:17.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:17.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:17.906 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:17.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:17.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:17.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:17.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:17.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:18.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:18.084 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:18.084 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:18.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:18.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:18.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836682 2026-02-23T08:36:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836682 2026-02-23T08:36:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836682' 2026-02-23T08:36:18.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:18.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705863 2026-02-23T08:36:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705863 2026-02-23T08:36:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836682 1-38654705863' 2026-02-23T08:36:18.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:18.230 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:18.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575045 2026-02-23T08:36:18.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575045 2026-02-23T08:36:18.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836682 1-38654705863 2-55834575045' 2026-02-23T08:36:18.302 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:18.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836682 2026-02-23T08:36:18.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:18.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:18.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836682 2026-02-23T08:36:18.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:18.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836682 2026-02-23T08:36:18.304 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836682' 2026-02-23T08:36:18.305 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836682 2026-02-23T08:36:18.305 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:18.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836679 -lt 21474836682 2026-02-23T08:36:18.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:19.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:19.469 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:19.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836682 -lt 21474836682 2026-02-23T08:36:19.633 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:19.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705863 2026-02-23T08:36:19.633 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:19.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:19.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705863 2026-02-23T08:36:19.635 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:19.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705863 2026-02-23T08:36:19.636 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705863 2026-02-23T08:36:19.636 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705863' 2026-02-23T08:36:19.637 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:19.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705864 -lt 38654705863 2026-02-23T08:36:19.801 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:19.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575045 2026-02-23T08:36:19.802 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:19.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:19.803 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575045 2026-02-23T08:36:19.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:19.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575045 2026-02-23T08:36:19.805 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575045' 2026-02-23T08:36:19.805 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575045 2026-02-23T08:36:19.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:19.974 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575046 -lt 55834575045 2026-02-23T08:36:19.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:19.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:19.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:20.124 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:20.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:20.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:20.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:20.135 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:20.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:20.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:20.300 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:20.300 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:20.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:20.300 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:20.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836685 2026-02-23T08:36:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836685 2026-02-23T08:36:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836685' 2026-02-23T08:36:20.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:20.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:20.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705867 2026-02-23T08:36:20.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705867 2026-02-23T08:36:20.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836685 1-38654705867' 2026-02-23T08:36:20.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:20.449 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:20.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575048 2026-02-23T08:36:20.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575048 2026-02-23T08:36:20.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836685 1-38654705867 2-55834575048' 2026-02-23T08:36:20.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:20.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836685 2026-02-23T08:36:20.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:20.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:20.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836685 2026-02-23T08:36:20.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:20.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836685 2026-02-23T08:36:20.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836685' 2026-02-23T08:36:20.525 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836685 2026-02-23T08:36:20.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:20.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836682 -lt 21474836685 2026-02-23T08:36:20.696 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:21.697 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:21.697 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:21.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836685 -lt 21474836685 2026-02-23T08:36:21.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:21.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705867 2026-02-23T08:36:21.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:21.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:21.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705867 2026-02-23T08:36:21.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:21.866 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705867 2026-02-23T08:36:21.866 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705867 2026-02-23T08:36:21.867 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705867' 2026-02-23T08:36:21.867 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:22.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705867 -lt 38654705867 2026-02-23T08:36:22.032 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:22.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575048 2026-02-23T08:36:22.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:22.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:22.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575048 2026-02-23T08:36:22.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:22.035 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575048 2026-02-23T08:36:22.035 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575048 2026-02-23T08:36:22.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575048' 2026-02-23T08:36:22.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:22.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575049 -lt 55834575048 2026-02-23T08:36:22.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:22.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:22.202 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:22.351 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:22.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:22.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:22.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:22.362 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:22.363 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:22.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:22.529 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:22.529 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:22.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:22.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:22.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:22.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836688 2026-02-23T08:36:22.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836688 2026-02-23T08:36:22.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836688' 2026-02-23T08:36:22.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:22.601 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:22.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705870 2026-02-23T08:36:22.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705870 2026-02-23T08:36:22.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836688 1-38654705870' 2026-02-23T08:36:22.676 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:22.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:22.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575052 2026-02-23T08:36:22.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575052 2026-02-23T08:36:22.748 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836688 1-38654705870 2-55834575052' 2026-02-23T08:36:22.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:22.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836688 2026-02-23T08:36:22.749 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:22.749 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:22.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836688 2026-02-23T08:36:22.750 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:22.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836688 2026-02-23T08:36:22.751 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836688' 2026-02-23T08:36:22.751 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836688 2026-02-23T08:36:22.752 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:22.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836685 -lt 21474836688 2026-02-23T08:36:22.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:23.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:23.915 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:24.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836688 -lt 21474836688 2026-02-23T08:36:24.081 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:24.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705870 2026-02-23T08:36:24.082 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:24.082 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:24.083 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705870 2026-02-23T08:36:24.083 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:24.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705870 2026-02-23T08:36:24.084 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705870' 2026-02-23T08:36:24.085 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705870 2026-02-23T08:36:24.085 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:24.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705870 -lt 38654705870 2026-02-23T08:36:24.247 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:24.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575052 2026-02-23T08:36:24.248 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:24.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:24.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575052 2026-02-23T08:36:24.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:24.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575052 2026-02-23T08:36:24.251 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575052' 2026-02-23T08:36:24.251 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575052 2026-02-23T08:36:24.251 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:24.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575052 -lt 55834575052 2026-02-23T08:36:24.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:24.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:24.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:24.570 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:24.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:375: _scrub_abort: continue 2026-02-23T08:36:24.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:370: _scrub_abort: for i in $(seq 0 200) 2026-02-23T08:36:24.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:372: _scrub_abort: flush_pg_stats 2026-02-23T08:36:24.582 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:36:24.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:36:24.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:36:24.745 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:36:24.745 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:36:24.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:36:24.745 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:24.745 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:36:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836691 2026-02-23T08:36:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836691 2026-02-23T08:36:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836691' 2026-02-23T08:36:24.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:24.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:36:24.894 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705873 2026-02-23T08:36:24.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705873 2026-02-23T08:36:24.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836691 1-38654705873' 2026-02-23T08:36:24.895 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:36:24.895 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:36:24.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834575055 2026-02-23T08:36:24.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834575055 2026-02-23T08:36:24.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836691 1-38654705873 2-55834575055' 2026-02-23T08:36:24.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:24.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836691 2026-02-23T08:36:24.968 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:24.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:36:24.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836691 2026-02-23T08:36:24.970 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:24.971 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836691 2026-02-23T08:36:24.971 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836691 2026-02-23T08:36:24.972 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836691' 2026-02-23T08:36:24.972 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:36:25.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836691 -lt 21474836691 2026-02-23T08:36:25.133 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:25.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705873 2026-02-23T08:36:25.133 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:25.134 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:36:25.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705873 2026-02-23T08:36:25.135 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:25.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705873 2026-02-23T08:36:25.136 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705873' 2026-02-23T08:36:25.136 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 38654705873 2026-02-23T08:36:25.136 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:36:25.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705873 -lt 38654705873 2026-02-23T08:36:25.299 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:36:25.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834575055 2026-02-23T08:36:25.300 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:36:25.301 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:36:25.301 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834575055 2026-02-23T08:36:25.302 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:36:25.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834575055 2026-02-23T08:36:25.303 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834575055' 2026-02-23T08:36:25.303 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 55834575055 2026-02-23T08:36:25.303 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:25.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575054 -lt 55834575055 2026-02-23T08:36:25.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:26.470 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:36:26.471 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:26.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575054 -lt 55834575055 2026-02-23T08:36:26.638 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:36:27.639 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:36:27.640 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:36:27.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834575057 -lt 55834575055 2026-02-23T08:36:27.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: ceph pg dump pgs 2026-02-23T08:36:27.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep '^1.0' 2026-02-23T08:36:27.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:373: _scrub_abort: grep -q scrubbing 2026-02-23T08:36:27.956 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:36:27.967 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:378: _scrub_abort: break 2026-02-23T08:36:27.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:380: _scrub_abort: set +o pipefail 2026-02-23T08:36:27.968 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:382: _scrub_abort: sleep 5 2026-02-23T08:36:32.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:384: _scrub_abort: grep 'noscrub set, aborting' td/osd-scrub-test/osd.1.log 2026-02-23T08:36:32.979 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:34:28.094+0000 7f6e3a55f6c0 10 osd.1 pg_epoch: 18 pg[1.0( v 17'1000 (0'0,17'1000] local-lis/les=15/16 n=1000 ec=15/15 lis/c=15/15 les/c/f=16/16/0 sis=15) [1,0,2] r=0 lpr=15 crt=17'1000 lcod 17'999 mlcod 17'999 active+clean+scrubbing(periodic-regular)] scrubber: noscrub set, aborting 2026-02-23T08:36:32.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: get_last_scrub_stamp 1.0 2026-02-23T08:36:32.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:32.980 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:32.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:32.981 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:33.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:390: _scrub_abort: local last_scrub=2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:33.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:391: _scrub_abort: ceph config set osd osd_scrub_sleep 0.1 2026-02-23T08:36:33.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:393: _scrub_abort: ceph osd unset noscrub 2026-02-23T08:36:33.506 INFO:tasks.workunit.client.0.trial129.stderr:noscrub is unset 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:394: _scrub_abort: '[' scrub = deep-scrub ']' 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:398: _scrub_abort: TIMEOUT=500 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:399: _scrub_abort: wait_for_scrub 1.0 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:33.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:33.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:33.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:33.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:33.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:33.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:33.683 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:34.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:34.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:34.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:34.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:34.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:34.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:34.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:34.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:34.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:35.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:35.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:35.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:35.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:35.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:35.850 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:36.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:36.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:37.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:37.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:37.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:37.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:37.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:37.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:37.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:37.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:37.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:38.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:38.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:38.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:38.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:38.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:38.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:38.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:38.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:38.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:39.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:39.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:39.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:39.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:39.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:39.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:39.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:39.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:39.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:40.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:40.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:40.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:40.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:40.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:40.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:40.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:40.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:40.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:41.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:41.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:41.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:41.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:41.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:41.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:41.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:41.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:41.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:42.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:42.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:42.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:42.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:42.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:42.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:42.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:43.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:43.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:44.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:44.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:44.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:45.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:45.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:45.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:45.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:45.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:46.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:46.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:46.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:46.349 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:46.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:46.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:46.350 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:46.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:46.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:47.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:47.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:47.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:47.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:47.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:48.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:48.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:48.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:48.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:48.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:48.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:48.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:48.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:49.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:49.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:49.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:49.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:49.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:49.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:49.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:50.013 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:50.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:51.015 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:51.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:51.015 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:51.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:51.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:51.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:51.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:51.176 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:52.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:52.177 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:52.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:52.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:52.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:52.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:52.178 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:52.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:52.341 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:53.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:53.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:53.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:53.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:53.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:53.343 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:53.344 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:53.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:53.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:54.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:54.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:54.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:54.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:54.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:54.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:54.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:54.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:54.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:55.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:55.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:55.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:55.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:55.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:55.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:55.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:55.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:55.858 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:56.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:56.859 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:56.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:56.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:56.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:56.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:56.860 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:57.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:57.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:58.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:58.024 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:58.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:58.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:58.025 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:58.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:58.026 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:58.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:58.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:36:59.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:36:59.190 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:36:59.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:36:59.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:36:59.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:36:59.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:36:59.192 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:36:59.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:36:59.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:00.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:00.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:00.358 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:00.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:00.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:01.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:01.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:01.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:01.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:01.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:01.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:01.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:01.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:02.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:02.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:02.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:02.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:02.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:02.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:02.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:02.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:02.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:03.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:03.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:03.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:03.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:03.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:03.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:03.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:04.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:04.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:05.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:05.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:05.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:05.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:05.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:05.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:05.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:05.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:05.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:06.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:06.185 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:06.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:06.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:07.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:07.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:07.351 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:07.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:07.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:07.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:07.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:07.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:07.517 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:08.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:08.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:08.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:08.519 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:08.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:08.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:08.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:08.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:08.687 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:09.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:09.688 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:09.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:09.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:09.689 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:09.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:09.690 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:09.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:09.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:10.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:10.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:10.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:10.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:10.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:10.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:10.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:11.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:11.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:12.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:12.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:12.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:12.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:12.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:12.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:12.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:12.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:12.188 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:13.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:13.189 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:13.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:13.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:13.190 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:13.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:13.191 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:13.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:13.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:14.356 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:14.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:14.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:14.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:14.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:14.357 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:14.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:14.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:15.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:15.524 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:15.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:15.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:15.524 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:15.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:15.525 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:15.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:15.690 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:16.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:16.691 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:16.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:16.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:16.691 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:16.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:16.692 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:16.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:16.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:17.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:17.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:17.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:17.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:17.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:17.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:17.856 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:18.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:18.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:19.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:19.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:19.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:19.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:19.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:19.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:19.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:19.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:19.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:20.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:20.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:20.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:20.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:20.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:20.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:20.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:20.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:20.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:21.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:21.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:21.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:21.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:21.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:21.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:21.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:21.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:21.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:22.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:22.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:22.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:22.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:22.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:22.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:22.518 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:22.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:22.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:23.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:23.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:23.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:23.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:23.683 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:23.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:23.684 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:23.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:23.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:24.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:24.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:24.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:24.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:24.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:24.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:24.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:25.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:25.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:26.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:26.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:26.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:26.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:26.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:26.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:26.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:26.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:26.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:27.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:27.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:27.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:27.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:27.183 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:27.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:27.184 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:27.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:27.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:28.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:28.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:28.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:28.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:29.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:29.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:29.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:29.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:29.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:29.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:29.515 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:29.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:29.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:30.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:30.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:30.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:30.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:30.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:30.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:30.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:30.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:30.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:31.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:31.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:31.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:31.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:31.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:31.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:31.849 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:32.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:32.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:33.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:33.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:33.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:33.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:33.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:33.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:33.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:33.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:33.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:34.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:34.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:34.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:34.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:34.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:34.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:34.187 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:34.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:34.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:35.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:35.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:35.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:35.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:35.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:35.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:35.353 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:35.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:35.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:36.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:36.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:36.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:36.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:36.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:36.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:36.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:36.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:36.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:37.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:37.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:37.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:37.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:37.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:37.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:37.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:37.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:37.850 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:38.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:38.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:38.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:38.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:38.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:38.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:38.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:39.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:39.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:40.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:40.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:40.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:40.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:40.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:40.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:40.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:40.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:40.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:41.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:41.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:41.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:41.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:41.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:41.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:41.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:41.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:41.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:42.352 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:42.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:42.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:42.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:42.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:42.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:42.354 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:42.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:42.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:43.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:43.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:43.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:43.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:43.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:44.686 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:44.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:44.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:44.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:44.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:44.688 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:44.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:44.852 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:45.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:45.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:45.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:45.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:45.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:45.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:45.855 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:46.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:46.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:47.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:47.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:47.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:47.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:47.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:47.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:47.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:47.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:47.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:48.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:48.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:48.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:48.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:48.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:48.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:48.350 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:48.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:49.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:49.351 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:49.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:49.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:49.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:49.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:49.352 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:49.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:49.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:50.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:50.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:50.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:50.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:50.516 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:50.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:50.517 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:50.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:50.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:51.682 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:51.849 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:52.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:52.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:52.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:52.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:52.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:52.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:53.016 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:53.017 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:54.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:54.018 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:54.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:54.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:54.018 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:54.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:54.019 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:54.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:54.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:55.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:55.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:55.182 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:55.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:55.346 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:56.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:56.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:56.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:56.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:56.347 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:56.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:56.348 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:56.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:56.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:57.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:57.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:57.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:57.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:57.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:57.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:57.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:57.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:57.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:58.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:58.677 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:58.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:58.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:58.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:58.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:58.678 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:37:58.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:37:58.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:37:59.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:37:59.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:37:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:37:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:37:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:37:59.847 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:37:59.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:00.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-21T08:34:17.631982+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:38:00.010 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:38:01.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:38:01.011 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:38:01.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:38:01.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:01.012 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:01.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:01.013 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:01.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:37:58.872732+0000 '>' 2026-02-21T08:34:17.631982+0000 2026-02-23T08:38:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:38:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:400: _scrub_abort: perf_counters td/osd-scrub-test 3 2026-02-23T08:38:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:38:01.180 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:38:01.180 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:38:01.180 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:38:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:38:01.181 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.257 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.258 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:01.259 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:01.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:38:01.260 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:38:01.329 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.330 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.331 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:01.332 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.333 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 11, 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:38:01.334 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:38:01.335 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:38:01.402 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:01.402 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:38:01.402 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.403 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.404 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.405 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:01.406 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:01.407 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_scrub_abort ------------------' 2026-02-23T08:38:01.408 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_scrub_abort ------------------ 2026-02-23T08:38:01.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:38:01.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:38:01.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:38:01.409 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:38:01.409 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:38:01.410 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:38:01.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:38:01.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:38:01.410 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:38:01.510 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:38:01.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:38:01.511 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:38:01.511 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:38:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:38:01.512 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:38:01.513 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:38:01.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:01.513 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:38:01.514 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:38:01.514 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:01.515 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:38:01.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:38:01.516 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:38:01.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:38:01.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.569 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:38:01.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:38:01.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:38:01.570 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_scrub_abort ------------------' 2026-02-23T08:38:01.570 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_scrub_abort ------------------ 2026-02-23T08:38:01.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:38:01.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_scrub_permit_time -------------------' 2026-02-23T08:38:01.571 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_scrub_permit_time ------------------- 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:38:01.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:38:01.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:38:01.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:38:01.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:38:01.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:38:01.574 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:38:01.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:38:01.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:38:01.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:38:01.575 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:38:01.575 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:38:01.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:01.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:38:01.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:38:01.577 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:01.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:38:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:38:01.579 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:38:01.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:38:01.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.580 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.580 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:38:01.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:38:01.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:38:01.581 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:38:01.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:38:01.582 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.583 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.583 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_scrub_permit_time -----------------------' 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_scrub_permit_time ----------------------- 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_scrub_permit_time td/osd-scrub-test 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:414: TEST_scrub_permit_time: local dir=td/osd-scrub-test 2026-02-23T08:38:01.584 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:415: TEST_scrub_permit_time: local poolname=test 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:416: TEST_scrub_permit_time: local OSDS=3 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:417: TEST_scrub_permit_time: local objects=15 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:419: TEST_scrub_permit_time: TESTDATA=testdata.889699 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:421: TEST_scrub_permit_time: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:38:01.585 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:01.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-23T08:38:01.623 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:38:01.624 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:38:01.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:38:01.686 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:38:01.687 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:38:01.687 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.687 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.687 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:38:01.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:38:01.687 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:422: TEST_scrub_permit_time: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:38:01.742 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:01.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:38:01.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:38:01.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:423: TEST_scrub_permit_time: date -d '2 hour ago' +%H 2026-02-23T08:38:01.852 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:423: TEST_scrub_permit_time: sed 's/^0//' 2026-02-23T08:38:01.853 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:423: TEST_scrub_permit_time: local scrub_begin_hour=6 2026-02-23T08:38:01.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:424: TEST_scrub_permit_time: date -d '1 hour ago' +%H 2026-02-23T08:38:01.854 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:424: TEST_scrub_permit_time: sed 's/^0//' 2026-02-23T08:38:01.855 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:424: TEST_scrub_permit_time: local scrub_end_hour=7 2026-02-23T08:38:01.856 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: expr 3 - 1 2026-02-23T08:38:01.857 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: seq 0 2 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:427: TEST_scrub_permit_time: run_osd td/osd-scrub-test 0 --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:38:01.862 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:38:01.863 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:38:01.864 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7' 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c1306260-54a4-4334-8a7d-dd6cd6dfc349 2026-02-23T08:38:01.865 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c1306260-54a4-4334-8a7d-dd6cd6dfc349' 2026-02-23T08:38:01.866 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 c1306260-54a4-4334-8a7d-dd6cd6dfc349 2026-02-23T08:38:01.866 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:38:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDpEZxpLi3cMxAAFD0x/y4fNCjFzjkMIUGZNw== 2026-02-23T08:38:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDpEZxpLi3cMxAAFD0x/y4fNCjFzjkMIUGZNw=="}' 2026-02-23T08:38:01.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c1306260-54a4-4334-8a7d-dd6cd6dfc349 -i td/osd-scrub-test/0/new.json 2026-02-23T08:38:01.959 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:01.969 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:38:01.970 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 --mkfs --key AQDpEZxpLi3cMxAAFD0x/y4fNCjFzjkMIUGZNw== --osd-uuid c1306260-54a4-4334-8a7d-dd6cd6dfc349 2026-02-23T08:38:01.983 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:01.983+0000 7f4b7ae07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:01.985 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:01.984+0000 7f4b7ae07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:01.985 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:01.985+0000 7f4b7ae07780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:01.986 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:01.985+0000 7f4b7ae07780 -1 bdev(0x5591a4dc7400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:38:01.986 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:01.985+0000 7f4b7ae07780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:38:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:38:02.433 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:38:02.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:38:02.434 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:38:02.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:38:02.529 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:38:02.530 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:38:02.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 2026-02-23T08:38:02.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:38:02.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:38:02.531 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:38:02.542 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:02.542+0000 7fa792e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:02.544 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:02.543+0000 7fa792e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:02.545 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:02.544+0000 7fa792e0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:02.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:38:02.621 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:02.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:02.621 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:38:02.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:38:02.737 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:02.737+0000 7fa792e0c780 -1 Falling back to public interface 2026-02-23T08:38:03.059 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:03.059+0000 7fa792e0c780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:38:03.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:38:03.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:03.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:38:03.714 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:03.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:38:03.803 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2612341599,v1:127.0.0.1:6801/2612341599] [v2:127.0.0.1:6802/2612341599,v1:127.0.0.1:6803/2612341599] exists,up c1306260-54a4-4334-8a7d-dd6cd6dfc349 2026-02-23T08:38:03.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:38:03.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:38:03.807 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:427: TEST_scrub_permit_time: run_osd td/osd-scrub-test 1 --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:38:03.808 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:03.809 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7' 2026-02-23T08:38:03.810 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:38:03.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:38:03.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=13bdf229-87fe-429f-9020-fd74908982a2 2026-02-23T08:38:03.811 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 13bdf229-87fe-429f-9020-fd74908982a2' 2026-02-23T08:38:03.811 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 13bdf229-87fe-429f-9020-fd74908982a2 2026-02-23T08:38:03.811 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:38:03.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrEZxpAKqYMBAAL+PU6CUqs1vDFfSmUTiMcQ== 2026-02-23T08:38:03.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrEZxpAKqYMBAAL+PU6CUqs1vDFfSmUTiMcQ=="}' 2026-02-23T08:38:03.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 13bdf229-87fe-429f-9020-fd74908982a2 -i td/osd-scrub-test/1/new.json 2026-02-23T08:38:03.906 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:03.914 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:38:03.915 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 --mkfs --key AQDrEZxpAKqYMBAAL+PU6CUqs1vDFfSmUTiMcQ== --osd-uuid 13bdf229-87fe-429f-9020-fd74908982a2 2026-02-23T08:38:03.929 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:03.928+0000 7fb240607780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:03.930 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:03.930+0000 7fb240607780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:03.931 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:03.931+0000 7fb240607780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:03.931 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:03.931+0000 7fb240607780 -1 bdev(0x557985025400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:38:03.932 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:03.931+0000 7fb240607780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:38:04.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:38:04.344 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:38:04.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:38:04.345 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:38:04.345 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:38:04.552 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:38:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:38:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 2026-02-23T08:38:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:38:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:38:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:38:04.565 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:04.565+0000 7f98d1948780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:04.567 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:04.566+0000 7f98d1948780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:04.568 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:04.567+0000 7f98d1948780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:38:04.777 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:04.776+0000 7f98d1948780 -1 Falling back to public interface 2026-02-23T08:38:04.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:38:05.113 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:05.113+0000 7f98d1948780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:38:05.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:38:05.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:05.884 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:38:05.885 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:05.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:38:06.050 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1172506309,v1:127.0.0.1:6811/1172506309] [v2:127.0.0.1:6812/1172506309,v1:127.0.0.1:6813/1172506309] exists,up 13bdf229-87fe-429f-9020-fd74908982a2 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:425: TEST_scrub_permit_time: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:427: TEST_scrub_permit_time: run_osd td/osd-scrub-test 2 --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:06.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7' 2026-02-23T08:38:06.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:38:06.053 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:38:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6e957f2c-c3b1-4cda-9b59-6c3142535404 2026-02-23T08:38:06.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 6e957f2c-c3b1-4cda-9b59-6c3142535404' 2026-02-23T08:38:06.054 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 6e957f2c-c3b1-4cda-9b59-6c3142535404 2026-02-23T08:38:06.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:38:06.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDuEZxpW960AxAAvWYJpdjzC+pL6DHDhK3IkA== 2026-02-23T08:38:06.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDuEZxpW960AxAAvWYJpdjzC+pL6DHDhK3IkA=="}' 2026-02-23T08:38:06.062 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6e957f2c-c3b1-4cda-9b59-6c3142535404 -i td/osd-scrub-test/2/new.json 2026-02-23T08:38:06.223 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:38:06.233 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-23T08:38:06.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 --mkfs --key AQDuEZxpW960AxAAvWYJpdjzC+pL6DHDhK3IkA== --osd-uuid 6e957f2c-c3b1-4cda-9b59-6c3142535404 2026-02-23T08:38:06.248 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.247+0000 7f2afb014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:06.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.249+0000 7f2afb014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:06.250 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.250+0000 7f2afb014780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:06.251 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.250+0000 7f2afb014780 -1 bdev(0x561e5ca2b400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:38:06.251 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.250+0000 7f2afb014780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:38:06.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-23T08:38:06.662 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:38:06.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:38:06.663 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:38:06.663 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:38:06.869 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:38:06.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:38:06.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:38:06.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --bluestore_cache_autotune=false --osd_deep_scrub_randomize_ratio=0.0 --osd_scrub_interval_randomize_ratio=0 --osd_scrub_begin_hour=6 --osd_scrub_end_hour=7 2026-02-23T08:38:06.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:38:06.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:38:06.881 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.881+0000 7f98d5955780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:06.883 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.882+0000 7f98d5955780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:06.884 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:06.883+0000 7f98d5955780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:07.038 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:38:07.039 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:07.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:07.040 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:38:07.088 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:07.087+0000 7f98d5955780 -1 Falling back to public interface 2026-02-23T08:38:07.207 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:38:07.509 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:07.508+0000 7f98d5955780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:38:08.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:38:08.208 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:08.209 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:08.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:38:08.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:08.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:38:08.372 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1483483660,v1:127.0.0.1:6819/1483483660] [v2:127.0.0.1:6820/1483483660,v1:127.0.0.1:6821/1483483660] exists,up 6e957f2c-c3b1-4cda-9b59-6c3142535404 2026-02-23T08:38:08.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:38:08.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:38:08.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:38:08.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:435: TEST_scrub_permit_time: create_pool test 1 1 2026-02-23T08:38:08.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:38:08.616 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:38:08.628 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:38:09.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:436: TEST_scrub_permit_time: wait_for_clean 2026-02-23T08:38:09.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:38:09.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:38:09.630 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:38:09.630 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:38:09.631 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:38:09.631 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:38:09.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:38:09.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:38:09.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:38:09.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:38:09.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:38:09.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:38:09.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:38:09.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:38:09.713 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:38:09.875 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:38:09.875 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:38:09.876 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:38:09.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:38:09.876 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:38:09.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:38:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-23T08:38:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-23T08:38:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-23T08:38:09.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:38:09.950 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:38:10.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-23T08:38:10.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-23T08:38:10.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672966' 2026-02-23T08:38:10.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:38:10.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:38:10.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-23T08:38:10.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-23T08:38:10.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-42949672966 2-64424509443' 2026-02-23T08:38:10.091 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:38:10.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-23T08:38:10.091 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:38:10.092 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:38:10.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-23T08:38:10.093 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:38:10.094 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-23T08:38:10.095 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-23T08:38:10.095 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836488 2026-02-23T08:38:10.095 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:38:10.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-23T08:38:10.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:38:11.257 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:38:11.257 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:38:11.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836488 2026-02-23T08:38:11.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:38:12.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:38:12.422 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:38:12.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836488 2026-02-23T08:38:12.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:38:12.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-23T08:38:12.590 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:38:12.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:38:12.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-23T08:38:12.592 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:38:12.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-23T08:38:12.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-23T08:38:12.593 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672966 2026-02-23T08:38:12.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:38:12.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672968 -lt 42949672966 2026-02-23T08:38:12.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:38:12.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-23T08:38:12.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:38:12.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:38:12.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-23T08:38:12.757 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:38:12.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-23T08:38:12.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-23T08:38:12.758 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 64424509443 2026-02-23T08:38:12.759 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:38:12.924 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509445 -lt 64424509443 2026-02-23T08:38:12.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:38:12.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:38:12.924 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:38:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:38:13.125 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:38:13.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:38:13.125 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:38:13.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:38:13.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:38:13.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:38:13.126 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:38:13.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:38:13.285 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:38:13.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:38:13.286 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:38:13.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:38:13.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:38:13.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:38:13.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:439: TEST_scrub_permit_time: get_pg test SOMETHING 2026-02-23T08:38:13.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-23T08:38:13.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=SOMETHING 2026-02-23T08:38:13.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test SOMETHING 2026-02-23T08:38:13.488 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-23T08:38:13.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:439: TEST_scrub_permit_time: local pgid=1.0 2026-02-23T08:38:13.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:440: TEST_scrub_permit_time: get_primary test SOMETHING 2026-02-23T08:38:13.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:38:13.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=SOMETHING 2026-02-23T08:38:13.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test SOMETHING 2026-02-23T08:38:13.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:38:13.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:440: TEST_scrub_permit_time: local primary=1 2026-02-23T08:38:13.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:441: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:13.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:13.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:13.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:13.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:13.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:441: TEST_scrub_permit_time: local last_scrub=2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:13.979 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:446: TEST_scrub_permit_time: ceph tell 1.0 schedule-scrub 86400 2026-02-23T08:38:14.043 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:14.043 INFO:tasks.workunit.client.0.trial129.stdout: "deep": false, 2026-02-23T08:38:14.043 INFO:tasks.workunit.client.0.trial129.stdout: "must": false, 2026-02-23T08:38:14.043 INFO:tasks.workunit.client.0.trial129.stdout: "stamp": "2026-02-22T08:38:14.042775+0000" 2026-02-23T08:38:14.044 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:14.050 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i=0 )) 2026-02-23T08:38:14.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:14.051 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:14.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:14.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:14.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:14.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:14.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-23T08:38:08.613100+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:14.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:15.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:15.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:15.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:15.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:15.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:15.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:15.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:15.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-23T08:38:08.613100+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:15.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:16.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:16.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:16.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:16.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:16.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:16.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:16.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:16.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:16.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:17.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:17.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:17.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:17.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:17.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:17.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:17.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:17.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:17.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:18.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:18.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:18.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:18.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:18.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:18.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:18.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:18.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:18.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:19.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:19.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:19.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:19.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:19.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:19.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:19.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:20.044 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:20.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:21.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:21.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:21.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:21.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:21.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:21.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:21.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:21.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:21.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:22.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:22.210 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:22.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:22.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:22.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:22.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:22.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:22.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:22.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:23.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:23.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:23.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:23.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:23.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:23.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:23.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:23.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:23.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:24.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:24.542 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:24.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:24.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:25.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:25.706 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:25.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:25.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:25.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:25.707 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:25.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:25.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:25.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:26.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:26.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:26.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:26.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:26.875 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:26.876 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:27.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:28.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:28.043 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:28.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:28.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:28.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:28.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:28.044 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:28.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:28.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:29.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:29.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:29.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:29.219 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:29.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:29.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:29.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:29.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:29.383 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:30.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:30.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:30.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:30.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:30.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:30.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:30.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:30.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:30.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:31.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:31.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:31.553 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:31.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:31.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:31.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:31.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:31.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:31.714 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:32.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:32.715 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:32.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:32.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:32.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:32.716 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:32.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:32.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:32.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:33.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:33.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:33.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:33.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:33.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:33.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:33.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:34.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:34.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:35.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:35.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:35.048 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:35.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:35.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:36.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:36.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:36.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:36.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:36.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:36.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:36.216 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:36.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:36.379 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:37.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:37.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:37.381 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:37.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:37.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:37.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:37.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:37.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:37.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:38.544 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:38.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:38.545 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:38.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:38.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:38.546 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:38.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:39.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:39.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:39.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:39.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:39.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:40.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:40.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:40.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:40.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:40.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:40.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:40.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:41.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:41.045 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:42.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:42.046 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:42.047 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:42.214 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:42.215 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:43.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:43.216 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:43.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:43.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:43.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:43.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:43.217 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:43.380 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:43.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:44.381 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:44.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:44.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:44.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:44.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:44.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:44.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:44.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:44.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:45.547 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:45.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:45.548 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:45.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:45.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:45.549 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:45.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:45.712 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:46.713 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:46.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:46.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:46.714 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:46.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:46.715 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:46.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:46.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:47.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:47.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:47.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: get_last_scrub_stamp 1.0 2026-02-23T08:38:47.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:38:47.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:38:47.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:38:47.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:38:48.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:450: TEST_scrub_permit_time: test 2026-02-22T08:38:14.042775+0000 '>' 2026-02-23T08:38:08.613100+0000 2026-02-23T08:38:48.047 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:453: TEST_scrub_permit_time: sleep 1 2026-02-23T08:38:49.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i++ )) 2026-02-23T08:38:49.048 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:449: TEST_scrub_permit_time: (( i < 30 )) 2026-02-23T08:38:49.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:455: TEST_scrub_permit_time: perf_counters td/osd-scrub-test 3 2026-02-23T08:38:49.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:38:49.049 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:38:49.049 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:38:49.050 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:38:49.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:49.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:38:49.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:38:49.123 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:49.123 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.124 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.125 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:49.126 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.127 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:38:49.128 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:38:49.129 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:38:49.193 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.194 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:49.195 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:49.196 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:38:49.197 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.198 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:38:49.199 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:49.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:49.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:38:49.199 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:38:49.263 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:38:49.263 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:38:49.264 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.264 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.264 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:49.264 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:49.264 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.265 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.265 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.265 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.265 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.265 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.265 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.266 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.267 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.268 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:38:49.269 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:38:49.270 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:38:49.271 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:38:49.271 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_scrub_permit_time ------------------ 2026-02-23T08:38:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_scrub_permit_time ------------------' 2026-02-23T08:38:49.272 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:38:49.273 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:38:49.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:38:49.372 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:38:49.372 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:38:49.373 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:38:49.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:38:49.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:38:49.374 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:38:49.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:49.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:38:49.375 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:38:49.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:49.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:38:49.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:38:49.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:38:49.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:38:49.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:38:49.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:38:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:38:49.386 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_scrub_permit_time ------------------ 2026-02-23T08:38:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_scrub_permit_time ------------------' 2026-02-23T08:38:49.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:31: run: for func in $funcs 2026-02-23T08:38:49.387 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Prepare Test TEST_scrub_test ------------------- 2026-02-23T08:38:49.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:32: run: echo '-------------- Prepare Test TEST_scrub_test -------------------' 2026-02-23T08:38:49.388 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:33: run: setup td/osd-scrub-test 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-scrub-test 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-scrub-test 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:38:49.389 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:38:49.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:38:49.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:38:49.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:38:49.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:38:49.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:38:49.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:38:49.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:49.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:38:49.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:38:49.392 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:38:49.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:38:49.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:38:49.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:38:49.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:38:49.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.395 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.395 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:38:49.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:38:49.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:38:49.396 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-scrub-test 2026-02-23T08:38:49.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:38:49.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.398 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.889699 2026-02-23T08:38:49.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:38:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-23T08:38:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:38:49.400 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-scrub-test 1' TERM HUP INT 2026-02-23T08:38:49.400 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Run Test TEST_scrub_test ----------------------- 2026-02-23T08:38:49.401 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:34: run: echo '-------------- Run Test TEST_scrub_test -----------------------' 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:35: run: TEST_scrub_test td/osd-scrub-test 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:52: TEST_scrub_test: local dir=td/osd-scrub-test 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:53: TEST_scrub_test: local poolname=test 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:54: TEST_scrub_test: local OSDS=3 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:55: TEST_scrub_test: local objects=15 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:57: TEST_scrub_test: run_mon td/osd-scrub-test a --osd_pool_default_size=3 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-scrub-test 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:38:49.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-scrub-test/a 2026-02-23T08:38:49.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-scrub-test/a --run-dir=td/osd-scrub-test --osd_pool_default_size=3 2026-02-23T08:38:49.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:49.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-scrub-test/a '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --mon-cluster-log-file=td/osd-scrub-test/log --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false --osd_pool_default_size=3 2026-02-23T08:38:49.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:38:49.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:38:49.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:38:49.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:38:49.439 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:38:49.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:38:49.441 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get fsid 2026-02-23T08:38:49.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:38:49.502 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.503 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.503 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.889699/ceph-mon.a.asok 2026-02-23T08:38:49.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:38:49.503 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.889699/ceph-mon.a.asok config get mon_host 2026-02-23T08:38:49.560 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:58: TEST_scrub_test: run_mgr td/osd-scrub-test x --mgr_stats_period=1 2026-02-23T08:38:49.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-scrub-test 2026-02-23T08:38:49.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:38:49.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:38:49.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:38:49.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-scrub-test/x 2026-02-23T08:38:49.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.652 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:49.653 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:38:49.653 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-scrub-test/x '--log-file=td/osd-scrub-test/$name.log' '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --run-dir=td/osd-scrub-test '--pid-file=td/osd-scrub-test/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr --mgr_stats_period=1 2026-02-23T08:38:49.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:59: TEST_scrub_test: local 'ceph_osd_args=--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 ' 2026-02-23T08:38:49.666 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:60: TEST_scrub_test: ceph_osd_args+='--osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 ' 2026-02-23T08:38:49.667 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:61: TEST_scrub_test: ceph_osd_args+=--osd_stats_update_period_scrubbing=2 2026-02-23T08:38:49.667 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: expr 3 - 1 2026-02-23T08:38:49.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: seq 0 2 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:64: TEST_scrub_test: run_osd td/osd-scrub-test 0 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/0 2026-02-23T08:38:49.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/0' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/0/journal' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:49.673 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:38:49.674 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/0 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=1f187b33-7fb8-49be-86cb-915531c7c8c6 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 1f187b33-7fb8-49be-86cb-915531c7c8c6' 2026-02-23T08:38:49.675 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 1f187b33-7fb8-49be-86cb-915531c7c8c6 2026-02-23T08:38:49.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:38:49.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAZEpxprf10KBAAq1uweKKjrRXcEtGkQHDuJg== 2026-02-23T08:38:49.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAZEpxprf10KBAAq1uweKKjrRXcEtGkQHDuJg=="}' 2026-02-23T08:38:49.679 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 1f187b33-7fb8-49be-86cb-915531c7c8c6 -i td/osd-scrub-test/0/new.json 2026-02-23T08:38:49.768 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:49.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/0/new.json 2026-02-23T08:38:49.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --mkfs --key AQAZEpxprf10KBAAq1uweKKjrRXcEtGkQHDuJg== --osd-uuid 1f187b33-7fb8-49be-86cb-915531c7c8c6 2026-02-23T08:38:49.793 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:49.792+0000 7f1680549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:49.794 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:49.794+0000 7f1680549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:49.796 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:49.794+0000 7f1680549780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:49.796 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:49.795+0000 7f1680549780 -1 bdev(0x55c3da5b3400 td/osd-scrub-test/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:38:49.796 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:49.795+0000 7f1680549780 -1 bluestore(td/osd-scrub-test/0) _read_fsid unparsable uuid 2026-02-23T08:38:50.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/0/keyring 2026-02-23T08:38:50.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:38:50.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:38:50.230 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:38:50.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:38:50.324 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:38:50.324 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:38:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/0 --osd-journal=td/osd-scrub-test/0/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:38:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:38:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:38:50.325 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:38:50.338 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:50.337+0000 7f7330351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:50.339 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:50.338+0000 7f7330351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:50.340 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:50.339+0000 7f7330351780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:38:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:38:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:38:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:38:50.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:38:50.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:50.417 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:50.417 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:38:50.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:50.418 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:38:50.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:38:50.548 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:50.548+0000 7f7330351780 -1 Falling back to public interface 2026-02-23T08:38:50.955 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:50.954+0000 7f7330351780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:38:51.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:38:51.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:51.507 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:51.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:38:51.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:51.507 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:38:51.597 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2126724996,v1:127.0.0.1:6801/2126724996] [v2:127.0.0.1:6802/2126724996,v1:127.0.0.1:6803/2126724996] exists,up 1f187b33-7fb8-49be-86cb-915531c7c8c6 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:64: TEST_scrub_test: run_osd td/osd-scrub-test 1 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:38:51.601 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/1 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/1' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/1/journal' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:38:51.602 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:38:51.603 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/1 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cfa05e38-473e-4d6b-b26b-677f2d265d38 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 cfa05e38-473e-4d6b-b26b-677f2d265d38' 2026-02-23T08:38:51.604 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 cfa05e38-473e-4d6b-b26b-677f2d265d38 2026-02-23T08:38:51.605 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:38:51.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAbEpxpLg5UJBAAlGzxJqQd/7qDU7Qh+5J9SQ== 2026-02-23T08:38:51.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAbEpxpLg5UJBAAlGzxJqQd/7qDU7Qh+5J9SQ=="}' 2026-02-23T08:38:51.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cfa05e38-473e-4d6b-b26b-677f2d265d38 -i td/osd-scrub-test/1/new.json 2026-02-23T08:38:51.700 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:51.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/1/new.json 2026-02-23T08:38:51.710 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --mkfs --key AQAbEpxpLg5UJBAAlGzxJqQd/7qDU7Qh+5J9SQ== --osd-uuid cfa05e38-473e-4d6b-b26b-677f2d265d38 2026-02-23T08:38:51.724 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:51.723+0000 7f4dea149780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:51.725 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:51.724+0000 7f4dea149780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:51.726 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:51.725+0000 7f4dea149780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:51.727 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:51.725+0000 7f4dea149780 -1 bdev(0x55e6ab02d400 td/osd-scrub-test/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:38:51.727 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:51.726+0000 7f4dea149780 -1 bluestore(td/osd-scrub-test/1) _read_fsid unparsable uuid 2026-02-23T08:38:52.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/1/keyring 2026-02-23T08:38:52.167 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:38:52.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:38:52.168 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:38:52.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:38:52.375 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:38:52.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:38:52.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/1 --osd-journal=td/osd-scrub-test/1/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:38:52.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:38:52.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:38:52.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:38:52.387 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:52.387+0000 7f5c47611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:52.389 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:52.388+0000 7f5c47611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:52.390 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:52.389+0000 7f5c47611780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:52.539 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:38:52.540 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:52.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:52.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:38:52.564 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:52.563+0000 7f5c47611780 -1 Falling back to public interface 2026-02-23T08:38:52.704 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:38:52.926 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:52.926+0000 7f5c47611780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:38:53.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:38:53.705 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:53.706 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:38:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:53.707 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:38:53.873 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/273408059,v1:127.0.0.1:6811/273408059] [v2:127.0.0.1:6812/273408059,v1:127.0.0.1:6813/273408059] exists,up cfa05e38-473e-4d6b-b26b-677f2d265d38 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:62: TEST_scrub_test: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:64: TEST_scrub_test: run_osd td/osd-scrub-test 2 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-scrub-test 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:38:53.878 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:38:53.879 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:38:53.880 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f1ed2069-b9be-4be2-abc9-30d5fa3b3900 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 f1ed2069-b9be-4be2-abc9-30d5fa3b3900' 2026-02-23T08:38:53.881 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 f1ed2069-b9be-4be2-abc9-30d5fa3b3900 2026-02-23T08:38:53.882 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:38:53.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAdEpxpNYi2NBAA3n5EWT+HC28mhgEiPrD/6g== 2026-02-23T08:38:53.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAdEpxpNYi2NBAA3n5EWT+HC28mhgEiPrD/6g=="}' 2026-02-23T08:38:53.886 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f1ed2069-b9be-4be2-abc9-30d5fa3b3900 -i td/osd-scrub-test/2/new.json 2026-02-23T08:38:54.043 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:38:54.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-scrub-test/2/new.json 2026-02-23T08:38:54.054 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 --mkfs --key AQAdEpxpNYi2NBAA3n5EWT+HC28mhgEiPrD/6g== --osd-uuid f1ed2069-b9be-4be2-abc9-30d5fa3b3900 2026-02-23T08:38:54.068 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.067+0000 7f1fc394d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:54.070 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.069+0000 7f1fc394d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:54.071 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.069+0000 7f1fc394d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:54.071 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.070+0000 7f1fc394d780 -1 bdev(0x56531a361400 td/osd-scrub-test/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:38:54.072 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.070+0000 7f1fc394d780 -1 bluestore(td/osd-scrub-test/2) _read_fsid unparsable uuid 2026-02-23T08:38:54.474 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-scrub-test/2/keyring 2026-02-23T08:38:54.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:38:54.475 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:38:54.476 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:38:54.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-scrub-test/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:38:54.680 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:38:54.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:38:54.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:38:54.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:38:54.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:38:54.681 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:38:54.694 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.692+0000 7fa9d0207780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:54.695 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.694+0000 7fa9d0207780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:54.696 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.695+0000 7fa9d0207780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:38:54.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:38:54.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:38:54.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:38:54.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:38:54.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:38:54.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:54.844 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:38:54.844 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:38:54.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:54.845 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:38:54.890 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:54.888+0000 7fa9d0207780 -1 Falling back to public interface 2026-02-23T08:38:55.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:38:55.237 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:38:55.235+0000 7fa9d0207780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:38:56.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:38:56.007 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:38:56.008 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:38:56.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:38:56.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:38:56.008 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:38:56.172 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1138721393,v1:127.0.0.1:6819/1138721393] [v2:127.0.0.1:6820/1138721393,v1:127.0.0.1:6821/1138721393] exists,up f1ed2069-b9be-4be2-abc9-30d5fa3b3900 2026-02-23T08:38:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:38:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:38:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:38:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:68: TEST_scrub_test: create_pool test 1 1 2026-02-23T08:38:56.173 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-23T08:38:56.350 INFO:tasks.workunit.client.0.trial129.stderr:pool 'test' created 2026-02-23T08:38:56.361 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-23T08:38:57.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:69: TEST_scrub_test: wait_for_clean 2026-02-23T08:38:57.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:38:57.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:38:57.363 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:38:57.364 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:38:57.364 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:38:57.365 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:38:57.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:38:57.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:38:57.365 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:38:57.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:38:57.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:38:57.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:38:57.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:38:57.443 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:38:57.443 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:38:57.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:38:57.606 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:38:57.606 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:38:57.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:38:57.606 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:38:57.607 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:38:57.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:38:57.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:38:57.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:38:57.680 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:38:57.680 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:38:57.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672965 2026-02-23T08:38:57.754 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672965 2026-02-23T08:38:57.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2026-02-23T08:38:57.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:38:57.755 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:38:57.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509443 2026-02-23T08:38:57.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509443 2026-02-23T08:38:57.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509443' 2026-02-23T08:38:57.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:38:57.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:38:57.828 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:38:57.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:38:57.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:38:57.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:38:57.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:38:57.830 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836487 2026-02-23T08:38:57.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:38:57.831 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:38:57.992 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:38:57.993 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:38:58.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:38:58.994 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:38:59.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836486 -lt 21474836487 2026-02-23T08:38:59.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:00.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:39:00.162 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:00.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836489 -lt 21474836487 2026-02-23T08:39:00.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:00.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672965 2026-02-23T08:39:00.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:00.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:00.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672965 2026-02-23T08:39:00.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:00.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672965 2026-02-23T08:39:00.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-23T08:39:00.333 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672965 2026-02-23T08:39:00.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:00.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672967 -lt 42949672965 2026-02-23T08:39:00.497 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:00.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509443 2026-02-23T08:39:00.498 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:00.499 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:00.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509443 2026-02-23T08:39:00.500 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:00.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509443 2026-02-23T08:39:00.501 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-23T08:39:00.501 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 64424509443 2026-02-23T08:39:00.501 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:00.668 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509445 -lt 64424509443 2026-02-23T08:39:00.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:00.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:00.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:00.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:00.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:01.036 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:01.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:01.036 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:01.037 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:01.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:01.240 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:01.241 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:01.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: ceph osd dump 2026-02-23T08:39:01.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: grep '^pool.*['\'']test['\'']' 2026-02-23T08:39:01.241 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: awk '{ print $2 }' 2026-02-23T08:39:01.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:70: TEST_scrub_test: poolid=1 2026-02-23T08:39:01.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:72: TEST_scrub_test: file_with_random_data 1032 2026-02-23T08:39:01.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1032 2026-02-23T08:39:01.403 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T08:39:01.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.sPsC0I7Ftb bs=1032 count=1 2026-02-23T08:39:01.405 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:39:01.405 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:39:01.405 INFO:tasks.workunit.client.0.trial129.stderr:1032 bytes (1.0 kB, 1.0 KiB) copied, 4.5876e-05 s, 22.5 MB/s 2026-02-23T08:39:01.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:72: TEST_scrub_test: local testdata_file=/tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.406 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: seq 1 15 2026-02-23T08:39:01.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.406 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj1 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.421 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.422 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj2 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj3 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj4 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj5 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj6 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj7 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.505 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj8 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj9 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.532 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj10 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.546 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj11 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj12 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj13 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj14 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:73: TEST_scrub_test: for i in `seq 1 $objects` 2026-02-23T08:39:01.600 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:75: TEST_scrub_test: rados -p test put obj15 /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:77: TEST_scrub_test: rm -f /tmp/tmp.sPsC0I7Ftb 2026-02-23T08:39:01.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:79: TEST_scrub_test: get_primary test obj1 2026-02-23T08:39:01.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:39:01.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:39:01.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:39:01.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:39:01.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:79: TEST_scrub_test: local primary=1 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:80: TEST_scrub_test: get_not_primary test obj1 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1220: get_not_primary: local poolname=test 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1221: get_not_primary: local objectname=obj1 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: get_primary test obj1 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=test 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=obj1 2026-02-23T08:39:01.782 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map test obj1 2026-02-23T08:39:01.783 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:39:01.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1223: get_not_primary: local primary=1 2026-02-23T08:39:01.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1224: get_not_primary: ceph --format json osd map test obj1 2026-02-23T08:39:01.948 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1225: get_not_primary: jq '.acting | map(select (. != 1)) | .[0]' 2026-02-23T08:39:02.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:80: TEST_scrub_test: local otherosd=0 2026-02-23T08:39:02.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:81: TEST_scrub_test: '[' 0 = 2 ']' 2026-02-23T08:39:02.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:85: TEST_scrub_test: local anotherosd=2 2026-02-23T08:39:02.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:88: TEST_scrub_test: file_with_random_data 512 2026-02-23T08:39:02.112 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-23T08:39:02.113 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-23T08:39:02.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.dIWuj1qgYk bs=512 count=1 2026-02-23T08:39:02.114 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records in 2026-02-23T08:39:02.114 INFO:tasks.workunit.client.0.trial129.stderr:1+0 records out 2026-02-23T08:39:02.114 INFO:tasks.workunit.client.0.trial129.stderr:512 bytes copied, 3.6378e-05 s, 14.1 MB/s 2026-02-23T08:39:02.114 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:88: TEST_scrub_test: local corrupt_data_file=/tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:89: TEST_scrub_test: objectstore_tool td/osd-scrub-test 2 obj1 set-bytes /tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-scrub-test 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-scrub-test 2 obj1 set-bytes /tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-scrub-test 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:39:02.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-scrub-test TERM osd.2 2026-02-23T08:39:02.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:02.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:02.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:02.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:02.116 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-scrub-test 2 obj1 set-bytes /tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-scrub-test 2026-02-23T08:39:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:39:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:39:02.424 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:39:02.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-scrub-test/2 2026-02-23T08:39:02.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-scrub-test/2 obj1 set-bytes /tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-scrub-test 2 --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:39:02.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-scrub-test 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-scrub-test/2 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 ' 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-scrub-test/2' 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-scrub-test/2/journal' 2026-02-23T08:39:02.592 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-scrub-test' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-scrub-test/$name.log' 2026-02-23T08:39:02.593 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-scrub-test/$name.pid' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+='--osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2' 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-scrub-test/2 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=6ae661d4-b7d2-40ad-ba24-225a41232500 --auth-supported=none --mon-host=127.0.0.1:7138 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-scrub-test/2 --osd-journal=td/osd-scrub-test/2/journal --chdir= --run-dir=td/osd-scrub-test '--admin-socket=/tmp/ceph-asok.889699/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-scrub-test/$name.log' '--pid-file=td/osd-scrub-test/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --osd-scrub-interval-randomize-ratio=0 --osd-deep-scrub-randomize-ratio=0 --osd_scrub_backoff_ratio=0 --osd_stats_update_period_not_scrubbing=3 --osd_stats_update_period_scrubbing=2 2026-02-23T08:39:02.594 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-scrub-test/2/whoami 2026-02-23T08:39:02.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:39:02.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:39:02.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:39:02.595 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:39:02.604 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:02.602+0000 7f69578dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:02.605 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:02.604+0000 7f69578dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:02.606 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:02.604+0000 7f69578dd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:39:02.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:02.757 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:39:02.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:02.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:39:02.813 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:02.811+0000 7f69578dd780 -1 Falling back to public interface 2026-02-23T08:39:02.920 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:03.200 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:03.198+0000 7f69578dd780 -1 osd.2 19 log_to_monitors true 2026-02-23T08:39:03.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:03.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 500 )) 2026-02-23T08:39:03.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:03.921 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:03.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:03.921 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:39:04.087 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 23 up_thru 0 down_at 20 last_clean_interval [15,19) [v2:127.0.0.1:6818/1143011811,v1:127.0.0.1:6819/1143011811] [v2:127.0.0.1:6820/1143011811,v1:127.0.0.1:6821/1143011811] exists,up f1ed2069-b9be-4be2-abc9-30d5fa3b3900 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:04.088 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:04.089 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:04.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:04.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:04.089 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:04.168 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:04.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:04.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:04.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:04.169 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:04.169 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:04.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:04.332 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:04.332 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:04.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:04.333 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:04.333 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:04.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836495 2026-02-23T08:39:04.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836495 2026-02-23T08:39:04.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495' 2026-02-23T08:39:04.405 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:04.405 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:04.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672973 2026-02-23T08:39:04.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672973 2026-02-23T08:39:04.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973' 2026-02-23T08:39:04.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:04.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247811 2026-02-23T08:39:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247811 2026-02-23T08:39:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836495 1-42949672973 2-98784247811' 2026-02-23T08:39:04.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:04.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836495 2026-02-23T08:39:04.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:04.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:04.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836495 2026-02-23T08:39:04.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:04.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836495 2026-02-23T08:39:04.555 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836495' 2026-02-23T08:39:04.555 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836495 2026-02-23T08:39:04.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836495 2026-02-23T08:39:04.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:05.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:39:05.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:05.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836495 2026-02-23T08:39:05.889 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:05.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672973 2026-02-23T08:39:05.890 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:05.891 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:05.891 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672973 2026-02-23T08:39:05.892 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:05.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672973 2026-02-23T08:39:05.893 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672973' 2026-02-23T08:39:05.893 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 42949672973 2026-02-23T08:39:05.893 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:06.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672974 -lt 42949672973 2026-02-23T08:39:06.056 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:06.056 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247811 2026-02-23T08:39:06.056 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:06.057 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:06.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247811 2026-02-23T08:39:06.058 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:06.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247811 2026-02-23T08:39:06.059 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247811' 2026-02-23T08:39:06.059 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 98784247811 2026-02-23T08:39:06.059 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:06.227 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247812 -lt 98784247811 2026-02-23T08:39:06.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:06.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:06.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:06.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:06.598 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:06.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:06.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:06.599 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:06.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:06.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:06.802 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:06.803 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:90: TEST_scrub_test: rm -f /tmp/tmp.dIWuj1qgYk 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:92: TEST_scrub_test: local pgid=1.0 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:93: TEST_scrub_test: pg_deep_scrub 1.0 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=1.0 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 1.0 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:39:06.804 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:06.805 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:06.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:06.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:06.805 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:39:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:39:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:39:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:39:06.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:06.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:07.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:07.161 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:07.161 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:07.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:07.161 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:07.161 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:07.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836499 2026-02-23T08:39:07.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836499 2026-02-23T08:39:07.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499' 2026-02-23T08:39:07.235 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:07.235 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:07.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672977 2026-02-23T08:39:07.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672977 2026-02-23T08:39:07.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-42949672977' 2026-02-23T08:39:07.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:07.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:07.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247815 2026-02-23T08:39:07.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247815 2026-02-23T08:39:07.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836499 1-42949672977 2-98784247815' 2026-02-23T08:39:07.382 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:07.382 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836499 2026-02-23T08:39:07.383 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:07.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:07.384 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836499 2026-02-23T08:39:07.385 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:07.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836499 2026-02-23T08:39:07.386 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836499' 2026-02-23T08:39:07.386 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836499 2026-02-23T08:39:07.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:07.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836496 -lt 21474836499 2026-02-23T08:39:07.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:08.551 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:39:08.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:08.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836499 -lt 21474836499 2026-02-23T08:39:08.717 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:08.717 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672977 2026-02-23T08:39:08.718 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:08.718 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:08.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672977 2026-02-23T08:39:08.719 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:08.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672977 2026-02-23T08:39:08.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672977' 2026-02-23T08:39:08.720 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672977 2026-02-23T08:39:08.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:08.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672977 -lt 42949672977 2026-02-23T08:39:08.883 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:08.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247815 2026-02-23T08:39:08.884 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:08.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:08.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247815 2026-02-23T08:39:08.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:08.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247815 2026-02-23T08:39:08.887 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247815' 2026-02-23T08:39:08.887 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 98784247815 2026-02-23T08:39:08.887 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:09.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247815 -lt 98784247815 2026-02-23T08:39:09.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:39:09.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-23T08:39:09.051 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 1.0 loop 0 2026-02-23T08:39:09.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-23T08:39:09.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-23T08:39:09.052 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:39:09.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-23T08:39:09.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:39:09.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:09.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:09.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:38:56.348222+0000 2026-02-23T08:39:09.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 1.0 2026-02-23T08:39:09.439 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2026-02-23T08:39:09.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 1.0 2026-02-23T08:38:56.348222+0000 last_deep_scrub_stamp 2026-02-23T08:39:09.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:39:09.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:38:56.348222+0000 2026-02-23T08:39:09.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:39:09.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:39:09.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:09.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:09.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:09.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:09.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:09.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:09.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:38:56.348222+0000 '>' 2026-02-23T08:38:56.348222+0000 2026-02-23T08:39:09.611 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:10.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:10.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:10.613 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:10.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:10.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:10.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:10.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:10.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:38:56.348222+0000 '>' 2026-02-23T08:38:56.348222+0000 2026-02-23T08:39:10.777 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:11.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:11.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:11.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:11.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:11.779 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:11.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:11.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:11.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:09.916010+0000 '>' 2026-02-23T08:38:56.348222+0000 2026-02-23T08:39:11.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:39:11.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:95: TEST_scrub_test: ceph pg dump pgs 2026-02-23T08:39:11.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:95: TEST_scrub_test: grep '^1.0' 2026-02-23T08:39:11.944 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:95: TEST_scrub_test: grep -q -- +inconsistent 2026-02-23T08:39:12.096 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:39:12.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:96: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:12.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:96: TEST_scrub_test: jq .info.stats.stat_sum.num_scrub_errors 2026-02-23T08:39:12.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:96: TEST_scrub_test: test 2 = 2 2026-02-23T08:39:12.179 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:98: TEST_scrub_test: ceph osd out 1 2026-02-23T08:39:12.389 INFO:tasks.workunit.client.0.trial129.stderr:marked out osd.1. 2026-02-23T08:39:12.402 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:99: TEST_scrub_test: wait_for_clean 2026-02-23T08:39:12.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:12.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:12.403 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:12.403 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:12.404 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:12.404 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:12.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:12.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:12.404 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:12.483 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:12.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:12.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:12.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:12.484 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:12.484 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:12.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:12.650 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:12.650 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:12.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:12.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:12.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836505 2026-02-23T08:39:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836505 2026-02-23T08:39:12.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505' 2026-02-23T08:39:12.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:12.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:12.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672983 2026-02-23T08:39:12.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672983 2026-02-23T08:39:12.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-42949672983' 2026-02-23T08:39:12.796 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:12.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:12.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247821 2026-02-23T08:39:12.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247821 2026-02-23T08:39:12.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836505 1-42949672983 2-98784247821' 2026-02-23T08:39:12.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:12.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836505 2026-02-23T08:39:12.871 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:12.872 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:12.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836505 2026-02-23T08:39:12.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:12.873 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836505 2026-02-23T08:39:12.874 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836505' 2026-02-23T08:39:12.874 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836505 2026-02-23T08:39:12.874 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:13.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836503 -lt 21474836505 2026-02-23T08:39:13.041 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:14.042 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:39:14.042 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836506 -lt 21474836505 2026-02-23T08:39:14.209 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:14.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672983 2026-02-23T08:39:14.210 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:14.211 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:14.211 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672983 2026-02-23T08:39:14.212 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:14.212 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672983 2026-02-23T08:39:14.213 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672983' 2026-02-23T08:39:14.213 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672983 2026-02-23T08:39:14.213 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672984 -lt 42949672983 2026-02-23T08:39:14.374 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:14.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247821 2026-02-23T08:39:14.375 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:14.376 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:14.376 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247821 2026-02-23T08:39:14.377 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:14.377 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247821 2026-02-23T08:39:14.378 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247821' 2026-02-23T08:39:14.378 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 98784247821 2026-02-23T08:39:14.378 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:14.543 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247822 -lt 98784247821 2026-02-23T08:39:14.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:14.543 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:14.544 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:14.755 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:14.756 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:14.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:14.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:14.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:14.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:15.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:15.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:15.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:15.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:101: TEST_scrub_test: pg_deep_scrub 1.0 2026-02-23T08:39:15.126 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1932: pg_deep_scrub: local pgid=1.0 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1934: pg_deep_scrub: wait_for_pg_clean 1.0 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1702: wait_for_pg_clean: local pg_id=1.0 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: get_timeout_delays 90 1 3 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:15.127 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:15.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: delays=('1' '2' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3' '3') 2026-02-23T08:39:15.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1703: wait_for_pg_clean: local -a delays 2026-02-23T08:39:15.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1704: wait_for_pg_clean: local -i loop=0 2026-02-23T08:39:15.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1706: wait_for_pg_clean: flush_pg_stats 2026-02-23T08:39:15.320 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:15.320 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:15.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:15.486 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:15.486 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:15.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:15.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:15.486 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:15.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836509 2026-02-23T08:39:15.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836509 2026-02-23T08:39:15.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509' 2026-02-23T08:39:15.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:15.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:15.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672987 2026-02-23T08:39:15.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672987 2026-02-23T08:39:15.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-42949672987' 2026-02-23T08:39:15.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:15.634 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:15.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247825 2026-02-23T08:39:15.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247825 2026-02-23T08:39:15.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836509 1-42949672987 2-98784247825' 2026-02-23T08:39:15.708 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:15.708 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836509 2026-02-23T08:39:15.709 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:15.709 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:15.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836509 2026-02-23T08:39:15.710 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:15.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836509 2026-02-23T08:39:15.711 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836509' 2026-02-23T08:39:15.711 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836509 2026-02-23T08:39:15.711 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:15.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836509 -lt 21474836509 2026-02-23T08:39:15.879 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:15.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672987 2026-02-23T08:39:15.880 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:15.881 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:15.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672987 2026-02-23T08:39:15.881 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:15.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672987 2026-02-23T08:39:15.882 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672987' 2026-02-23T08:39:15.882 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672987 2026-02-23T08:39:15.883 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:16.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672987 -lt 42949672987 2026-02-23T08:39:16.051 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:16.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247825 2026-02-23T08:39:16.052 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:16.053 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:16.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247825 2026-02-23T08:39:16.054 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:16.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247825 2026-02-23T08:39:16.055 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247825' 2026-02-23T08:39:16.055 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 98784247825 2026-02-23T08:39:16.055 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:16.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247824 -lt 98784247825 2026-02-23T08:39:16.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:17.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:39:17.222 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:17.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247824 -lt 98784247825 2026-02-23T08:39:17.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:18.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:39:18.391 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:18.556 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247827 -lt 98784247825 2026-02-23T08:39:18.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1708: wait_for_pg_clean: true 2026-02-23T08:39:18.557 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1709: wait_for_pg_clean: echo '#---------- 1.0 loop 0' 2026-02-23T08:39:18.557 INFO:tasks.workunit.client.0.trial129.stdout:#---------- 1.0 loop 0 2026-02-23T08:39:18.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: is_pg_clean 1.0 2026-02-23T08:39:18.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1572: is_pg_clean: local pgid=1.0 2026-02-23T08:39:18.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1573: is_pg_clean: local pg_state 2026-02-23T08:39:18.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: ceph pg 1.0 query 2026-02-23T08:39:18.558 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: jq -r '.state ' 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1574: is_pg_clean: pg_state=active+clean+remapped 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1575: is_pg_clean: [[ active+clean+remapped == \a\c\t\i\v\e\+\c\l\e\a\n* ]] 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1710: wait_for_pg_clean: break 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1719: wait_for_pg_clean: return 0 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:18.631 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:18.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:18.632 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:18.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1935: pg_deep_scrub: local last_scrub=2026-02-23T08:39:09.916010+0000 2026-02-23T08:39:18.795 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1936: pg_deep_scrub: ceph pg deep-scrub 1.0 2026-02-23T08:39:18.947 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.0 to deep-scrub 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1937: pg_deep_scrub: wait_for_scrub 1.0 2026-02-23T08:39:09.916010+0000 last_deep_scrub_stamp 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:39:09.916010+0000 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_deep_scrub_stamp 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:18.959 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:18.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:18.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:18.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:18.960 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:19.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:09.916010+0000 '>' 2026-02-23T08:39:09.916010+0000 2026-02-23T08:39:19.122 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:20.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:20.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:20.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:20.123 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:20.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:20.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:20.124 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:20.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:09.916010+0000 '>' 2026-02-23T08:39:09.916010+0000 2026-02-23T08:39:20.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:21.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:21.288 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:21.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:21.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:21.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:21.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:21.289 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:21.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:09.916010+0000 '>' 2026-02-23T08:39:09.916010+0000 2026-02-23T08:39:21.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:22.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:22.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:22.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_deep_scrub_stamp 2026-02-23T08:39:22.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:22.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_deep_scrub_stamp 2026-02-23T08:39:22.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:22.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_deep_scrub_stamp' 2026-02-23T08:39:22.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:19.117890+0000 '>' 2026-02-23T08:39:09.916010+0000 2026-02-23T08:39:22.620 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:39:22.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:103: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:22.621 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:103: TEST_scrub_test: jq .info.stats.stat_sum.num_scrub_errors 2026-02-23T08:39:22.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:103: TEST_scrub_test: test 2 = 2 2026-02-23T08:39:22.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:104: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:22.693 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:104: TEST_scrub_test: jq '.peer_info[0].stats.stat_sum.num_scrub_errors' 2026-02-23T08:39:22.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:104: TEST_scrub_test: test 2 = 2 2026-02-23T08:39:22.764 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:105: TEST_scrub_test: ceph pg dump pgs 2026-02-23T08:39:22.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:105: TEST_scrub_test: grep '^1.0' 2026-02-23T08:39:22.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:105: TEST_scrub_test: grep -q -- +inconsistent 2026-02-23T08:39:22.916 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:39:22.926 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:107: TEST_scrub_test: ceph osd in 1 2026-02-23T08:39:23.135 INFO:tasks.workunit.client.0.trial129.stderr:marked in osd.1. 2026-02-23T08:39:23.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:108: TEST_scrub_test: wait_for_clean 2026-02-23T08:39:23.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:23.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:23.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:23.147 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:23.148 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:23.148 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:23.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:23.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:23.148 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:23.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:23.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:23.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:23.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:23.228 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:23.228 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:23.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:23.394 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:23.394 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:23.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:23.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:23.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:23.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836518 2026-02-23T08:39:23.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836518 2026-02-23T08:39:23.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518' 2026-02-23T08:39:23.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:23.467 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:23.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672996 2026-02-23T08:39:23.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672996 2026-02-23T08:39:23.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518 1-42949672996' 2026-02-23T08:39:23.540 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:23.540 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:23.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247834 2026-02-23T08:39:23.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247834 2026-02-23T08:39:23.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836518 1-42949672996 2-98784247834' 2026-02-23T08:39:23.615 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:23.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836518 2026-02-23T08:39:23.616 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:23.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:23.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836518 2026-02-23T08:39:23.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:23.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836518 2026-02-23T08:39:23.618 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836518 2026-02-23T08:39:23.618 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836518' 2026-02-23T08:39:23.619 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:23.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836518 -lt 21474836518 2026-02-23T08:39:23.780 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:23.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672996 2026-02-23T08:39:23.781 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:23.781 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:23.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672996 2026-02-23T08:39:23.782 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:23.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672996 2026-02-23T08:39:23.783 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672996' 2026-02-23T08:39:23.784 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672996 2026-02-23T08:39:23.784 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:23.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672996 -lt 42949672996 2026-02-23T08:39:23.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:23.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247834 2026-02-23T08:39:23.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:23.950 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:23.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247834 2026-02-23T08:39:23.951 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:23.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247834 2026-02-23T08:39:23.952 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247834' 2026-02-23T08:39:23.952 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 98784247834 2026-02-23T08:39:23.952 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:24.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247834 -lt 98784247834 2026-02-23T08:39:24.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:24.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:24.120 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:24.327 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:24.328 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:24.492 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:24.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:24.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:24.493 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:110: TEST_scrub_test: repair 1.0 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1887: repair: local pgid=1.0 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: get_last_scrub_stamp 1.0 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:24.695 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:39:24.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:24.696 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:39:24.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1888: repair: local last_scrub=2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:24.857 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1889: repair: ceph pg repair 1.0 2026-02-23T08:39:25.008 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1890: repair: wait_for_scrub 1.0 2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2063: wait_for_scrub: local pgid=1.0 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2064: wait_for_scrub: local last_scrub=2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2065: wait_for_scrub: local sname=last_scrub_stamp 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i=0 )) 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:39:25.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:25.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:39:25.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:25.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:39:25.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:19.117890+0000 '>' 2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:25.184 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:26.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:26.185 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:26.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:39:26.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:26.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:39:26.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:26.186 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:39:26.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:19.117890+0000 '>' 2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:26.353 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:27.354 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:27.355 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:27.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:39:27.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:27.355 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:39:27.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:27.356 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:39:27.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:19.117890+0000 '>' 2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:27.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2071: wait_for_scrub: sleep 1 2026-02-23T08:39:28.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i++ )) 2026-02-23T08:39:28.519 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2067: wait_for_scrub: (( i < 500 )) 2026-02-23T08:39:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: get_last_scrub_stamp 1.0 last_scrub_stamp 2026-02-23T08:39:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1517: get_last_scrub_stamp: local pgid=1.0 2026-02-23T08:39:28.520 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1518: get_last_scrub_stamp: local sname=last_scrub_stamp 2026-02-23T08:39:28.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1519: get_last_scrub_stamp: ceph --format json pg dump pgs 2026-02-23T08:39:28.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1520: get_last_scrub_stamp: jq -r '.pg_stats | .[] | select(.pgid=="1.0") | .last_scrub_stamp' 2026-02-23T08:39:28.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2068: wait_for_scrub: test 2026-02-23T08:39:26.958824+0000 '>' 2026-02-23T08:39:19.117890+0000 2026-02-23T08:39:28.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2069: wait_for_scrub: return 0 2026-02-23T08:39:28.684 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:111: TEST_scrub_test: wait_for_clean 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:28.685 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:28.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:28.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:28.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:28.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:28.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:28.766 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:28.931 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:28.931 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:28.932 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:28.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:28.932 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:28.932 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:29.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836525 2026-02-23T08:39:29.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836525 2026-02-23T08:39:29.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836525' 2026-02-23T08:39:29.004 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:29.004 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:29.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673002 2026-02-23T08:39:29.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673002 2026-02-23T08:39:29.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836525 1-42949673002' 2026-02-23T08:39:29.076 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:29.076 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:29.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247840 2026-02-23T08:39:29.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247840 2026-02-23T08:39:29.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836525 1-42949673002 2-98784247840' 2026-02-23T08:39:29.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:29.149 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836525 2026-02-23T08:39:29.150 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:29.150 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:29.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836525 2026-02-23T08:39:29.151 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:29.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836525 2026-02-23T08:39:29.152 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836525 2026-02-23T08:39:29.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836525' 2026-02-23T08:39:29.152 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836522 -lt 21474836525 2026-02-23T08:39:29.316 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:30.317 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:39:30.318 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:30.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836525 -lt 21474836525 2026-02-23T08:39:30.485 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:30.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673002 2026-02-23T08:39:30.485 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:30.486 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:30.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673002 2026-02-23T08:39:30.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:30.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673002 2026-02-23T08:39:30.489 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949673002 2026-02-23T08:39:30.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673002' 2026-02-23T08:39:30.489 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:30.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673003 -lt 42949673002 2026-02-23T08:39:30.656 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:30.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247840 2026-02-23T08:39:30.656 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:30.657 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:30.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247840 2026-02-23T08:39:30.658 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:30.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247840 2026-02-23T08:39:30.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247840' 2026-02-23T08:39:30.659 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 98784247840 2026-02-23T08:39:30.660 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:30.825 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247841 -lt 98784247840 2026-02-23T08:39:30.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:30.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:30.826 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:31.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:31.033 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:31.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:31.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:31.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:31.033 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:31.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:31.034 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:31.195 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:31.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:31.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:31.196 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:31.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:31.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:31.398 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:31.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:114: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:31.399 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:114: TEST_scrub_test: jq '.peer_info[0].stats.stat_sum.num_scrub_errors' 2026-02-23T08:39:31.471 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:114: TEST_scrub_test: test 2 = 2 2026-02-23T08:39:31.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:115: TEST_scrub_test: ceph pg dump pgs 2026-02-23T08:39:31.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:115: TEST_scrub_test: grep '^1.0' 2026-02-23T08:39:31.472 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:115: TEST_scrub_test: grep -vq -- +inconsistent 2026-02-23T08:39:31.623 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:39:31.634 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:117: TEST_scrub_test: ceph osd out 1 2026-02-23T08:39:31.823 INFO:tasks.workunit.client.0.trial129.stderr:marked out osd.1. 2026-02-23T08:39:31.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:118: TEST_scrub_test: wait_for_clean 2026-02-23T08:39:31.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:31.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:31.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:31.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:31.838 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:31.838 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:31.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:31.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:31.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:31.918 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=500 2026-02-23T08:39:31.918 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:32.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:32.083 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:32.083 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:32.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:32.083 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:32.084 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:32.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836529 2026-02-23T08:39:32.159 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836529 2026-02-23T08:39:32.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836529' 2026-02-23T08:39:32.160 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:32.160 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:32.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949673007 2026-02-23T08:39:32.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949673007 2026-02-23T08:39:32.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836529 1-42949673007' 2026-02-23T08:39:32.234 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:32.234 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 500 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247845 2026-02-23T08:39:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247845 2026-02-23T08:39:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836529 1-42949673007 2-98784247845' 2026-02-23T08:39:32.307 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:32.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836529 2026-02-23T08:39:32.308 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:32.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:32.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836529 2026-02-23T08:39:32.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:32.310 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836529 2026-02-23T08:39:32.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836529' 2026-02-23T08:39:32.311 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836529 2026-02-23T08:39:32.311 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:32.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836527 -lt 21474836529 2026-02-23T08:39:32.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:33.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 500 -eq 0 ']' 2026-02-23T08:39:33.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:33.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836527 -lt 21474836529 2026-02-23T08:39:33.642 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:34.643 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 499 -eq 0 ']' 2026-02-23T08:39:34.643 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:34.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836530 -lt 21474836529 2026-02-23T08:39:34.813 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:34.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949673007 2026-02-23T08:39:34.813 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:34.814 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:34.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949673007 2026-02-23T08:39:34.815 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:34.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949673007 2026-02-23T08:39:34.816 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949673007' 2026-02-23T08:39:34.816 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949673007 2026-02-23T08:39:34.816 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949673008 -lt 42949673007 2026-02-23T08:39:34.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:34.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-98784247845 2026-02-23T08:39:34.984 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:34.984 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:34.985 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-98784247845 2026-02-23T08:39:34.986 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:34.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247845 2026-02-23T08:39:34.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 98784247845' 2026-02-23T08:39:34.987 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 98784247845 2026-02-23T08:39:34.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:35.154 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247846 -lt 98784247845 2026-02-23T08:39:35.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:35.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:35.155 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:35.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:35.359 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:35.359 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:35.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:35.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:35.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:35.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:35.360 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:35.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:35.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:35.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:35.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:35.724 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:35.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:35.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:120: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:35.725 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:120: TEST_scrub_test: jq .info.stats.stat_sum.num_scrub_errors 2026-02-23T08:39:35.797 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:120: TEST_scrub_test: test 0 = 0 2026-02-23T08:39:35.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:121: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:35.797 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:121: TEST_scrub_test: jq '.peer_info[0].stats.stat_sum.num_scrub_errors' 2026-02-23T08:39:35.871 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:121: TEST_scrub_test: test 0 = 0 2026-02-23T08:39:35.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:122: TEST_scrub_test: ceph pg 1.0 query 2026-02-23T08:39:35.872 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:122: TEST_scrub_test: jq '.peer_info[1].stats.stat_sum.num_scrub_errors' 2026-02-23T08:39:35.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:122: TEST_scrub_test: test 0 = 0 2026-02-23T08:39:35.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:123: TEST_scrub_test: ceph pg dump pgs 2026-02-23T08:39:35.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:123: TEST_scrub_test: grep '^1.0' 2026-02-23T08:39:35.946 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:123: TEST_scrub_test: grep -vq -- +inconsistent 2026-02-23T08:39:36.099 INFO:tasks.workunit.client.0.trial129.stderr:dumped pgs 2026-02-23T08:39:36.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:124: TEST_scrub_test: perf_counters td/osd-scrub-test 3 2026-02-23T08:39:36.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:43: perf_counters: local dir=td/osd-scrub-test 2026-02-23T08:39:36.110 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:44: perf_counters: local OSDS=3 2026-02-23T08:39:36.111 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: expr 3 - 1 2026-02-23T08:39:36.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: seq 0 2 2026-02-23T08:39:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:39:36.112 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.0 counter dump 2026-02-23T08:39:36.113 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:39:36.183 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:39:36.183 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:39:36.183 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.183 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.184 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:39:36.184 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:39:36.184 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.184 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.184 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.184 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.185 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:39:36.186 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.186 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.186 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:39:36.186 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:39:36.186 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.186 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 2, 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.187 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:39:36.188 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.189 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:39:36.190 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.191 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.191 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.191 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.191 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.191 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.191 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.192 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.192 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.192 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:39:36.192 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:39:36.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:39:36.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.1 counter dump 2026-02-23T08:39:36.193 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:39:36.252 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:39:36.252 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:39:36.252 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.253 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 6, 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.254 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.255 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.256 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:39:36.257 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:39:36.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:45: perf_counters: for osd in $(seq 0 $(expr $OSDS - 1)) 2026-02-23T08:39:36.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: ceph tell osd.2 counter dump 2026-02-23T08:39:36.258 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:47: perf_counters: jq 'with_entries(select(.key | startswith("osd_scrub")))' 2026-02-23T08:39:36.324 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:39:36.324 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_ec": [ 2026-02-23T08:39:36.324 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.324 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.324 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.325 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_dp_repl": [ 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "level": "deep", 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.326 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_ec": [ 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "ec" 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.327 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: ], 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "osd_scrub_sh_repl": [ 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: { 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "labels": { 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "level": "shallow", 2026-02-23T08:39:36.328 INFO:tasks.workunit.client.0.trial129.stdout: "pooltype": "replicated" 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: }, 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: "counters": { 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: "preemptions": 0, 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_selected": 0, 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: "chunk_busy": 0, 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: "locked_object": 0, 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: "write_blocked_by_scrub": 0 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: } 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout: ] 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:39:36.329 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Teardown Test TEST_scrub_test ------------------ 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:36: run: echo '-------------- Teardown Test TEST_scrub_test ------------------' 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:37: run: teardown td/osd-scrub-test 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:36.331 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:36.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:36.332 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:36.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:36.432 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:39:36.432 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:39:36.433 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:39:36.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:39:36.434 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:39:36.434 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:39:36.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:39:36.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:39:36.435 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:39:36.435 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:39:36.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:39:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:39:36.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:39:36.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:39:36.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.448 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:39:36.448 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:39:36.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:39:36.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:39:36.449 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:38: run: echo '-------------- Complete Test TEST_scrub_test ------------------' 2026-02-23T08:39:36.449 INFO:tasks.workunit.client.0.trial129.stdout:-------------- Complete Test TEST_scrub_test ------------------ 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-scrub-test 0 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-scrub-test 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-scrub-test KILL 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:36.450 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:36.452 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:36.452 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:39:36.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:39:36.453 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:39:36.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:39:36.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:39:36.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:39:36.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:39:36.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:39:36.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:39:36.456 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:39:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:39:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-23T08:39:36.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-scrub-test 2026-02-23T08:39:36.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:39:36.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.459 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.889699 2026-02-23T08:39:36.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.889699 2026-02-23T08:39:36.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:39:36.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:39:36.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-23T08:39:36.460 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T08:39:36.460 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T08:39:36.490 INFO:tasks.workunit:Running workunit scrub/osd-unexpected-clone.sh... 2026-02-23T08:39:36.490 DEBUG:teuthology.orchestra.run.trial129:workunit test scrub/osd-unexpected-clone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5adce3ff0fe1645dcbc38d059f948571dc3d69da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh 2026-02-23T08:39:36.554 INFO:tasks.workunit.client.0.trial129.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-23T08:39:36.558 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-unexpected-clone 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:22: run: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:23: run: shift 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:25: run: export CEPH_MON=127.0.0.1:7144 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:25: run: CEPH_MON=127.0.0.1:7144 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:26: run: export CEPH_ARGS 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:27: run: uuidgen 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:27: run: CEPH_ARGS+='--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none ' 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:36.559 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:30: run: export -n CEPH_CLI_TEST_DUP_COMMAND 2026-02-23T08:39:36.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:31: run: set 2026-02-23T08:39:36.561 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-23T08:39:36.561 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:31: run: local funcs=TEST_recover_unexpected 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:32: run: for func in $funcs 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:33: run: setup td/osd-unexpected-clone 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-unexpected-clone 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-unexpected-clone KILL 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:36.562 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:36.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:36.563 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:39:36.563 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:39:36.564 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:39:36.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:39:36.564 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:39:36.565 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:39:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:39:36.565 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:39:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:39:36.566 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:39:36.566 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:39:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:39:36.567 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-unexpected-clone 2026-02-23T08:39:36.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:39:36.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.568 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.568 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.1018865 2026-02-23T08:39:36.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:39:36.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:39:36.569 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-unexpected-clone 2026-02-23T08:39:36.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-23T08:39:36.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.570 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.571 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.1018865 2026-02-23T08:39:36.573 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-23T08:39:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-23T08:39:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-23T08:39:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-23T08:39:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-unexpected-clone 1' TERM HUP INT 2026-02-23T08:39:36.573 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:34: run: TEST_recover_unexpected td/osd-unexpected-clone 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:40: TEST_recover_unexpected: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:42: TEST_recover_unexpected: run_mon td/osd-unexpected-clone a 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-unexpected-clone/a 2026-02-23T08:39:36.574 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-unexpected-clone/a --run-dir=td/osd-unexpected-clone 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:36.589 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-unexpected-clone/a '--log-file=td/osd-unexpected-clone/$name.log' '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --mon-cluster-log-file=td/osd-unexpected-clone/log --run-dir=td/osd-unexpected-clone '--pid-file=td/osd-unexpected-clone/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-23T08:39:36.608 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-23T08:39:36.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-23T08:39:36.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:39:36.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:39:36.610 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.1018865/ceph-mon.a.asok 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:39:36.611 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.1018865/ceph-mon.a.asok config get fsid 2026-02-23T08:39:36.668 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.669 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.1018865/ceph-mon.a.asok 2026-02-23T08:39:36.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-23T08:39:36.670 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.1018865/ceph-mon.a.asok config get mon_host 2026-02-23T08:39:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:43: TEST_recover_unexpected: run_mgr td/osd-unexpected-clone x 2026-02-23T08:39:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-23T08:39:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-23T08:39:36.725 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-23T08:39:36.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-unexpected-clone/x 2026-02-23T08:39:36.726 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-23T08:39:36.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-23T08:39:36.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:36.817 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:36.818 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:36.818 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.818 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:36.818 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:39:36.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-unexpected-clone/x '--log-file=td/osd-unexpected-clone/$name.log' '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --run-dir=td/osd-unexpected-clone '--pid-file=td/osd-unexpected-clone/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-23T08:39:36.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:44: TEST_recover_unexpected: run_osd td/osd-unexpected-clone 0 2026-02-23T08:39:36.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:39:36.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:39:36.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-23T08:39:36.835 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-unexpected-clone/0 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/0' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/0/journal' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:39:36.836 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:39:36.837 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-unexpected-clone/0 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=630d37ea-224b-409c-8dbf-19caaa5e194e 2026-02-23T08:39:36.838 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 630d37ea-224b-409c-8dbf-19caaa5e194e' 2026-02-23T08:39:36.839 INFO:tasks.workunit.client.0.trial129.stdout:add osd0 630d37ea-224b-409c-8dbf-19caaa5e194e 2026-02-23T08:39:36.839 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:39:36.842 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBIEpxp27UtMhAAhv+JKhgcLdIhoyF0OYw6lQ== 2026-02-23T08:39:36.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBIEpxp27UtMhAAhv+JKhgcLdIhoyF0OYw6lQ=="}' 2026-02-23T08:39:36.843 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 630d37ea-224b-409c-8dbf-19caaa5e194e -i td/osd-unexpected-clone/0/new.json 2026-02-23T08:39:36.930 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:39:36.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-unexpected-clone/0/new.json 2026-02-23T08:39:36.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/0 --osd-journal=td/osd-unexpected-clone/0/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBIEpxp27UtMhAAhv+JKhgcLdIhoyF0OYw6lQ== --osd-uuid 630d37ea-224b-409c-8dbf-19caaa5e194e 2026-02-23T08:39:36.954 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:36.952+0000 7ffa70169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:36.955 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:36.954+0000 7ffa70169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:36.957 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:36.954+0000 7ffa70169780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:36.957 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:36.955+0000 7ffa70169780 -1 bdev(0x55b32fa57400 td/osd-unexpected-clone/0/block) open stat got: (1) Operation not permitted 2026-02-23T08:39:36.957 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:36.955+0000 7ffa70169780 -1 bluestore(td/osd-unexpected-clone/0) _read_fsid unparsable uuid 2026-02-23T08:39:37.390 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-unexpected-clone/0/keyring 2026-02-23T08:39:37.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:39:37.391 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-23T08:39:37.391 INFO:tasks.workunit.client.0.trial129.stdout:adding osd0 key to auth repository 2026-02-23T08:39:37.392 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-unexpected-clone/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:39:37.487 INFO:tasks.workunit.client.0.trial129.stdout:start osd.0 2026-02-23T08:39:37.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-23T08:39:37.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/0 --osd-journal=td/osd-unexpected-clone/0/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:39:37.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:39:37.488 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:39:37.489 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:39:37.499 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:37.498+0000 7fb5c9547780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:37.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:37.499+0000 7fb5c9547780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:37.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:37.500+0000 7fb5c9547780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:37.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-23T08:39:37.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:37.576 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:37.577 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:39:37.669 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:37.713 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:37.712+0000 7fb5c9547780 -1 Falling back to public interface 2026-02-23T08:39:38.050 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:38.049+0000 7fb5c9547780 -1 osd.0 0 log_to_monitors true 2026-02-23T08:39:38.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:38.670 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:38.671 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:39:38.671 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:38.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:38.672 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-23T08:39:38.761 INFO:tasks.workunit.client.0.trial129.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2094616064,v1:127.0.0.1:6801/2094616064] [v2:127.0.0.1:6802/2094616064,v1:127.0.0.1:6803/2094616064] exists,up 630d37ea-224b-409c-8dbf-19caaa5e194e 2026-02-23T08:39:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:45: TEST_recover_unexpected: run_osd td/osd-unexpected-clone 1 2026-02-23T08:39:38.765 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-unexpected-clone/1 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/1' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/1/journal' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:38.766 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:39:38.767 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-unexpected-clone/1 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e354aae9-415a-4439-b779-8ae3478adfc2 2026-02-23T08:39:38.768 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e354aae9-415a-4439-b779-8ae3478adfc2' 2026-02-23T08:39:38.769 INFO:tasks.workunit.client.0.trial129.stdout:add osd1 e354aae9-415a-4439-b779-8ae3478adfc2 2026-02-23T08:39:38.769 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:39:38.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBKEpxp0936LRAAnHR5uEyv8gNcWDuguYpdZA== 2026-02-23T08:39:38.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBKEpxp0936LRAAnHR5uEyv8gNcWDuguYpdZA=="}' 2026-02-23T08:39:38.772 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e354aae9-415a-4439-b779-8ae3478adfc2 -i td/osd-unexpected-clone/1/new.json 2026-02-23T08:39:38.860 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:39:38.869 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-unexpected-clone/1/new.json 2026-02-23T08:39:38.870 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBKEpxp0936LRAAnHR5uEyv8gNcWDuguYpdZA== --osd-uuid e354aae9-415a-4439-b779-8ae3478adfc2 2026-02-23T08:39:38.882 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:38.881+0000 7f751634b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:38.884 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:38.882+0000 7f751634b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:38.884 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:38.883+0000 7f751634b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:38.885 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:38.883+0000 7f751634b780 -1 bdev(0x560e944df400 td/osd-unexpected-clone/1/block) open stat got: (1) Operation not permitted 2026-02-23T08:39:38.885 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:38.883+0000 7f751634b780 -1 bluestore(td/osd-unexpected-clone/1) _read_fsid unparsable uuid 2026-02-23T08:39:39.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-unexpected-clone/1/keyring 2026-02-23T08:39:39.285 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:39:39.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-23T08:39:39.287 INFO:tasks.workunit.client.0.trial129.stdout:adding osd1 key to auth repository 2026-02-23T08:39:39.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-unexpected-clone/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:39:39.489 INFO:tasks.workunit.client.0.trial129.stdout:start osd.1 2026-02-23T08:39:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-23T08:39:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:39:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:39:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:39:39.490 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:39:39.500 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:39.498+0000 7f44a7abf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:39.501 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:39.499+0000 7f44a7abf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:39.502 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:39.500+0000 7f44a7abf780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:39.651 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:39:39.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:39.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:39.652 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:39:39.716 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:39.714+0000 7f44a7abf780 -1 Falling back to public interface 2026-02-23T08:39:39.815 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:40.062 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:40.060+0000 7f44a7abf780 -1 osd.1 0 log_to_monitors true 2026-02-23T08:39:40.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:40.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:40.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:40.817 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:39:40.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:40.817 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:39:40.982 INFO:tasks.workunit.client.0.trial129.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/85055170,v1:127.0.0.1:6811/85055170] [v2:127.0.0.1:6812/85055170,v1:127.0.0.1:6813/85055170] exists,up e354aae9-415a-4439-b779-8ae3478adfc2 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:46: TEST_recover_unexpected: run_osd td/osd-unexpected-clone 2 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-23T08:39:40.986 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:39:40.987 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:39:40.988 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:39:40.989 INFO:tasks.workunit.client.0.trial129.stdout:add osd2 5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:39:40.990 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5f04f39f-03a0-4525-93a8-eaab2118c6bf' 2026-02-23T08:39:40.990 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-23T08:39:40.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBMEpxp42MvOxAAP9SwDlyoOA2kn6Cj2Abr8Q== 2026-02-23T08:39:40.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBMEpxp42MvOxAAP9SwDlyoOA2kn6Cj2Abr8Q=="}' 2026-02-23T08:39:40.994 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5f04f39f-03a0-4525-93a8-eaab2118c6bf -i td/osd-unexpected-clone/2/new.json 2026-02-23T08:39:41.152 INFO:tasks.workunit.client.0.trial129.stdout:2 2026-02-23T08:39:41.163 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-unexpected-clone/2/new.json 2026-02-23T08:39:41.164 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBMEpxp42MvOxAAP9SwDlyoOA2kn6Cj2Abr8Q== --osd-uuid 5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:39:41.176 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.174+0000 7f7168b54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:41.178 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.176+0000 7f7168b54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:41.178 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.177+0000 7f7168b54780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:41.179 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.177+0000 7f7168b54780 -1 bdev(0x55b297f97400 td/osd-unexpected-clone/2/block) open stat got: (1) Operation not permitted 2026-02-23T08:39:41.179 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.177+0000 7f7168b54780 -1 bluestore(td/osd-unexpected-clone/2) _read_fsid unparsable uuid 2026-02-23T08:39:41.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-unexpected-clone/2/keyring 2026-02-23T08:39:41.586 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-23T08:39:41.587 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-23T08:39:41.588 INFO:tasks.workunit.client.0.trial129.stdout:adding osd2 key to auth repository 2026-02-23T08:39:41.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-unexpected-clone/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-23T08:39:41.792 INFO:tasks.workunit.client.0.trial129.stdout:start osd.2 2026-02-23T08:39:41.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-23T08:39:41.793 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:39:41.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-23T08:39:41.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-23T08:39:41.794 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-23T08:39:41.805 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.803+0000 7fba6c96d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:41.806 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.804+0000 7fba6c96d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:41.807 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.805+0000 7fba6c96d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:41.944 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:41.942+0000 7fba6c96d780 -1 Falling back to public interface 2026-02-23T08:39:41.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-23T08:39:41.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:41.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:39:41.960 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:41.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:41.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:41.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:41.961 INFO:tasks.workunit.client.0.trial129.stdout:0 2026-02-23T08:39:41.961 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:41.962 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:39:42.121 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:42.320 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:42.319+0000 7fba6c96d780 -1 osd.2 0 log_to_monitors true 2026-02-23T08:39:43.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:43.123 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:43.123 INFO:tasks.workunit.client.0.trial129.stdout:1 2026-02-23T08:39:43.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:43.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:43.124 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:39:43.285 INFO:tasks.workunit.client.0.trial129.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3299998053,v1:127.0.0.1:6819/3299998053] [v2:127.0.0.1:6820/3299998053,v1:127.0.0.1:6821/3299998053] exists,up 5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:39:43.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:43.286 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:43.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:43.287 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:48: TEST_recover_unexpected: ceph osd pool create foo 1 2026-02-23T08:39:43.450 INFO:tasks.workunit.client.0.trial129.stderr:pool 'foo' created 2026-02-23T08:39:43.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:49: TEST_recover_unexpected: rados -p foo put foo /etc/passwd 2026-02-23T08:39:45.093 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:50: TEST_recover_unexpected: rados -p foo mksnap snap 2026-02-23T08:39:45.139 INFO:tasks.workunit.client.0.trial129.stdout:created pool foo snap snap 2026-02-23T08:39:45.140 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:51: TEST_recover_unexpected: rados -p foo put foo /etc/group 2026-02-23T08:39:45.156 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:53: TEST_recover_unexpected: wait_for_clean 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:45.157 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:45.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:39:45.229 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:45.393 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:45.394 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:45.394 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:45.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:45.394 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:45.394 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:45.467 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836483 2026-02-23T08:39:45.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836483 2026-02-23T08:39:45.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483' 2026-02-23T08:39:45.468 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:45.468 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:45.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672963 2026-02-23T08:39:45.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672963 2026-02-23T08:39:45.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963' 2026-02-23T08:39:45.541 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:45.542 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:45.613 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509442 2026-02-23T08:39:45.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509442 2026-02-23T08:39:45.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836483 1-42949672963 2-64424509442' 2026-02-23T08:39:45.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:45.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836483 2026-02-23T08:39:45.614 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:45.614 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:45.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836483 2026-02-23T08:39:45.615 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:45.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836483 2026-02-23T08:39:45.616 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836483' 2026-02-23T08:39:45.617 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.0 seq 21474836483 2026-02-23T08:39:45.617 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:45.778 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836483 2026-02-23T08:39:45.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:46.779 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:39:46.780 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:46.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836483 2026-02-23T08:39:46.945 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:46.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672963 2026-02-23T08:39:46.946 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:46.947 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:46.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672963 2026-02-23T08:39:46.947 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:46.948 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672963 2026-02-23T08:39:46.949 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672963' 2026-02-23T08:39:46.949 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.1 seq 42949672963 2026-02-23T08:39:46.949 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:47.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672963 2026-02-23T08:39:47.115 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:47.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509442 2026-02-23T08:39:47.116 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:47.117 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:47.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509442 2026-02-23T08:39:47.117 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:47.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509442 2026-02-23T08:39:47.119 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509442' 2026-02-23T08:39:47.119 INFO:tasks.workunit.client.0.trial129.stdout:waiting osd.2 seq 64424509442 2026-02-23T08:39:47.119 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:47.282 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509442 -lt 64424509442 2026-02-23T08:39:47.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:47.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:47.283 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:47.487 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:47.648 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:47.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:47.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:47.649 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:55: TEST_recover_unexpected: get_primary foo foo 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1187: get_primary: local poolname=foo 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1188: get_primary: local objectname=foo 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1190: get_primary: ceph --format json osd map foo foo 2026-02-23T08:39:47.851 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1191: get_primary: jq .acting_primary 2026-02-23T08:39:48.014 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:55: TEST_recover_unexpected: local osd=1 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:57: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 1 --op list foo 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:57: TEST_recover_unexpected: grep snapid.:1 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 1 --op list foo 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.1 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:48.016 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:48.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:48.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:48.017 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 1 --op list foo 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/1 2026-02-23T08:39:48.121 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/1 --op list foo 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 1 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/1 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/1' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/1/journal' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:39:48.224 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:39:48.225 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:39:48.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/1 2026-02-23T08:39:48.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:39:48.226 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:39:48.226 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:39:48.226 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/1/whoami 2026-02-23T08:39:48.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:39:48.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:39:48.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:39:48.227 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:39:48.238 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:48.236+0000 7f4e49607780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:48.239 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:48.238+0000 7f4e49607780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:48.240 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:48.238+0000 7f4e49607780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:39:48.389 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:48.390 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:39:48.445 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:48.443+0000 7f4e49607780 -1 Falling back to public interface 2026-02-23T08:39:48.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:48.811 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:48.809+0000 7f4e49607780 -1 osd.1 19 log_to_monitors true 2026-02-23T08:39:49.556 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:49.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:49.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:49.557 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:49.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:49.557 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 23 up_thru 23 down_at 20 last_clean_interval [10,19) [v2:127.0.0.1:6810/2336181695,v1:127.0.0.1:6811/2336181695] [v2:127.0.0.1:6812/2336181695,v1:127.0.0.1:6813/2336181695] exists,up e354aae9-415a-4439-b779-8ae3478adfc2 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:49.723 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:49.724 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:49.724 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:49.724 INFO:tasks.workunit.client.0.trial129.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:49.724 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:49.724 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:49.724 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:39:49.796 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:49.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:49.957 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:49.957 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:49.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:49.957 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:49.957 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:50.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-23T08:39:50.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-23T08:39:50.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485' 2026-02-23T08:39:50.030 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:50.030 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:50.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=98784247810 2026-02-23T08:39:50.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 98784247810 2026-02-23T08:39:50.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-98784247810' 2026-02-23T08:39:50.101 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:50.101 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:50.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509444 2026-02-23T08:39:50.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509444 2026-02-23T08:39:50.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836485 1-98784247810 2-64424509444' 2026-02-23T08:39:50.173 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:50.173 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836485 2026-02-23T08:39:50.173 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:50.174 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:50.175 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-23T08:39:50.175 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:50.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836485 2026-02-23T08:39:50.176 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-23T08:39:50.176 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836485 2026-02-23T08:39:50.176 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:50.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-23T08:39:50.339 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:51.341 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:39:51.342 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:51.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-23T08:39:51.509 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:51.509 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-98784247810 2026-02-23T08:39:51.510 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:51.510 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:51.511 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-98784247810 2026-02-23T08:39:51.511 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:51.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=98784247810 2026-02-23T08:39:51.512 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 98784247810' 2026-02-23T08:39:51.512 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 98784247810 2026-02-23T08:39:51.512 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:51.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 98784247810 -lt 98784247810 2026-02-23T08:39:51.674 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:51.675 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509444 2026-02-23T08:39:51.675 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:51.676 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:51.676 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509444 2026-02-23T08:39:51.676 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:51.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509444 2026-02-23T08:39:51.677 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509444' 2026-02-23T08:39:51.677 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 64424509444 2026-02-23T08:39:51.678 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:51.842 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509444 -lt 64424509444 2026-02-23T08:39:51.842 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:51.843 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:51.843 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:52.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:52.045 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:52.045 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:52.045 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:52.045 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:52.045 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:52.046 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:52.046 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:52.208 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:52.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:52.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:52.208 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:52.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:52.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:52.412 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:52.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:57: TEST_recover_unexpected: JSON='["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:39:52.412 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:58: TEST_recover_unexpected: echo 'JSON is ["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' 2026-02-23T08:39:52.413 INFO:tasks.workunit.client.0.trial129.stdout:JSON is ["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}] 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:59: TEST_recover_unexpected: rm -f td/osd-unexpected-clone/_ td/osd-unexpected-clone/data 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:60: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=1 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-23T08:39:52.415 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=1 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.1 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:52.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/1 2026-02-23T08:39:52.721 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/1 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-attr _ 2026-02-23T08:39:52.818 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 1 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/1 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:52.819 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/1' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/1/journal' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:52.820 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/1 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-23T08:39:52.821 INFO:tasks.workunit.client.0.trial129.stderr:start osd.1 2026-02-23T08:39:52.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/1 --osd-journal=td/osd-unexpected-clone/1/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:39:52.822 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/1/whoami 2026-02-23T08:39:52.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-23T08:39:52.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:39:52.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:39:52.822 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:39:52.829 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:52.827+0000 7f63ffa0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:52.830 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:52.829+0000 7f63ffa0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:52.831 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:52.829+0000 7f63ffa0a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:52.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-23T08:39:52.982 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:52.983 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:39:52.993 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:52.992+0000 7f63ffa0a780 -1 Falling back to public interface 2026-02-23T08:39:53.147 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:53.340 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:53.338+0000 7f63ffa0a780 -1 osd.1 24 log_to_monitors true 2026-02-23T08:39:54.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:54.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:54.148 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:54.148 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:54.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:54.149 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:osd.1 up in weight 1 up_from 28 up_thru 28 down_at 25 last_clean_interval [23,24) [v2:127.0.0.1:6810/4198022854,v1:127.0.0.1:6811/4198022854] [v2:127.0.0.1:6812/4198022854,v1:127.0.0.1:6813/4198022854] exists,up e354aae9-415a-4439-b779-8ae3478adfc2 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:54.313 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:54.314 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:54.314 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:54.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:54.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:54.314 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:54.387 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:39:54.387 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:54.549 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:54.549 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:54.549 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:54.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:54.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:54.550 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:54.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-23T08:39:54.624 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-23T08:39:54.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-23T08:39:54.625 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:54.625 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:54.698 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084290 2026-02-23T08:39:54.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084290 2026-02-23T08:39:54.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-120259084290' 2026-02-23T08:39:54.699 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:54.699 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:54.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=64424509446 2026-02-23T08:39:54.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 64424509446 2026-02-23T08:39:54.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-120259084290 2-64424509446' 2026-02-23T08:39:54.774 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:54.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-23T08:39:54.774 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:54.775 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:54.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-23T08:39:54.775 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:54.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-23T08:39:54.776 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-23T08:39:54.776 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836487 2026-02-23T08:39:54.776 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:54.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-23T08:39:54.940 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:54.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084290 2026-02-23T08:39:54.941 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:54.941 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:54.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084290 2026-02-23T08:39:54.942 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:54.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084290 2026-02-23T08:39:54.943 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084290' 2026-02-23T08:39:54.943 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 120259084290 2026-02-23T08:39:54.943 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:55.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084290 -lt 120259084290 2026-02-23T08:39:55.108 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:55.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-64424509446 2026-02-23T08:39:55.108 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:55.109 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:55.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-64424509446 2026-02-23T08:39:55.110 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:55.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=64424509446 2026-02-23T08:39:55.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-23T08:39:55.111 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 64424509446 2026-02-23T08:39:55.111 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:55.274 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-23T08:39:55.274 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:55.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:55.275 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:55.476 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:39:55.477 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:39:55.640 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:39:55.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:39:55.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:55.641 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:39:55.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:39:55.846 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:61: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:39:55.847 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.2 2026-02-23T08:39:55.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:39:55.848 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:39:55.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:39:55.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:39:55.848 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:39:56.151 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:39:56.152 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' get-bytes td/osd-unexpected-clone/data 2026-02-23T08:39:56.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 2 2026-02-23T08:39:56.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:39:56.263 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-23T08:39:56.264 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:39:56.265 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:39:56.266 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:39:56.267 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:39:56.267 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/2/whoami 2026-02-23T08:39:56.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:39:56.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:39:56.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:39:56.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:39:56.275 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:56.273+0000 7f57ac208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:56.276 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:56.274+0000 7f57ac208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:56.277 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:56.275+0000 7f57ac208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:56.425 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:39:56.488 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:56.487+0000 7f57ac208780 -1 Falling back to public interface 2026-02-23T08:39:56.588 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:39:56.876 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:39:56.874+0000 7f57ac208780 -1 osd.2 29 log_to_monitors true 2026-02-23T08:39:57.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:39:57.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:39:57.590 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:39:57.591 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:57.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:39:57.591 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:39:57.757 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 33 up_thru 0 down_at 30 last_clean_interval [15,29) [v2:127.0.0.1:6818/3044615799,v1:127.0.0.1:6819/3044615799] [v2:127.0.0.1:6820/3044615799,v1:127.0.0.1:6821/3044615799] exists,up 5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:39:57.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:39:57.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:39:57.757 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:39:57.758 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:39:57.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:39:57.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:39:57.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:39:57.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:39:57.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:39:57.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:39:57.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:39:57.998 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:39:57.998 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:39:57.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:39:57.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:57.998 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:39:58.071 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836488 2026-02-23T08:39:58.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836488 2026-02-23T08:39:58.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488' 2026-02-23T08:39:58.072 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:58.072 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:39:58.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084291 2026-02-23T08:39:58.145 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084291 2026-02-23T08:39:58.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-120259084291' 2026-02-23T08:39:58.146 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:39:58.146 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:39:58.217 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920770 2026-02-23T08:39:58.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920770 2026-02-23T08:39:58.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836488 1-120259084291 2-141733920770' 2026-02-23T08:39:58.218 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:58.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836488 2026-02-23T08:39:58.218 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:58.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:39:58.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836488 2026-02-23T08:39:58.220 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:58.220 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836488 2026-02-23T08:39:58.221 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836488' 2026-02-23T08:39:58.221 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836488 2026-02-23T08:39:58.221 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:58.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836488 2026-02-23T08:39:58.384 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:39:59.385 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:39:59.386 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:39:59.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836488 2026-02-23T08:39:59.550 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:59.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084291 2026-02-23T08:39:59.551 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:59.552 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:39:59.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084291 2026-02-23T08:39:59.552 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:59.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084291 2026-02-23T08:39:59.553 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084291' 2026-02-23T08:39:59.553 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 120259084291 2026-02-23T08:39:59.554 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:39:59.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084292 -lt 120259084291 2026-02-23T08:39:59.719 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:39:59.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-141733920770 2026-02-23T08:39:59.720 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:39:59.720 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:39:59.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-141733920770 2026-02-23T08:39:59.721 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:39:59.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920770 2026-02-23T08:39:59.722 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 141733920770' 2026-02-23T08:39:59.722 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 141733920770 2026-02-23T08:39:59.722 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:39:59.885 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920770 -lt 141733920770 2026-02-23T08:39:59.885 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:39:59.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:39:59.886 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:40:00.088 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:40:00.249 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:40:00.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:40:00.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:40:00.250 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:40:00.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:40:00.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:40:00.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:40:00.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:63: TEST_recover_unexpected: rados -p foo rmsnap snap 2026-02-23T08:40:00.517 INFO:tasks.workunit.client.0.trial129.stdout:removed pool foo snap snap 2026-02-23T08:40:00.518 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:65: TEST_recover_unexpected: sleep 5 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:67: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-23T08:40:05.522 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.2 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:40:05.523 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:40:05.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:40:05.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-23T08:40:05.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-23T08:40:05.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:40:05.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:40:05.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:40:05.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:40:05.831 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-bytes td/osd-unexpected-clone/data 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 2 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:40:06.019 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:40:06.020 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:40:06.021 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/2/whoami 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:40:06.022 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:40:06.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:40:06.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:40:06.030 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:06.028+0000 7f4d6494b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:40:06.031 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:06.029+0000 7f4d6494b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:40:06.032 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:06.030+0000 7f4d6494b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:40:06.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:40:06.183 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:40:06.258 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:06.256+0000 7f4d6494b780 -1 Falling back to public interface 2026-02-23T08:40:06.347 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:40:06.589 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:06.588+0000 7f4d6494b780 -1 osd.2 35 log_to_monitors true 2026-02-23T08:40:07.348 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:40:07.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:40:07.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:40:07.349 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:40:07.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:40:07.349 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:40:07.520 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 36 last_clean_interval [33,35) [v2:127.0.0.1:6818/2129228129,v1:127.0.0.1:6819/2129228129] [v2:127.0.0.1:6820/2129228129,v1:127.0.0.1:6821/2129228129] exists,up 5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:40:07.520 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:40:07.521 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:40:07.522 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:40:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:40:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:40:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:40:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:40:07.594 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:40:07.595 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:40:07.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:40:07.760 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:40:07.760 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:40:07.760 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:40:07.761 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:40:07.761 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:40:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-23T08:40:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-23T08:40:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491' 2026-02-23T08:40:07.832 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:40:07.832 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:40:07.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084294 2026-02-23T08:40:07.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084294 2026-02-23T08:40:07.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-120259084294' 2026-02-23T08:40:07.905 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:40:07.905 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:40:07.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724546 2026-02-23T08:40:07.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724546 2026-02-23T08:40:07.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836491 1-120259084294 2-167503724546' 2026-02-23T08:40:07.975 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:40:07.975 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836491 2026-02-23T08:40:07.976 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:40:07.976 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:40:07.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-23T08:40:07.977 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:40:07.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836491 2026-02-23T08:40:07.978 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-23T08:40:07.978 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836491 2026-02-23T08:40:07.979 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:40:08.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836491 2026-02-23T08:40:08.142 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:40:09.143 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:40:09.144 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:40:09.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-23T08:40:09.308 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:40:09.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084294 2026-02-23T08:40:09.309 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:40:09.309 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:40:09.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084294 2026-02-23T08:40:09.310 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:40:09.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084294 2026-02-23T08:40:09.311 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084294' 2026-02-23T08:40:09.312 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 120259084294 2026-02-23T08:40:09.312 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:40:09.477 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084295 -lt 120259084294 2026-02-23T08:40:09.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:40:09.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724546 2026-02-23T08:40:09.478 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:40:09.478 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:40:09.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724546 2026-02-23T08:40:09.479 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:40:09.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724546 2026-02-23T08:40:09.480 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724546' 2026-02-23T08:40:09.480 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 167503724546 2026-02-23T08:40:09.480 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:40:09.650 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724546 -lt 167503724546 2026-02-23T08:40:09.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:40:09.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:40:09.651 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:40:09.860 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:40:09.861 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:40:10.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:40:10.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:40:10.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:40:10.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:40:10.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:40:10.229 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:40:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:40:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:68: TEST_recover_unexpected: objectstore_tool td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-23T08:40:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1288: objectstore_tool: local dir=td/osd-unexpected-clone 2026-02-23T08:40:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1289: objectstore_tool: shift 2026-02-23T08:40:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1290: objectstore_tool: local id=2 2026-02-23T08:40:10.230 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1291: objectstore_tool: shift 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1293: objectstore_tool: _objectstore_tool_nowait td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nowait: local dir=td/osd-unexpected-clone 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nowait: shift 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1262: _objectstore_tool_nowait: local id=2 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1263: _objectstore_tool_nowait: shift 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nowait: kill_daemons td/osd-unexpected-clone TERM osd.2 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:40:10.231 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:40:10.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:40:10.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:40:10.232 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1267: _objectstore_tool_nowait: _objectstore_tool_nodown td/osd-unexpected-clone 2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/osd-unexpected-clone 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:40:10.334 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/osd-unexpected-clone/2 '["1.0",{"oid":"foo","key":"","snapid":1,"hash":2143417350,"max":0,"pool":1,"namespace":"","max":0}]' set-attr _ td/osd-unexpected-clone/_ 2026-02-23T08:40:10.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1268: _objectstore_tool_nowait: activate_osd td/osd-unexpected-clone 2 2026-02-23T08:40:10.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-unexpected-clone 2026-02-23T08:40:10.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-23T08:40:10.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-23T08:40:10.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-23T08:40:10.525 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-unexpected-clone/2 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 ' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-unexpected-clone/2' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-unexpected-clone/2/journal' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-unexpected-clone' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-23T08:40:10.526 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-unexpected-clone/$name.log' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-unexpected-clone/$name.pid' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-23T08:40:10.527 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-unexpected-clone/2 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr:start osd.2 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=cb56cd10-47fc-4dd9-b378-6bcf767ec1d1 --auth-supported=none --mon-host=127.0.0.1:7144 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-unexpected-clone/2 --osd-journal=td/osd-unexpected-clone/2/journal --chdir= --run-dir=td/osd-unexpected-clone '--admin-socket=/tmp/ceph-asok.1018865/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-unexpected-clone/$name.log' '--pid-file=td/osd-unexpected-clone/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-unexpected-clone/2/whoami 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-23T08:40:10.528 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-23T08:40:10.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-23T08:40:10.537 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:10.535+0000 7f3dc240d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:40:10.538 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:10.536+0000 7f3dc240d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:40:10.538 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:10.537+0000 7f3dc240d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-23T08:40:10.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-23T08:40:10.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-23T08:40:10.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-23T08:40:10.692 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-23T08:40:10.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-23T08:40:10.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:40:10.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-23T08:40:10.693 INFO:tasks.workunit.client.0.trial129.stderr:0 2026-02-23T08:40:10.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:40:10.693 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:40:10.747 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:10.746+0000 7f3dc240d780 -1 Falling back to public interface 2026-02-23T08:40:10.854 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-23T08:40:11.081 INFO:tasks.workunit.client.0.trial129.stderr:2026-02-23T08:40:11.079+0000 7f3dc240d780 -1 osd.2 40 log_to_monitors true 2026-02-23T08:40:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-23T08:40:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-23T08:40:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-23T08:40:11.856 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:40:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-23T08:40:11.856 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-23T08:40:12.022 INFO:tasks.workunit.client.0.trial129.stderr:osd.2 up in weight 1 up_from 44 up_thru 0 down_at 41 last_clean_interval [39,40) [v2:127.0.0.1:6818/213262160,v1:127.0.0.1:6819/213262160] [v2:127.0.0.1:6820/213262160,v1:127.0.0.1:6821/213262160] exists,up 5f04f39f-03a0-4525-93a8-eaab2118c6bf 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1294: objectstore_tool: wait_for_clean 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-23T08:40:12.023 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-23T08:40:12.024 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-23T08:40:12.024 INFO:tasks.workunit.client.0.trial129.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-23T08:40:12.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-23T08:40:12.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-23T08:40:12.024 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-23T08:40:12.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-23T08:40:12.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-23T08:40:12.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-23T08:40:12.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-23T08:40:12.098 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-23T08:40:12.098 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-23T08:40:12.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-23T08:40:12.268 INFO:tasks.workunit.client.0.trial129.stderr:1 2026-02-23T08:40:12.268 INFO:tasks.workunit.client.0.trial129.stderr:2' 2026-02-23T08:40:12.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-23T08:40:12.268 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:40:12.269 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-23T08:40:12.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-23T08:40:12.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-23T08:40:12.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-23T08:40:12.342 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:40:12.342 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-23T08:40:12.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=120259084296 2026-02-23T08:40:12.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 120259084296 2026-02-23T08:40:12.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-120259084296' 2026-02-23T08:40:12.416 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-23T08:40:12.417 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-23T08:40:12.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=188978561026 2026-02-23T08:40:12.493 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 188978561026 2026-02-23T08:40:12.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-120259084296 2-188978561026' 2026-02-23T08:40:12.494 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:40:12.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-23T08:40:12.494 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:40:12.495 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-23T08:40:12.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-23T08:40:12.495 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:40:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-23T08:40:12.496 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-23T08:40:12.496 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.0 seq 21474836493 2026-02-23T08:40:12.496 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:40:12.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836492 -lt 21474836493 2026-02-23T08:40:12.659 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-23T08:40:13.660 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-23T08:40:13.661 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-23T08:40:13.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-23T08:40:13.827 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:40:13.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-120259084296 2026-02-23T08:40:13.827 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:40:13.828 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-23T08:40:13.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-120259084296 2026-02-23T08:40:13.829 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:40:13.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=120259084296 2026-02-23T08:40:13.830 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 120259084296' 2026-02-23T08:40:13.830 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.1 seq 120259084296 2026-02-23T08:40:13.830 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-23T08:40:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 120259084296 -lt 120259084296 2026-02-23T08:40:13.996 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-23T08:40:13.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-188978561026 2026-02-23T08:40:13.996 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-23T08:40:13.997 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-23T08:40:13.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-188978561026 2026-02-23T08:40:13.997 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-23T08:40:13.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=188978561026 2026-02-23T08:40:13.998 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 188978561026' 2026-02-23T08:40:13.999 INFO:tasks.workunit.client.0.trial129.stderr:waiting osd.2 seq 188978561026 2026-02-23T08:40:13.999 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-23T08:40:14.162 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 188978561026 -lt 188978561026 2026-02-23T08:40:14.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-23T08:40:14.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:40:14.163 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-23T08:40:14.367 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-23T08:40:14.368 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-23T08:40:14.529 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-23T08:40:14.529 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-23T08:40:14.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-23T08:40:14.530 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-23T08:40:14.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-23T08:40:14.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-23T08:40:14.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-23T08:40:14.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:70: TEST_recover_unexpected: sleep 5 2026-02-23T08:40:19.733 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:72: TEST_recover_unexpected: ceph pg repair 1.0 2026-02-23T08:40:19.890 INFO:tasks.workunit.client.0.trial129.stderr:instructing pg 1.0 on osd.1 to repair 2026-02-23T08:40:19.901 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:74: TEST_recover_unexpected: sleep 10 2026-02-23T08:40:29.902 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:76: TEST_recover_unexpected: ceph log last 2026-02-23T08:40:30.099 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:20.244469+0000 osd.1 (osd.1) 3 : cluster [ERR] 1.0 shard 1 1:602f83fe:::foo:1 : missing 2026-02-23T08:40:30.100 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:20.244520+0000 osd.1 (osd.1) 4 : cluster [ERR] repair 1.0 1:602f83fe:::foo:1 : is an unexpected clone 2026-02-23T08:40:30.100 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:20.244590+0000 osd.1 (osd.1) 5 : cluster [ERR] 1.0 repair 1 missing, 0 inconsistent objects 2026-02-23T08:40:30.100 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:20.244597+0000 osd.1 (osd.1) 6 : cluster [ERR] 1.0 repair 1 missing, 0 inconsistent objects 2026-02-23T08:40:30.100 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:20.244617+0000 osd.1 (osd.1) 7 : cluster [ERR] 1.0 repair 3 errors, 2 fixed 2026-02-23T08:40:30.100 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199203+0000 osd.1 (osd.1) 9 : cluster [ERR] 1.0 shard 1 soid 1:602f83fe:::foo:1 : candidate size 0 info size 15284 mismatch 2026-02-23T08:40:30.100 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199235+0000 osd.1 (osd.1) 10 : cluster [ERR] 1.0 shard 0 soid 1:602f83fe:::foo:1 : data_digest 0xfc21523d != data_digest 0x71587dc6 from auth oi 1:602f83fe:::foo:1(19'2 client.4150.0:1 dirty|data_digest s 15284 uv 1 dd 71587dc6 alloc_hint [0 0 0]) 2026-02-23T08:40:30.101 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199237+0000 osd.1 (osd.1) 11 : cluster [ERR] 1.0 shard 1 soid 1:602f83fe:::foo:1 : data_digest 0xffffffff != data_digest 0xfc21523d from shard 0, data_digest 0xffffffff != data_digest 0x71587dc6 from auth oi 1:602f83fe:::foo:1(19'2 client.4150.0:1 dirty|data_digest s 15284 uv 1 dd 71587dc6 alloc_hint [0 0 0]), size 0 != size 15284 from auth oi 1:602f83fe:::foo:1(19'2 client.4150.0:1 dirty|data_digest s 15284 uv 1 dd 71587dc6 alloc_hint [0 0 0]), size 0 != size 15284 from shard 0 2026-02-23T08:40:30.101 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199238+0000 osd.1 (osd.1) 12 : cluster [ERR] 1.0 soid 1:602f83fe:::foo:1 : data_digest 0x71587dc6 != data_digest 0xfc21523d from shard 0 2026-02-23T08:40:30.101 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199285+0000 osd.1 (osd.1) 13 : cluster [ERR] deep-scrub 1.0 1:602f83fe:::foo:1 : is an unexpected clone 2026-02-23T08:40:30.101 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199372+0000 osd.1 (osd.1) 14 : cluster [ERR] 1.0 deep-scrub 0 missing, 1 inconsistent objects 2026-02-23T08:40:30.101 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:21.199373+0000 osd.1 (osd.1) 15 : cluster [ERR] 1.0 deep-scrub 4 errors 2026-02-23T08:40:30.101 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:24.867481+0000 mon.a (mon.0) 227 : cluster [ERR] Health check failed: 4 scrub errors (OSD_SCRUB_ERRORS) 2026-02-23T08:40:30.102 INFO:tasks.workunit.client.0.trial129.stdout:2026-02-23T08:40:24.867500+0000 mon.a (mon.0) 228 : cluster [ERR] Health check failed: Possible data damage: 1 pg inconsistent (PG_DAMAGED) 2026-02-23T08:40:30.111 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:79: TEST_recover_unexpected: timeout 60 ceph tell osd.0 version 2026-02-23T08:40:30.175 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:40:30.175 INFO:tasks.workunit.client.0.trial129.stdout: "version": "20.3.0-5433-g5adce3ff", 2026-02-23T08:40:30.175 INFO:tasks.workunit.client.0.trial129.stdout: "release": "tentacle", 2026-02-23T08:40:30.175 INFO:tasks.workunit.client.0.trial129.stdout: "release_type": "dev" 2026-02-23T08:40:30.175 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:40:30.182 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:80: TEST_recover_unexpected: timeout 60 ceph tell osd.1 version 2026-02-23T08:40:30.248 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:40:30.248 INFO:tasks.workunit.client.0.trial129.stdout: "version": "20.3.0-5433-g5adce3ff", 2026-02-23T08:40:30.248 INFO:tasks.workunit.client.0.trial129.stdout: "release": "tentacle", 2026-02-23T08:40:30.248 INFO:tasks.workunit.client.0.trial129.stdout: "release_type": "dev" 2026-02-23T08:40:30.248 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:40:30.256 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:81: TEST_recover_unexpected: timeout 60 ceph tell osd.2 version 2026-02-23T08:40:30.321 INFO:tasks.workunit.client.0.trial129.stdout:{ 2026-02-23T08:40:30.321 INFO:tasks.workunit.client.0.trial129.stdout: "version": "20.3.0-5433-g5adce3ff", 2026-02-23T08:40:30.321 INFO:tasks.workunit.client.0.trial129.stdout: "release": "tentacle", 2026-02-23T08:40:30.321 INFO:tasks.workunit.client.0.trial129.stdout: "release_type": "dev" 2026-02-23T08:40:30.321 INFO:tasks.workunit.client.0.trial129.stdout:} 2026-02-23T08:40:30.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh:35: run: teardown td/osd-unexpected-clone 2026-02-23T08:40:30.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-unexpected-clone 2026-02-23T08:40:30.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-23T08:40:30.329 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-unexpected-clone KILL 2026-02-23T08:40:30.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:40:30.330 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:40:30.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:40:30.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:40:30.330 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:40:30.436 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:40:30.436 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:40:30.437 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:40:30.437 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:40:30.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:40:30.438 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:40:30.438 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:40:30.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:40:30.439 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:40:30.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:40:30.440 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:40:30.440 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:40:30.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-23T08:40:30.441 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-unexpected-clone 2026-02-23T08:40:30.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:40:30.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:40:30.451 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:40:30.451 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.1018865 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-unexpected-clone 0 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-unexpected-clone 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-23T08:40:30.453 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-unexpected-clone KILL 2026-02-23T08:40:30.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-23T08:40:30.454 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-23T08:40:30.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-23T08:40:30.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-23T08:40:30.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-23T08:40:30.454 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-23T08:40:30.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-23T08:40:30.455 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-23T08:40:30.455 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-23T08:40:30.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-23T08:40:30.456 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-23T08:40:30.457 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-23T08:40:30.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:40:30.457 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-23T08:40:30.458 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-23T08:40:30.458 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-23T08:40:30.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:40:30.459 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-23T08:40:30.460 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-unexpected-clone 2026-02-23T08:40:30.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-23T08:40:30.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-23T08:40:30.461 INFO:tasks.workunit.client.0.trial129.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.1018865 2026-02-23T08:40:30.461 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.1018865 2026-02-23T08:40:30.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-23T08:40:30.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-23T08:40:30.463 INFO:tasks.workunit.client.0.trial129.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-23T08:40:30.464 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-23T08:40:30.464 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-23T08:40:30.533 INFO:tasks.workunit:Stopping ['scrub'] on client.0... 2026-02-23T08:40:30.534 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-23T08:40:30.887 DEBUG:teuthology.parallel:result is None 2026-02-23T08:40:30.887 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T08:40:30.915 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T08:40:30.915 DEBUG:teuthology.orchestra.run.trial129:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-23T08:40:30.974 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-23T08:40:30.974 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-23T08:40:30.988 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-23T08:40:30.989 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-23T08:40:31.167 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-23T08:40:31.179 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-23T08:40:31.179 DEBUG:teuthology.orchestra.run.trial129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-23T08:40:31.195 INFO:teuthology.orchestra.run.trial129.stderr:bash: line 1: ntpq: command not found 2026-02-23T08:40:31.219 INFO:teuthology.orchestra.run.trial129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-23T08:40:31.220 INFO:teuthology.orchestra.run.trial129.stdout:=============================================================================== 2026-02-23T08:40:31.220 INFO:teuthology.orchestra.run.trial129.stdout:^* 216-144-228-179-host.col> 2 9 377 0 +274us[ +346us] +/- 11ms 2026-02-23T08:40:31.220 INFO:teuthology.orchestra.run.trial129.stdout:^+ 144.202.62.209.vultruser> 3 6 377 139 -738us[ -660us] +/- 20ms 2026-02-23T08:40:31.220 INFO:teuthology.orchestra.run.trial129.stdout:^- neoknet.com 2 9 377 68 +15ms[ +15ms] +/- 110ms 2026-02-23T08:40:31.220 INFO:teuthology.orchestra.run.trial129.stdout:^- connected.by.freedominte> 2 9 377 468 -274us[ -184us] +/- 41ms 2026-02-23T08:40:31.220 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-23T08:40:31.236 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-23T08:40:31.236 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-23T08:40:31.251 DEBUG:teuthology.orchestra.run.trial129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-23T08:40:31.314 DEBUG:teuthology.orchestra.run.trial129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-23T08:40:31.332 INFO:teuthology.orchestra.run.trial129.stderr:grep: Invalid content of \{\} 2026-02-23T08:40:31.343 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-23T08:40:31.344 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-23T08:40:31.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-23T08:40:31.375 INFO:teuthology.task.internal:Duration was 3939.338576 seconds 2026-02-23T08:40:31.376 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-23T08:40:31.393 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-23T08:40:31.394 DEBUG:teuthology.orchestra.run.trial129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-23T08:40:31.433 INFO:teuthology.orchestra.run.trial129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-23T08:40:31.709 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-23T08:40:31.710 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial129.front.sepia.ceph.com 2026-02-23T08:40:31.710 DEBUG:teuthology.orchestra.run.trial129:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-23T08:40:31.769 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-23T08:40:31.769 DEBUG:teuthology.orchestra.run.trial129:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T08:40:31.866 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-23T08:40:31.867 DEBUG:teuthology.orchestra.run.trial129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-23T08:40:31.892 INFO:teuthology.orchestra.run.trial129.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-23T08:40:31.892 INFO:teuthology.orchestra.run.trial129.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-23T08:40:31.893 INFO:teuthology.orchestra.run.trial129.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-23T08:40:31.893 INFO:teuthology.orchestra.run.trial129.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-23T08:40:31.893 INFO:teuthology.orchestra.run.trial129.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-23T08:40:31.902 INFO:teuthology.orchestra.run.trial129.stderr: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-23T08:40:31.904 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-23T08:40:31.916 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-23T08:40:31.916 DEBUG:teuthology.orchestra.run.trial129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-23T08:40:31.972 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-23T08:40:31.991 DEBUG:teuthology.orchestra.run.trial129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:40:32.056 INFO:teuthology.orchestra.run.trial129.stdout:kernel.core_pattern = core 2026-02-23T08:40:32.069 DEBUG:teuthology.orchestra.run.trial129:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-23T08:40:32.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-23T08:40:32.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-23T08:40:32.102 INFO:teuthology.task.internal:Transferring archived files... 2026-02-23T08:40:32.105 DEBUG:teuthology.misc:Transferring archived files from trial129:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-23_07:12:59-rados-wip-bharath8-testing-2026-02-22-0716-distro-default-trial/65533/remote/trial129 2026-02-23T08:40:32.106 DEBUG:teuthology.orchestra.run.trial129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-23T08:40:32.167 INFO:teuthology.task.internal:Removing archive directory... 2026-02-23T08:40:32.167 DEBUG:teuthology.orchestra.run.trial129:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-23T08:40:32.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-23T08:40:32.227 INFO:teuthology.task.internal:Not uploading archives. 2026-02-23T08:40:32.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-23T08:40:32.244 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-23T08:40:32.244 DEBUG:teuthology.orchestra.run.trial129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-23T08:40:32.274 INFO:teuthology.orchestra.run.trial129.stdout: 786901 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 23 08:40 /home/ubuntu/cephtest 2026-02-23T08:40:32.275 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-23T08:40:32.288 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-23T08:40:32.326 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{rpm_latest} workloads/scrub} duration: 3939.3385763168335 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-23T08:40:32.326 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-23T08:40:32.431 INFO:teuthology.run:pass